Do I have to set up my browser to use the proxy server every time I surf the web?

No. Once you've set up your browser to use the proxy server, the setting will be saved until you change it.