You need to create an icon file called favicon.ico and put it in your site's public_html or www folder, wherever your site draws it's content from.
That image is then loaded by most browsers and displayed next to the domain and on the tabs (Firefox) for the site.