This has been long debated and I’ve been pulled-up on it by several readers. The fact is that there is still division on the subject; some dictionaries and certain publishers still choose “Web site”. There are also differences occurring between UK, US and Australian English.
After doing some research, here is the overall consensus I reached. These are 10 widely recognised and reputable sources, with their chosen use: