If you use the ping command in a command prompt, you should be able to see if you have connection between you and the server.
It should look something like this :
You can see in the picture I attached, that the server replied to me, in about 100 milliseconds.
If it can reply, there's a connection between my machine, and the server.