How to reduce response time of Server List Ping?

My server is always last one in servers list to show its online and etc. It took one second for other servers while mine is more than 5 sec. Ping is 20ms server running on VDS.
Here is screenshot of what i mean:

Also the same thing with entering the server, it took 10 seconds or more but gameplay has no lags.