400-500 ms ping! Service is decent but the ping is crazy high

I am having stupid high ping. It is 400-500 ms on SpeedTest and around the same when playing video games as well. The same ping pretty much with or without the ethernet cord.

I went on my modem's settings gateway to test the ping from my computer (wifi connected) to the router and it was 0ms, so it isn't having issues connecting to the router.

How do I get this fixed?