latency spikes

I  have this strange issue happening to me that I just noticed the last couple of days. Any IP I ping seems to have a latency spike every say 30 seconds or so. I did restart my modem and directly connect my computer and disconnect everything else that's using my internet. I have also tested from another computer and same issue is happening. I am not using wireless. I am also sure it is not malware or a virus or any other thing as I'm the only person who uses this internet connection.

This happens to each and every IP I try to ping.

Here is an example of pinging the 1st hop after my router:

Pinging 10.3.96.1 with 32 bytes of data:
Reply from 10.3.96.1: bytes=32 time=7ms TTL=254
Reply from 10.3.96.1: bytes=32 time=9ms TTL=254
Reply from 10.3.96.1: bytes=32 time=6ms TTL=254
Reply from 10.3.96.1: bytes=32 time=1533ms TTL=254
Reply from 10.3.96.1: bytes=32 time=6ms TTL=254
Reply from 10.3.96.1: bytes=32 time=7ms TTL=254
Reply from 10.3.96.1: bytes=32 time=6ms TTL=254

Ping statistics for 10.3.96.1:

Packets: Sent = 25, Received = 25, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
Minimum = 5ms, Maximum = 1533ms, Average = 67ms

Another example pinging cox.net:

Pinging cox.net [68.99.123.161] with 32 bytes of data:
Reply from 68.99.123.161: bytes=32 time=25ms TTL=56
Reply from 68.99.123.161: bytes=32 time=26ms TTL=56
Reply from 68.99.123.161: bytes=32 time=28ms TTL=56
Reply from 68.99.123.161: bytes=32 time=25ms TTL=56
Reply from 68.99.123.161: bytes=32 time=2011ms TTL=56
Reply from 68.99.123.161: bytes=32 time=26ms TTL=56
Reply from 68.99.123.161: bytes=32 time=26ms TTL=56
Reply from 68.99.123.161: bytes=32 time=25ms TTL=56
Reply from 68.99.123.161: bytes=32 time=28ms TTL=56
Reply from 68.99.123.161: bytes=32 time=26ms TTL=56

Ping statistics for 68.99.123.161:
Packets: Sent = 43, Received = 43, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
Minimum = 24ms, Maximum = 2011ms, Average = 71ms

My download and upload speeds are Ok and I don't think I have packet loss but this is affecting things like online gaming drastically. Can anyone help with this issue or do I have to directly call cox support for this?