Upstream Packet Loss/Jitter causing issues gaming.

So over the last few months Ive been noticing strange issues while gaming relating to my network. According to the in-game network monitor Im getting packet loss on the upstream side, typically 1-5% ...