Internet Dropout with Airport Extreme & Motorola SB5101N Modem

So I was attempting to download a large game via Origin, about 8GB in size, and my connection was "interrupted" or "dropped" about 10 times during the whole download. I've noticed that the internet tends to cutout for 1 - 5 minutes, particular when requiring a lot of bandwidth, such as downloading large files. All the devices are affected, not just my laptop and I cannot access anything on the internet. We are using an Airport Extreme (the flat one, not the tower looking one[new]) and a Motorola SB5101N modem and we have the high speed internet package.

When I get these "dropouts", the modem shows that it's receiving and sending information, in other words none of the lights go off (as far as I know). The Airport Extreme however sometimes shows a flashing amber-yellow, instead of a solid green light. When I go to my network diagnostics utility software, it goes through a series of checks; WiFi, WiFi Settings, Network Settings, ISP, Internet, Server (in that order). During the "outages" the last two, 'internet' and 'server' turn yellow. Not sure what they mean, but wanted to see if anybody else ran into these issues.

I would think it would be either a router or modem issue, but I don't know how to troubleshoot them since I don't have anything to replace them. I've tried looking through the Apple forums, but haven't found a solution.

Any help would be gladly appreciated.