Forum Discussion

Yonderway's avatar
Yonderway
New Contributor
7 years ago

Possibly Misbehaving Upstream Node

For about a week now I have been having fairly large packet loss (anywhere from 10-70% depending on time of day) at an upstream node from me (currently 10.39.0.1, strange to me that this is a private block /8 address but I am unfamiliar with Cox's network internal structure).

I would be happy to provide any additional information deemed necessary.

The event logs in my router (C7800, hardware version V1.07, firmware version V3.01.38) shows nothing interesting. 

Here are the results of some ping targets (via PingPlotter Pro with a packet size of 56 bytes) over approximately the last 24 hours (I can share the data set and use other packet sizes if requested):

Home Router/Modem combo (direct gigabit wired connection):

Target Name: 192.168.0.1
IP: 192.168.0.1
Date/Time: 4/17/2018 6:08:09 PM - 4/17/2018 6:18:09 PM

Hop Sent PL% Min Max Avg Host Name / [IP]
1 979 0 0.01 3.00 1.27 192.168.0.1 [192.168.0.1]

First Hop out (potential problem child):

Target Name: 10.39.0.1
IP: 10.39.0.1
Date/Time: 4/17/2018 6:16:13 PM - 4/17/2018 6:26:13 PM

Hop Sent PL% Min Max Avg Host Name / [IP]
1 1024 95 0.41 2.76 1.28 192.168.0.1 [192.168.0.1]
2 1026 71 8.07 397.28 102.04 10.39.0.1 [10.39.0.1]

Google's DNS Server (8.8.8.8):

Target Name: 8.8.8.8
IP: 8.8.8.8
Date/Time: 4/17/2018 6:17:06 PM - 4/17/2018 6:27:06 PM

Hop Sent PL% Min Max Avg Host Name / [IP]
1 1029 99 0.30 1.57 1.20 192.168.0.1 [192.168.0.1]
2 1031 83 8.00 432.13 124.31 10.39.0.1 [10.39.0.1]
3 1032 11 6.81 576.41 75.55 100.127.73.186 [100.127.73.186]
4 1032 14 6.99 422.23 76.36 100.120.100.10 [100.120.100.10]
5 1033 13 18.24 579.26 83.72 langbprj02-ae1.0.rd.la.cox.net [68.1.1.14]
6 1033 20 18.21 575.27 83.96 72.215.224.175 [72.215.224.175]
7 1029 100 0 0 0 [-]
8 1031 24 21.17 569.80 90.73 108.170.234.214 [108.170.234.214]
9 1032 18 18.30 563.42 81.47 216.239.50.161 [216.239.50.161]
10 1032 13 19.50 454.68 86.73 8.8.8.8 [8.8.8.8]

Cloudflare's DNS server (1.1.1.1):

Target Name: 1.1.1.1
IP: 1.1.1.1
Date/Time: 4/17/2018 6:17:35 PM - 4/17/2018 6:27:35 PM

Hop Sent PL% Min Max Avg Host Name / [IP]
1 1034 95 0.54 2.91 1.33 192.168.0.1 [192.168.0.1]
2 1036 47 5.12 418.66 92.10 10.39.0.1 [10.39.0.1]
3 1037 10 9.00 415.94 72.61 100.127.73.186 [100.127.73.186]
4 1037 11 8.19 455.00 75.12 100.120.100.10 [100.120.100.10]
5 1037 12 18.05 427.10 85.07 68.1.4.252 [68.1.4.252]
6 1037 12 19.16 454.03 84.33 141.101.72.254 [141.101.72.254]
7 1037 10 18.01 439.66 83.25 1.1.1.1 [1.1.1.1]

Level 3 DNS Server (4.2.2.1):

Target Name: 4.2.2.1
IP: 4.2.2.1
Date/Time: 4/17/2018 6:18:37 PM - 4/17/2018 6:28:37 PM

Hop Sent PL% Min Max Avg Host Name / [IP]
1 1032 95 1.00 1.82 1.26 192.168.0.1 [192.168.0.1]
2 1033 68 4.42 578.59 94.86 10.39.0.1 [10.39.0.1]
3 1035 19 9.08 570.79 76.02 100.127.73.184 [100.127.73.184]
4 1036 17 7.95 564.64 73.30 100.120.100.6 [100.120.100.6]
5 1032 73 7.70 561.20 76.57 lag-194.bear1.Phoenix1.Level3.net [4.31.188.61]
6 1036 14 16.29 566.77 77.09 ae-1-60.edge3.LosAngeles1.Level3.net [4.69.144.9]
7 1036 20 17.03 665.52 80.13 ae-1-60.edge3.LosAngeles1.Level3.net [4.69.144.9]
8 1036 20 15.37 599.05 85.11 4.2.2.1 [4.2.2.1]

Blizzard HOTS US West Server (24.105.62.129):

Target Name: 24.105.30.129
IP: 24.105.30.129
Date/Time: 4/17/2018 6:20:20 PM - 4/17/2018 6:30:20 PM

Hop Sent PL% Min Max Avg Host Name / [IP]
1 1032 96 0.60 2.63 1.34 192.168.0.1 [192.168.0.1]
2 1034 48 9.34 560.44 109.70 10.39.0.1 [10.39.0.1]
3 1036 12 9.82 556.88 84.02 100.127.73.186 [100.127.73.186]
4 1036 12 9.68 551.84 83.77 100.120.100.10 [100.120.100.10]
5 1036 16 20.03 559.19 92.80 68.1.4.252 [68.1.4.252]
6 1036 13 18.49 553.85 90.69 70.191.61.10 [70.191.61.10]
7 1036 19 18.68 546.57 94.46 ae1-br02-eqla1.blizzardonline.net [137.221.68.35]
8 1036 13 19.88 541.03 88.65 be2-pe01-eqla1.blizzardonline.net [137.221.68.71]
9 1036 16 18.60 586.50 96.50 24.105.30.129 [24.105.30.129]

www.google.com (ipv6):

Target Name: www.google.com
IP: 2607:f8b0:4006:812::2004
Date/Time: 4/17/2018 6:20:35 PM - 4/17/2018 6:30:35 PM

Hop Sent PL% Min Max Avg Host Name / [IP]
1 1035 42 0.35 2.92 1.34 2600:8800:1486:d800:b2b9:8aff:feb0:d3b2 [2600:8800:1486:d800:b2b9:8aff:feb0:d3b2]
2 1036 23 5.28 849.72 120.99 2600:8800:14ff:ffff::1111 [2600:8800:14ff:ffff::1111]
3 1033 60 9.19 429.34 65.39 2001:578:801:fffc:300::38 [2001:578:801:fffc:300::38]
4 1036 10 6.24 435.20 70.85 2001:578:900:4::2 [2001:578:900:4::2]
5 416 10 19.43 411.38 90.35 2001:578:1:0:172:17:249:33 [2001:578:1:0:172:17:249:33]
6 416 9 19.64 379.80 85.90 2001:578:20:a100::7:1 [2001:578:20:a100::7:1]
7 416 9 18.35 375.06 83.47 2607:f8b0:8000:202::1:1 [2607:f8b0:8000:202::1:1]
8 416 9 19.53 467.06 83.68 2001:4860:0:1::2da [2001:4860:0:1::2da]
9 416 9 19.00 462.27 85.14 2001:4860:0:1110::14 [2001:4860:0:1110::14]
10 416 9 19.16 457.19 90.16 2001:4860::c:4000:de3d [2001:4860::c:4000:de3d]
11 416 9 45.26 478.49 116.68 2001:4860::c:4000:d20a [2001:4860::c:4000:d20a]
12 416 9 52.36 478.25 125.70 2001:4860::8:0:ca26 [2001:4860::8:0:ca26]
13 416 9 78.97 499.98 148.55 2001:4860::c:4000:d29f [2001:4860::c:4000:d29f]
14 416 9 77.00 583.96 147.57 2001:4860::c:4001:29de [2001:4860::c:4001:29de]
15 413 58 78.15 488.96 138.00 2001:4860::1:4001:21a [2001:4860::1:4001:21a]
16 416 9 79.62 573.91 142.89 2001:4860:0:1::210b [2001:4860:0:1::210b]
17 1029 9 75.72 520.19 137.74 www.google.com [2607:f8b0:4006:812::2004]

www.amazon.com (ipv4):

Target Name: www.amazon.com
IP: 184.24.124.204
Date/Time: 4/17/2018 6:21:04 PM - 4/17/2018 6:31:04 PM

Hop Sent PL% Min Max Avg Host Name / [IP]
1 1032 80 0.01 3.12 1.28 192.168.0.1 [192.168.0.1]
2 1032 33 4.83 481.53 85.15 10.39.0.1 [10.39.0.1]
3 494 11 10.26 476.98 78.95 100.127.73.184 [100.127.73.184]
4 494 11 9.26 471.72 77.35 100.120.100.6 [100.120.100.6]
5 494 11 8.71 464.65 76.11 chndbbrc01-pos0200.rd.ph.cox.net [68.1.0.153]
6 1033 9 5.99 491.70 77.44 www.amazon.com [184.24.124.204]

AWSEC2 US east (34.192.0.54):

Target Name: 34.192.0.54
IP: 34.192.0.54
Date/Time: 4/17/2018 6:23:30 PM - 4/17/2018 6:33:30 PM

Hop Sent PL% Min Max Avg Host Name / [IP]
1 1030 95 0.66 2.01 1.29 192.168.0.1 [192.168.0.1]
2 1031 65 4.00 528.73 112.42 10.39.0.1 [10.39.0.1]
3 1034 16 7.52 525.28 77.40 100.127.73.186 [100.127.73.186]
4 1034 18 9.15 519.96 79.19 100.120.100.10 [100.120.100.10]
5 1034 14 27.74 538.68 93.58 dalsbprj02-ae1.0.rd.dl.cox.net [68.1.5.140]
6 1034 19 30.84 521.05 96.85 72.21.221.204 [72.21.221.204]
7 1034 18 33.88 546.31 108.29 176.32.125.152 [176.32.125.152]
8 1034 18 25.35 521.00 94.53 176.32.125.157 [176.32.125.157]
9 1030 100 0 0 0 [-]
10 432 18 65.97 447.22 133.12 54.239.46.6 [54.239.46.6]
11 432 15 66.00 541.63 128.13 54.239.42.141 [54.239.42.141]
12 1030 100 0 0 0 [-]
13 404 18 71.40 544.77 152.13 54.239.111.144 [54.239.111.144]
14 1030 100 0 0 0 [-]
15 406 22 64.68 555.19 139.48 52.93.27.41 [52.93.27.41]
16 507 25 65.58 484.58 129.68 52.93.26.162 [52.93.26.162]
17 528 23 63.63 516.76 132.53 52.93.26.146 [52.93.26.146]
18 1030 100 0 0 0 [-]
19 1030 100 0 0 0 [-]
20 1030 100 0 0 0 [-]
21 1030 100 0 0 0 [-]
22 1030 100 0 0 0 [-]
23 1033 18 63.44 508.77 126.77 34.192.0.54 [34.192.0.54]

AWS EC2 US West (50.18.56.1):

Target Name: 50.18.56.1
IP: 50.18.56.1
Date/Time: 4/17/2018 6:24:14 PM - 4/17/2018 6:34:14 PM

Hop Sent PL% Min Max Avg Host Name / [IP]
1 1031 88 0.28 1.61 1.28 192.168.0.1 [192.168.0.1]
2 1034 34 4.77 408.39 81.77 10.39.0.1 [10.39.0.1]
3 1034 15 8.70 433.27 75.73 100.127.73.184 [100.127.73.184]
4 1034 15 7.98 428.22 75.03 100.120.100.6 [100.120.100.6]
5 1033 24 20.00 435.99 92.32 langbprj02-ae1.0.rd.la.cox.net [68.1.1.14]
6 1034 19 18.57 437.91 87.76 52.95.218.216 [52.95.218.216]
7 1030 91 38.12 291.11 81.92 54.239.102.18 [54.239.102.18]
8 1029 100 0 0 0 [-]
9 1034 28 25.35 432.04 93.47 54.239.42.147 [54.239.42.147]
10 1029 100 0 0 0 [-]
11 1034 29 26.39 413.00 91.70 54.240.242.58 [54.240.242.58]
12 1033 27 26.31 484.91 91.98 54.240.242.49 [54.240.242.49]
13 925 30 29.76 522.84 94.82 54.240.242.108 [54.240.242.108]
14 924 29 26.26 518.58 92.45 54.240.242.127 [54.240.242.127]
15 1033 23 25.90 514.73 90.04 205.251.229.158 [205.251.229.158]
16 1029 100 0 0 0 [-]
17 1029 100 0 0 0 [-]
18 1029 100 0 0 0 [-]
19 1029 100 0 0 0 [-]
20 1029 100 0 0 0 [-]
21 1029 100 0 0 0 [-]
22 1029 100 0 0 0 [-]
23 1029 100 0 0 0 [-]
24 1034 21 27.99 439.00 94.58 50.18.56.1 [50.18.56.1]

Cable Connection information:

<tabindex=-1>Downstream Bonded Channels
Channel Lock Status Modulation Channel ID Frequency Power SNR Correctables Uncorrectabables
1 Locked QAM256 41 405000000 Hz -3.9 dBmV 38.3 dB 48 0
2 Locked QAM256 1 783000000 Hz -3.0 dBmV 37.4 dB 114 207
3 Locked QAM256 2 789000000 Hz -3.3 dBmV 38.2 dB 141 216
4 Locked QAM256 3 795000000 Hz -3.4 dBmV 38.2 dB 194 247
5 Locked QAM256 4 801000000 Hz -2.6 dBmV 37.8 dB 154 271
6 Locked QAM256 9 831000000 Hz -3.0 dBmV 37.6 dB 321 638
7 Locked QAM256 10 837000000 Hz -2.6 dBmV 37.8 dB 288 712
8 Locked QAM256 11 843000000 Hz -3.0 dBmV 38.0 dB 264 749
9 Locked QAM256 12 849000000 Hz -3.3 dBmV 37.9 dB 363 770
10 Locked QAM256 17 879000000 Hz -3.3 dBmV 37.7 dB 729 1388
11 Locked QAM256 18 885000000 Hz -3.9 dBmV 37.8 dB 768 1611
12 Locked QAM256 19 891000000 Hz -4.1 dBmV 37.7 dB 808 1776
13 Locked QAM256 20 897000000 Hz -3.3 dBmV 38.0 dB 791 1925
14 Locked QAM256 21 903000000 Hz -3.2 dBmV 37.8 dB 883 2031
15 Locked QAM256 22 909000000 Hz -3.6 dBmV 37.7 dB 843 2301
16 Locked QAM256 25 927000000 Hz -3.8 dBmV 37.7 dB 1042 2641
17 Locked QAM256 26 933000000 Hz -3.6 dBmV 37.6 dB 1050 2772
18 Locked QAM256 27 939000000 Hz -3.4 dBmV 37.7 dB 1074 2836
19 Locked QAM256 28 945000000 Hz -3.7 dBmV 37.6 dB 1086 2993
20 Locked QAM256 29 951000000 Hz -4.4 dBmV 37.4 dB 1120 2964
21 Locked QAM256 30 957000000 Hz -4.6 dBmV 37.5 dB 1014 2956
22 Locked QAM256 33 357000000 Hz -3.7 dBmV 38.7 dB 47 0
23 Locked QAM256 34 363000000 Hz -3.9 dBmV 38.6 dB 55 0
24 Locked QAM256 35 369000000 Hz -4.3 dBmV 38.5 dB 52 0
25 Locked QAM256 36 375000000 Hz -4.5 dBmV 38.4 dB 48 0
26 Locked QAM256 37 381000000 Hz -4.4 dBmV 38.4 dB 50 0
27 Locked QAM256 38 387000000 Hz -4.3 dBmV 38.3 dB 53 0
28 Locked QAM256 42 411000000 Hz -4.6 dBmV 38.1 dB 49 0
29 Locked QAM256 43 417000000 Hz -5.0 dBmV 38.0 dB 47 0
30 Locked QAM256 44 423000000 Hz -4.5 dBmV 38.0 dB 44 0
31 Locked QAM256 45 429000000 Hz -4.4 dBmV 38.2 dB 45 0
32 Locked QAM256 46 435000000 Hz -4.5 dBmV 38.0 dB 44 0

<tabindex=-1>Upstream Bonded Channels
Channel Lock Status US Channel Type Channel ID Symbol Rate Frequency Power
1 Locked ATDMA 4 5120 Ksym/sec 36300000 Hz 41.3 dBmV
2 Locked ATDMA 1 2560 Ksym/sec 18400000 Hz 38.3 dBmV
3 Locked ATDMA 2 5120 Ksym/sec 23300000 Hz 39.0 dBmV
4 Locked ATDMA 3 5120 Ksym/sec 29800000 Hz 40.8 dBmV
5 Not Locked Unknown 0 0 Ksym/sec 0 Hz 0 dBmV
6 Not Locked Unknown 0 0 Ksym/sec 0 Hz 0 dBmV
7 Not Locked Unknown 0 0 Ksym/sec 0 Hz 0 dBmV
8 Not Locked Unknown 0 0 Ksym/sec 0 Hz 0 dBmV

<tabindex=-1>Downstream OFDM Channels
Channel Channel ID Indicator Subcarrier Zero Frequency Active Subcarrier Number Range Total Codewords Uncorrectable Codewords
1 159 Non-Primary 203600000 Hz 1126 ~ 2969 3220659348 0
2 0 Other 0 Hz 0 ~ 0 0 0

<tabindex=-1>Upstream OFDMA Channels
Channel UpstreamIsMuted Ranging Status Subcarrier Zero Frequency Active Subcarrier Number Range Symbols Per Frame Tx Power
1   Other 0 Hz 0 ~ 0 0 0 dBmV
2   Other 0 Hz 0 ~ 0 0

0 dBmV