Subject: Re: cxgb4 mbox4 errors listening to multiple multicast addresses

From: Dimitris Michailidis <[email-masked]>
Date: Thu, 10 May 2012 13:46:57 -0700

On 05/10/2012 01:14 PM, Shawn Bohrer wrote:
> Hello, I'm testing some Chelsio T4 cards (T420-CR) and they seem to
> reliably fail if I try to receiving multicast data on a number of
> different addresses.  Actually it they fail even before any data is
> sent, so it must be simply subscribing to the multicast addresses that
> is the problem.  See below for an example.
> 
> $ uname -r
> 3.3.1
> 
> $ ethtool -i eth6
> driver: cxgb4
> version: 1.3.0-ko
> firmware-version: 1.3.10.0, TP 0.1.7.0
> bus-info: 0000:04:00.4
> supports-statistics: yes
> supports-test: no
> supports-eeprom-access: yes
> supports-register-dump: yes
> 
> I've got vlan824 configured to use eth6.  So if with iperf I can do:
> 
> $ route add -net 224.0.0.0 netmask 240.0.0.0 dev vlan824
> $ for x in $(seq 1 95); do iperf -s -u -B 224.4.4.${x} -p 500${x} & done
> 
> $ dmesg | grep cxgb4
> [   10.847870] cxgb4 0000:04:00.4: irq 77 for MSI/MSI-X
> [   10.847877] cxgb4 0000:04:00.4: irq 78 for MSI/MSI-X
> [   10.847882] cxgb4 0000:04:00.4: irq 79 for MSI/MSI-X
> [   10.847888] cxgb4 0000:04:00.4: irq 80 for MSI/MSI-X
> [   10.847893] cxgb4 0000:04:00.4: irq 81 for MSI/MSI-X
> [   10.847898] cxgb4 0000:04:00.4: irq 82 for MSI/MSI-X
> [   10.847903] cxgb4 0000:04:00.4: irq 83 for MSI/MSI-X
> [   10.847908] cxgb4 0000:04:00.4: irq 84 for MSI/MSI-X
> [   10.847913] cxgb4 0000:04:00.4: irq 85 for MSI/MSI-X
> [   10.847918] cxgb4 0000:04:00.4: irq 86 for MSI/MSI-X
> [   10.847923] cxgb4 0000:04:00.4: irq 87 for MSI/MSI-X
> [   10.847928] cxgb4 0000:04:00.4: irq 88 for MSI/MSI-X
> [   10.847933] cxgb4 0000:04:00.4: irq 89 for MSI/MSI-X
> [   10.847938] cxgb4 0000:04:00.4: irq 90 for MSI/MSI-X
> [   10.847943] cxgb4 0000:04:00.4: irq 91 for MSI/MSI-X
> [   10.847948] cxgb4 0000:04:00.4: irq 92 for MSI/MSI-X
> [   10.847953] cxgb4 0000:04:00.4: irq 93 for MSI/MSI-X
> [   10.847957] cxgb4 0000:04:00.4: irq 94 for MSI/MSI-X
> [   10.847962] cxgb4 0000:04:00.4: irq 95 for MSI/MSI-X
> [   10.847967] cxgb4 0000:04:00.4: irq 96 for MSI/MSI-X
> [   10.847972] cxgb4 0000:04:00.4: irq 97 for MSI/MSI-X
> [   10.847977] cxgb4 0000:04:00.4: irq 98 for MSI/MSI-X
> [   10.847981] cxgb4 0000:04:00.4: irq 99 for MSI/MSI-X
> [   10.847986] cxgb4 0000:04:00.4: irq 100 for MSI/MSI-X
> [   10.847991] cxgb4 0000:04:00.4: irq 101 for MSI/MSI-X
> [   10.847996] cxgb4 0000:04:00.4: irq 102 for MSI/MSI-X
> [   10.848001] cxgb4 0000:04:00.4: irq 103 for MSI/MSI-X
> [   10.848005] cxgb4 0000:04:00.4: irq 104 for MSI/MSI-X
> [   10.848010] cxgb4 0000:04:00.4: irq 105 for MSI/MSI-X
> [   10.848016] cxgb4 0000:04:00.4: irq 106 for MSI/MSI-X
> [   10.848021] cxgb4 0000:04:00.4: irq 107 for MSI/MSI-X
> [   10.848025] cxgb4 0000:04:00.4: irq 108 for MSI/MSI-X
> [   10.848032] cxgb4 0000:04:00.4: irq 109 for MSI/MSI-X
> [   10.848036] cxgb4 0000:04:00.4: irq 110 for MSI/MSI-X
> [   10.848041] cxgb4 0000:04:00.4: irq 111 for MSI/MSI-X
> [   10.848046] cxgb4 0000:04:00.4: irq 112 for MSI/MSI-X
> [   10.848051] cxgb4 0000:04:00.4: irq 113 for MSI/MSI-X
> [   10.848055] cxgb4 0000:04:00.4: irq 114 for MSI/MSI-X
> [   10.848060] cxgb4 0000:04:00.4: irq 115 for MSI/MSI-X
> [   10.848065] cxgb4 0000:04:00.4: irq 116 for MSI/MSI-X
> [   10.848069] cxgb4 0000:04:00.4: irq 117 for MSI/MSI-X
> [   10.848074] cxgb4 0000:04:00.4: irq 118 for MSI/MSI-X
> [   10.848079] cxgb4 0000:04:00.4: irq 119 for MSI/MSI-X
> [   10.848083] cxgb4 0000:04:00.4: irq 120 for MSI/MSI-X
> [   10.848088] cxgb4 0000:04:00.4: irq 121 for MSI/MSI-X
> [   10.848093] cxgb4 0000:04:00.4: irq 122 for MSI/MSI-X
> [   10.848098] cxgb4 0000:04:00.4: irq 123 for MSI/MSI-X
> [   10.848103] cxgb4 0000:04:00.4: irq 124 for MSI/MSI-X
> [   10.848107] cxgb4 0000:04:00.4: irq 125 for MSI/MSI-X
> [   10.848112] cxgb4 0000:04:00.4: irq 126 for MSI/MSI-X
> [   10.848116] cxgb4 0000:04:00.4: irq 127 for MSI/MSI-X
> [   10.848121] cxgb4 0000:04:00.4: irq 128 for MSI/MSI-X
> [   10.848480] cxgb4 0000:04:00.4: eth4: Chelsio T420-LL-CR rev 2 10GBASE-R SFP+ RNIC PCIe x8 5 GT/s MSI-X
> [   10.848482] cxgb4 0000:04:00.4: eth4: S/N: PT18110977, E/C: 01234567890123
> [   10.848714] cxgb4 0000:04:00.4: eth5: Chelsio T420-LL-CR rev 2 10GBASE-R SFP+ RNIC PCIe x8 5 GT/s MSI-X
> [   10.848716] cxgb4 0000:04:00.4: eth5: S/N: PT18110977, E/C: 01234567890123
> [   10.850726] iw_cxgb4:Chelsio T4 RDMA Driver - version 0.1
> [   17.958293] iw_cxgb4:0000:04:00.4: Up
> [   17.979873] cxgb4 0000:04:00.4: eth6: link up, 10Gbps, full-duplex, Tx/Rx PAUSE
> [   17.979876] cxgb4 0000:04:00.4: eth6: passive DA module inserted
> [  685.517044] cxgb4 0000:04:00.4: mbox 4: 150004c400000c02 800f01005e04040f 83ff01005e040401 0 0 0 0 0
> [  685.529179] cxgb4 0000:04:00.4: mbox 4: 150004c400000c02 800f01005e04040f 83ff01005e040401 0 0 0 0 0
> [  685.542396] cxgb4 0000:04:00.4: mbox 4: 150004c400000c02 800f01005e04040f 83ff01005e040401 83ff01005e040403 0 0 0 0
> [  685.555827] cxgb4 0000:04:00.4: mbox 4: 150004c400000c02 800f01005e04040f 83ff01005e040401 83ff01005e040403 0 0 0 0
> [  685.570377] cxgb4 0000:04:00.4: mbox 4: 150004c400000c03 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 0 0 0
> [  685.585110] cxgb4 0000:04:00.4: mbox 4: 150004c400000c03 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 0 0 0
> [  685.600915] cxgb4 0000:04:00.4: mbox 4: 150004c400000c03 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 0 0
> [  685.616945] cxgb4 0000:04:00.4: mbox 4: 150004c400000c03 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 0 0
> [  685.633943] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 0
> [  685.651269] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 0
> [  685.669648] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  685.688434] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  685.708128] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  685.726910] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  685.746620] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  685.765403] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  685.785103] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  685.803889] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  685.823559] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  685.842345] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  685.862060] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  685.880845] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  685.900669] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  685.919454] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  685.939104] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  685.957888] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  685.977570] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  685.996352] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.016043] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.034827] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.054675] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.073462] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.093201] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.111984] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.131681] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.150483] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.170134] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.188919] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.208593] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.227376] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.247074] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.265857] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.285532] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.304318] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.323965] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.342749] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.362423] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.381208] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.400882] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.419686] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.439341] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.458129] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.477762] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.496542] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.516173] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.534959] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.554585] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.573368] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.593006] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.611788] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.631453] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.650237] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.669893] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.688680] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.708360] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.727145] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.746777] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.765562] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.785242] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.804028] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.824719] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.843501] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.863170] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.881953] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.901648] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.920429] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.940061] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.958854] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.978518] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  686.997301] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.016940] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.035726] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.055372] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.074157] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.093794] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.112576] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.132207] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.150988] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.170634] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.189421] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.209058] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.227856] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.247488] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.266267] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.285905] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.304689] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.324333] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.343120] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.362756] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.381539] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.401179] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.419964] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.439623] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.458407] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.478076] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.496866] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.516497] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.535280] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.554924] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.573713] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.593351] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.612138] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.631793] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.650573] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.670222] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.689008] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.708652] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.727437] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.747071] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.765869] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.785510] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.804295] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.823948] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.842733] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.862379] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.881165] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.900829] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.919610] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.939241] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.958025] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.978719] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  687.997502] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.017145] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.035943] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.055583] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.074365] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.094004] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.112787] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.132430] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.151211] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.170856] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.189642] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.209303] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.228086] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.247714] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.266496] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.286143] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.304930] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.324558] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.343343] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.362973] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.381759] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.401398] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.420179] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.439808] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.458591] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.478220] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.497003] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.516654] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.535434] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.555081] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.573877] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.593508] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.612291] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.631928] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.650712] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.670347] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.689131] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.708761] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.727547] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.747188] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.765970] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.785608] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> [  688.804391] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413
> 
> Then on a second machine, I set up the iperf client to send the
> multicast data.
> 
> machine2 $ route add -net 224.0.0.0 netmask 240.0.0.0 dev vlan824
> machine2 $ for x in $(seq 1 95); do iperf -u -c 224.4.4.${x} -p 500${x} -l 100 -b 10M & done
> 
> The receiver will receive some of the packets on a few of the
> addresses, but most of the addresses never receive anything.  I
> realize this could be because we are simply dropping packets, but even
> running a single instance of the iperf client on machine2 for many of
> the addresses causes no packets to be received for example:
> 
> machine2 $ iperf -u -c 224.4.4.65 -p 50065 -l 100 -b 10M
> 
> Is there any translation of those cryptic mbox 4 errors?

The mbox messages are dumps of mailbox commands that try to register MAC 
addresses and fail due to exhaustion of exact MAC filters.  It should fall back 
to ALL_MULTI mode and probably shouldn't be logging these as they are expected 
failure.  From your description it would appear it didn't fall back, I'll take 
a closer look.  Can you send me the output of ifconfig or ip link for the port 
in this state?

> Thanks,
> Shawn