On Wednesday 12 January 2005 09:11 am, Robert Olsson wrote:
> Jeremy M. Guthrie writes:
> > > Did the e1000 patch cure the problem that interrupts got enabled for
> > > unidirectional traffic? Ring size? I've never seen any win in system
> > > performance w. RX rings larger than 256 at least not in lab.
> >
> > ETH3 Interrupts(calc'd from below): 1479968
> > ETH2 Interrupts: 261543
> > Packets RX'd on ETH3: 3892720
> > Packets dropped on RX on ETH3: 10305
>
> Very strange...
>
> eth3 is bound to CPU0 which in turn has all packet load... If we were
> to believe your CPU0 was saturated (due to the drops). We should see no
> (RX) interrupts on eth3. But there is a lot... one irq per every three
> packet. Why?
I have no idea why it would be doing this.
> Can you investigate? e1000 has problem like this w. unidirectional traffic
> w/o the patch I sent.
This appears to be where this problem is getting beyond my expertise. I
verified NAPI is turned on. I also verified the patch is in place. I am
open to suggestions but otherwise I am not the worlds best coder.
> Or is your traffic so extremely bursty. No?
By the nature of our business it can be very bursty. We just have so many
sources/destinations for traffic that our traffic is generally pretty bursty.
We might be running 300-400 mbps with spikes of 40-100 mbps.
> --ro
>
> > This equates to about a 0.26% drop rate. W/ 256 packet RX ring size I
> > see about a 0.42% drop rate.
> >
> > This is using both the newest Intel driver w/ your patch and an
> > increased ring size of 2048.
> >
> > Tue Jan 11 19:15:04 CST 2005
> > eth3 Link encap:Ethernet HWaddr 00:02:B3:D5:7E:30
> > inet addr:10.253.0.1 Bcast:10.255.255.255 Mask:255.255.255.0
> > inet6 addr: fe80::202:b3ff:fed5:7e30/64 Scope:Link
> > UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
> > RX packets:2337377824 errors:14992144 dropped:14992144
> > overruns:9643826 frame:0
> > TX packets:5 errors:0 dropped:0 overruns:0 carrier:0
> > collisions:0 txqueuelen:1000
> > RX bytes:3984064976 (3799.5 Mb) TX bytes:398 (398.0 b)
> > Base address:0x22a0 Memory:eff80000-effa0000
> >
> > CPU0 CPU1
> > 0: 93627934 353254270 IO-APIC-edge timer
> > 1: 35 507 IO-APIC-edge i8042
> > 7: 0 0 IO-APIC-level ohci_hcd
> > 8: 0 2 IO-APIC-edge rtc
> > 12: 73 145 IO-APIC-edge i8042
> > 14: 120 313 IO-APIC-edge ide0
> > 18: 2158179576 1815 IO-APIC-level eth3
> > 20: 2 2136514988 IO-APIC-level eth2
> > 27: 204201 371301 IO-APIC-level eth0
> > 28: 14585 75320 IO-APIC-level aic7xxx
> > 30: 0 0 IO-APIC-level acpi
> > NMI: 0 0
> > LOC: 446922783 446921227
> > ERR: 0
> > MIS: 0
> >
> > Tue Jan 11 19:16:05 CST 2005
> > eth3 Link encap:Ethernet HWaddr 00:02:B3:D5:7E:30
> > inet addr:10.253.0.1 Bcast:10.255.255.255 Mask:255.255.255.0
> > inet6 addr: fe80::202:b3ff:fed5:7e30/64 Scope:Link
> > UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
> > RX packets:2341270544 errors:15002449 dropped:15002449
> > overruns:9652393 frame:0
> > TX packets:5 errors:0 dropped:0 overruns:0 carrier:0
> > collisions:0 txqueuelen:1000
> > RX bytes:1664751812 (1587.6 Mb) TX bytes:398 (398.0 b)
> > Base address:0x22a0 Memory:eff80000-effa0000
> >
> > CPU0 CPU1
> > 0: 93639955 353302319 IO-APIC-edge timer
> > 1: 35 507 IO-APIC-edge i8042
> > 7: 0 0 IO-APIC-level ohci_hcd
> > 8: 0 2 IO-APIC-edge rtc
> > 12: 73 145 IO-APIC-edge i8042
> > 14: 120 313 IO-APIC-edge ide0
> > 18: 2159659544 1815 IO-APIC-level eth3
> > 20: 2 2136776531 IO-APIC-level eth2
> > 27: 204245 371369 IO-APIC-level eth0
> > 28: 14593 75343 IO-APIC-level aic7xxx
> > 30: 0 0 IO-APIC-level acpi
> > NMI: 0 0
> > LOC: 446982858 446981302
> > ERR: 0
> > MIS: 0
--
--------------------------------------------------
Jeremy M. Guthrie jeremy.guthrie@xxxxxxxxxx
Senior Network Engineer Phone: 608-298-1061
Berbee Fax: 608-288-3007
5520 Research Park Drive NOC: 608-298-1102
Madison, WI 53711
pgpQYPG7rcCMZ.pgp
Description: PGP signature
|