netdev
[Top] [All Lists]

Re: V2.4 policy router operates faster/better than V2.6

To: netdev@xxxxxxxxxxx
Subject: Re: V2.4 policy router operates faster/better than V2.6
From: "Jeremy M. Guthrie" <jeremy.guthrie@xxxxxxxxxx>
Date: Tue, 11 Jan 2005 19:27:13 -0600
Cc: Robert Olsson <Robert.Olsson@xxxxxxxxxxx>, Stephen Hemminger <shemminger@xxxxxxxx>, Jesse Brandeburg <jesse.brandeburg@xxxxxxxxx>
In-reply-to: <16868.381.537772.831831@robur.slu.se>
Organization: Berbee Information Networks
References: <Pine.LNX.4.44.0501071416060.5818-100000@localhost.localdomain> <200501110917.26621.jeremy.guthrie@berbee.com> <16868.381.537772.831831@robur.slu.se>
Reply-to: jeremy.guthrie@xxxxxxxxxx
Sender: netdev-bounce@xxxxxxxxxxx
User-agent: KMail/1.7.2
On Tuesday 11 January 2005 10:40 am, Robert Olsson wrote:
> About the same load as last time 80 kpps forwarded and droprate of ~200 pps
> and 2323 fib lookups/sec. Not so bad for PIII but it maybe tuned better.
>
> Did the e1000 patch cure the problem that interrupts got enabled for
> unidirectional traffic? Ring size? I've never seen any win in system
> performance w. RX rings larger than 256 at least not in lab.

ETH3 Interrupts(calc'd from below):  1479968
ETH2 Interrupts:  261543
Packets RX'd on ETH3:  3892720
Packets dropped on RX on ETH3:  10305

This equates to about a 0.26% drop rate. W/ 256 packet RX ring size I see 
about a 0.42% drop rate.

This is using both the newest Intel driver w/ your patch and an increased ring 
size of 2048.

Tue Jan 11 19:15:04 CST 2005
eth3      Link encap:Ethernet  HWaddr 00:02:B3:D5:7E:30
          inet addr:10.253.0.1  Bcast:10.255.255.255  Mask:255.255.255.0
          inet6 addr: fe80::202:b3ff:fed5:7e30/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:2337377824 errors:14992144 dropped:14992144 
overruns:9643826 frame:0
          TX packets:5 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:3984064976 (3799.5 Mb)  TX bytes:398 (398.0 b)
          Base address:0x22a0 Memory:eff80000-effa0000

           CPU0       CPU1
  0:   93627934  353254270    IO-APIC-edge  timer
  1:         35        507    IO-APIC-edge  i8042
  7:          0          0   IO-APIC-level  ohci_hcd
  8:          0          2    IO-APIC-edge  rtc
 12:         73        145    IO-APIC-edge  i8042
 14:        120        313    IO-APIC-edge  ide0
 18: 2158179576       1815   IO-APIC-level  eth3
 20:          2 2136514988   IO-APIC-level  eth2
 27:     204201     371301   IO-APIC-level  eth0
 28:      14585      75320   IO-APIC-level  aic7xxx
 30:          0          0   IO-APIC-level  acpi
NMI:          0          0
LOC:  446922783  446921227
ERR:          0
MIS:          0

Tue Jan 11 19:16:05 CST 2005
eth3      Link encap:Ethernet  HWaddr 00:02:B3:D5:7E:30
          inet addr:10.253.0.1  Bcast:10.255.255.255  Mask:255.255.255.0
          inet6 addr: fe80::202:b3ff:fed5:7e30/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:2341270544 errors:15002449 dropped:15002449 
overruns:9652393 frame:0
          TX packets:5 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:1664751812 (1587.6 Mb)  TX bytes:398 (398.0 b)
          Base address:0x22a0 Memory:eff80000-effa0000

           CPU0       CPU1
  0:   93639955  353302319    IO-APIC-edge  timer
  1:         35        507    IO-APIC-edge  i8042
  7:          0          0   IO-APIC-level  ohci_hcd
  8:          0          2    IO-APIC-edge  rtc
 12:         73        145    IO-APIC-edge  i8042
 14:        120        313    IO-APIC-edge  ide0
 18: 2159659544       1815   IO-APIC-level  eth3
 20:          2 2136776531   IO-APIC-level  eth2
 27:     204245     371369   IO-APIC-level  eth0
 28:      14593      75343   IO-APIC-level  aic7xxx
 30:          0          0   IO-APIC-level  acpi
NMI:          0          0
LOC:  446982858  446981302
ERR:          0
MIS:          0

       --ro
>
> Jeremy M. Guthrie writes:
>  > date ; ifconfig eth3 ; cat /proc/net/softnet_stat ;
>  > cat /proc/net/stat/rt_cache ; sleep 60 ; date ; ifconfig eth3 ;
>  > cat /proc/net/softnet_stat ; cat /proc/net/stat/rt_cache
>  >
>  > Tue Jan 11 09:12:21 CST 2005
>  > eth3      Link encap:Ethernet  HWaddr 00:02:B3:D5:7E:30
>  >           inet addr:10.253.0.1  Bcast:10.255.255.255  Mask:255.255.255.0
>  >           inet6 addr: fe80::202:b3ff:fed5:7e30/64 Scope:Link
>  >           UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
>  >           RX packets:3519452697 errors:5558592 dropped:5558592
>  > overruns:4011523 frame:0
>  >           TX packets:5 errors:0 dropped:0 overruns:0 carrier:0
>  >           collisions:0 txqueuelen:1000
>  >           RX bytes:497775695 (474.7 Mb)  TX bytes:398 (398.0 b)
>  >           Base address:0x22a0 Memory:eff80000-effa0000
>  >
>  > f59427dc 150dc67c 00c562ab 000d2659 00000000 00000000 00000000 00000000
>  > 00547b5b
>  > 00038622 00000000 00000065 00000000 00000000 00000000 00000000 00000000
>  > 0006804f
>  > entries  in_hit in_slow_tot in_no_route in_brd in_martian_dst
>  > in_martian_src out_hit out_slow_tot out_slow_mc  gc_total gc_ignored
>  > gc_goal_miss gc_dst_overflow in_hlist_search out_hlist_search
>  > 0000f3c2  aeca1565 272c383d 00000000 00000000 000089a8 00005298 00000002
>  > 001db403 0003054f 00000000 230aa73c 22fe33eb 00000cf0 00000000 b37011dc
>  > 00957c14
>  > 0000f3c2  0000b975 00029703 00000000 00000000 000035a5 00000000 00000000
>  > 00000015 00000083 00000002 000038c8 000038a3 00000000 00000000 0012a566
>  > 0000014d
>  >
>  > Tue Jan 11 09:13:21 CST 2005
>  > eth3      Link encap:Ethernet  HWaddr 00:02:B3:D5:7E:30
>  >           inet addr:10.253.0.1  Bcast:10.255.255.255  Mask:255.255.255.0
>  >           inet6 addr: fe80::202:b3ff:fed5:7e30/64 Scope:Link
>  >           UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
>  >           RX packets:3524302561 errors:5571396 dropped:5571396
>  > overruns:4022383 frame:0
>  >           TX packets:5 errors:0 dropped:0 overruns:0 carrier:0
>  >           collisions:0 txqueuelen:1000
>  >           RX bytes:3065327250 (2923.3 Mb)  TX bytes:398 (398.0 b)
>  >           Base address:0x22a0 Memory:eff80000-effa0000
>  >
>  > f5de26f5 150dc67c 00c562b4 000d2659 00000000 00000000 00000000 00000000
>  > 00547ffd
>  > 00038632 00000000 00000065 00000000 00000000 00000000 00000000 00000000
>  > 0006807c
>  > entries  in_hit in_slow_tot in_no_route in_brd in_martian_dst
>  > in_martian_src out_hit out_slow_tot out_slow_mc  gc_total gc_ignored
>  > gc_goal_miss gc_dst_overflow in_hlist_search out_hlist_search
>  > 0000fc1e  af11f07b 272e58d3 00000000 00000000 000089a8 00005298 00000002
>  > 001db571 00030572 00000000 230cc7f1 23005428 00000cf0 00000000 b4b5b529
>  > 009583b9
>  > 0000fc1e  0000b977 00029710 00000000 00000000 000035a7 00000000 00000000
>  > 00000015 00000083 00000002 000038ca 000038a5 00000000 00000000 0012a5c8
>  > 0000014d
>  >
>  > --
>  >
>  > --------------------------------------------------
>  > Jeremy M. Guthrie        jeremy.guthrie@xxxxxxxxxx
>  > Senior Network Engineer        Phone: 608-298-1061
>  > Berbee                           Fax: 608-288-3007
>  > 5520 Research Park Drive         NOC: 608-298-1102
>  > Madison, WI 53711

-- 

--------------------------------------------------
Jeremy M. Guthrie        jeremy.guthrie@xxxxxxxxxx
Senior Network Engineer        Phone: 608-298-1061
Berbee                           Fax: 608-288-3007
5520 Research Park Drive         NOC: 608-298-1102
Madison, WI 53711

<Prev in Thread] Current Thread [Next in Thread>