On Wednesday 05 January 2005 07:18 am, Robert Olsson wrote:
> Jeremy M. Guthrie writes:
> > How would I check? It should be in the hundreds of thousands.
>
> Good question Stephen,..
>
> Yes it seems like this pretty hefty load. Forwarding rate of 92k kpps
> and a drop rate of 10 kpps and dst hash mostly at 50-60 kentries if
> I read the stats correctly.
Yeah, the load will be high. I'm expecting this to be watching ~ 750 mbps by
next December. The app profiles all traffic going in and out of our data
centers.
> And 2.4 were able handle this but not 2.6.10?
Yes. It does handle it. It runs harder ie. 2.6 caps out at ~ 50% utilization
where 2.4 might run 60-75% utilized.
> Assuming things are uses and setup identically. 2.6 uses RCU for route
> hash locking. Any dst cache overslow messages seen?
No.
> A couple of lines of rtstat would be very interesing from this box.
I'm not showing the /proc/net/rt_cache_stat file. Was there a kernel option I
need to recompile with for rt_cache_stat to show up in proc?
> Also check that the CPU shares the RX packet load. CPU0 affinty to eth0
> and CPU1 to eth1 seems to be best. It gives cache bouncing at "TX" and
> slab jobs but we have accept that for now.
How would I go about doing this?
> 13:37:25 CPU %user %nice %system %iowait %irq %soft %idle
>
> > intr/s
> > 13:38:24 all 0.14 0.00 0.12 0.12 2.02 42.89 54.71
> > 25900.70
> > 13:38:24 0 0.03 0.00 0.05 0.22 0.00 16.67 83.03
> > 2246.10
> > 13:38:24 1 0.25 0.00 0.20 0.03 4.02 69.12 26.40
> > 23654.55
>
> This looks weird to me... we cannot have CPU left? Due to the imbalance?
> Check /proc/net/softnet_stat,
cat /proc/net/softnet_stat
5592c972 00000000 00001fc8 00000000 00000000 00000000 00000000 00000000
00391c3f
000f1991 00000000 00000000 00000000 00000000 00000000 00000000 00000000
001292ba
> Haven't used mpstat. %soft is that *all* softirq's or only softirq's
> deferred to ksoftird only?
"%soft"
Show the percentage of time spent by the CPU or CPUs to service
softirqs. A softirq (software interrupt) is one of up to 32
enumerated software interrupts which can run on multiple CPUs at
once.
--
--------------------------------------------------
Jeremy M. Guthrie jeremy.guthrie@xxxxxxxxxx
Senior Network Engineer Phone: 608-298-1061
Berbee Fax: 608-288-3007
5520 Research Park Drive NOC: 608-298-1102
Madison, WI 53711
pgpsSFj5sz4Jq.pgp
Description: PGP signature
|