Re: bad TSO performance in 2.6.9-rc2-BK

["David S. Miller" <davem@xxxxxxxxxxxxx>]

I think I know what may be going on here.

Let's say that we even get the congestion window openned up
so that we can build 64K TSO frames, that's around 43 or 44
1500 mtu frames.

That means as the window fills up, we have to see 44 ACKs
before we are able to send the next TSO frame.  Needless to
say that breaks ACK clocking completely.

And given that, getting 22MB/sec with TSO enabled is
actually an impressive feat.

I can't think of a fix I'm completely happy with.  We could
limit TSO to something like 2 or 4 normal MSS frames, but
that negates much of the gain from TSO.  But something like
this is necessary to keep the pipe full.

Anyways, for testing, something like the patch below.  If things
still stink a bit, try using a limit of "2" in this patch instead
of "4".

===== net/ipv4/tcp_output.c 1.58 vs edited =====
--- 1.58/net/ipv4/tcp_output.c  2004-09-13 21:39:17 -07:00
+++ edited/net/ipv4/tcp_output.c        2004-09-23 15:51:51 -07:00
@@ -645,6 +645,12 @@
                if (factor > tp->snd_cwnd)
                        factor = tp->snd_cwnd;
 
+               /* Also, do not let it grow more than 4 frames
+                * so that ACK clocking continues to work.
+                */
+               if (factor > 4)
+                       factor = 4;
+
                tp->mss_cache = mss_now * factor;
        }