Received: with ECARTIS (v1.0.0; list netdev); Fri, 08 Jul 2005 11:18:04 -0700 (PDT) Received: from ns1.s2io.com (ns1.s2io.com [142.46.200.198]) by oss.sgi.com (8.12.10/8.12.10/SuSE Linux 0.7) with ESMTP id j68II0H9016607 for ; Fri, 8 Jul 2005 11:18:00 -0700 Received: from guinness.s2io.com (sentry.s2io.com [142.46.200.199]) by ns1.s2io.com (8.12.10/8.12.10) with ESMTP id j68IGLcx026721; Fri, 8 Jul 2005 14:16:21 -0400 (EDT) Received: from rkoushik ([10.16.16.61]) by guinness.s2io.com (8.12.6/8.12.6) with ESMTP id j68IGIKP024269; Fri, 8 Jul 2005 14:16:18 -0400 (EDT) Message-Id: <200507081816.j68IGIKP024269@guinness.s2io.com> From: "Raghavendra Koushik" To: "'Arthur Kepner'" Cc: , , , , , Subject: RE: [PATCH 2.6.12.1 5/12] S2io: Performance improvements Date: Fri, 8 Jul 2005 11:16:14 -0700 MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Office Outlook, Build 11.0.5510 In-Reply-To: Thread-Index: AcWD0q0SS5czwbPMREWCPAhX7ThQggAFhp3A X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.2180 X-Scanned-By: MIMEDefang 2.34 X-archive-position: 2703 X-ecartis-version: Ecartis v1.0.0 Sender: netdev-bounce@oss.sgi.com Errors-to: netdev-bounce@oss.sgi.com X-original-sender: raghavendra.koushik@neterion.com Precedence: bulk X-list: netdev Content-Length: 1905 Lines: 57 I'll include this fix in the next patch that incorporates any other review comments coming my way.. Thanks for pointing it out. -Koushik > -----Original Message----- > From: Arthur Kepner [mailto:akepner@sgi.com] > Sent: Friday, July 08, 2005 8:31 AM > To: Raghavendra Koushik > Cc: jgarzik@pobox.com; netdev@oss.sgi.com; > netdev@vger.kernel.org; ravinandan.arakali@neterion.com; > leonid.grossman@neterion.com; rapuru.sriram@neterion.com > Subject: RE: [PATCH 2.6.12.1 5/12] S2io: Performance improvements > > On Thu, 7 Jul 2005, Raghavendra Koushik wrote: > > > .... > > On an Altix machine I believe the readq was necessary to flush > > the PIO writes. How long did you run the tests? I had seen > > in long duration tests that an occasional write > > (TXDL control word and the address) would be missed and the xmit > > Get's stuck. > > > > The most recent tests I did used pktgen, and they ran for a total > time of ~.5 hours (changing pkt_size every 30 seconds or so). The > pktgen tests and other tests (like nttcp) have been run > several times, > so I've exercised the card for a total of several hours without > any problems. > > > > > > > > > FWIW, I've done quite a few performance measurements with > the patch > > > I posted earlier, and it's worked well. For 1500 byte > mtus throughput > > > goes up by ~20%. Is even the mmiowb() unnecessary? > > > > > > > Was this on 2.4 kernel because I think the readq would not have a > > significant impact on 2.6 kernels due to TSO. > > (with TSO on the number of packets that actually enter the > > Xmit routine would be reduced apprx 40 times). > > ..... > > This was with a 2.6 kernel (with TSO on). PIO reads are pretty > expensive on Altix, so eliminating them really helps us. > > For big mtus (>=4KBytes) the benefit of replacing the readq() > with mmiowb() in s2io_xmit() is negligible. > > -- > Arthur >