Hi,
We are using XFS on an Mailserver. We have a strange Problem which could
be tracked down to Filesystem or Hardware level.
The Problem:
Some of the stored mails get`s mixxed with various contents of the
Filesystem or other Mails. The Files "look" normal dumped with "od" - no
strange content. This Problem could be reproduced. If we send and
massive amount of Data slighly smaller than Blocksize some of the
generated Files gets mixxed. If i should guess, i would say that the
files get filled with content to fill the Inode.
One of this Files:
mail8:# cat 1136200241.M378338P21770V000000000000000FI2D87F6C0_0.*
Return-Path: <apache@xxxxxxxxxxxxx>
X-Original-To: <private>
Delivered-To: <private>
Received: from localhost (localhost [127.0.0.1])
by mail8.netdiscounter.de (Postfix) with ESMTP id 402E2407E6D
for <private>; Mon, 2 Jan 2006
12:10:41 +0100 (CET)
Received: from node2.mail8.netdiscounter.de ([127.0.0.1])
by localhost (mail8 [127.0.0.1]) (amavisd-new, port 10024) with ESMTP
id 20751-02 for <private>;
Mon, 2 Jan 2006 12:10:41 +0100 (CET)
Received-SPF: none (mail8.netdiscounter.de: 212.185.119.14 is neither
permitted nor denied by domain of 93660.t-wp.de)
client-ip=212.185.119.14; envelope-from=apache@xxxxxxxxxxxxx;
helo=93660.t-wp.de;
Received: from 93660.t-wp.de (93660.t-wp.de [212.185.119.14])
(using TLSv1 with cipher EDH-RSA-DES-CBC3-SHA (168/168 bits))
(No client certificate requested)
by mail8.netdiscounter.de (Postfix) with ESMTP id E4747407E6B
for <private>; Mon, 2 Jan 2006
12:10:38 +0100 (CET)
Received: (from apache@localhost)
by 93660.t-wp.de (8.11.6/8.11.6) id k02BAch16561;
Mon, 2 Jan 2006 12:10:38 +0100
Date: Mon, 2 Jan 2006 12:10:38 +0100
From: Apache <apache@xxxxxxxxxxxxx>
Message-Id: <200601021110.k02BAch16561@xxxxxxxxxxxxx>
To: <private>
Subject: Kontaktformular
X-Virus-Scanned: by amavisd-new-2.3.1 (20050509) at netdiscounter.de
X-Spam-Status: No, hits=-0.685 tagged_above=-999 required=4
tests=[AWL=-0.686,
BAYES_50=0.001]
X-Spam-Level:
Kontakt_Titel:
Kontakt_Anrede: Frau
Kontakt_Vorname: Birgit
Kontakt_Name: Geiger
Kontakt_Strasse: Im H<sonderzeichen>lderle 10
Kontakt_Ort: 72224 Ebhausen
Vertriebsschiene:
Kontakt_Rueckrufnummer: 1234
Kontakt_email: <private>
Markt_in: 71083 Herrenberg, Daimlerstra>sonderzeichen>e / Filial-Nummer:
20_113
Vertriebsschiene: Baumarkt & Garten
Kontakt_Anliegen:
Warum erhalten unsere Nachbarn und wir selten bis
<sonderzeichen>berhaupt nie Ihren Baumarktprospekt, Bewohner in anderen
Stra<sonderzeichen>en aber regelm<sonderzeichen>ig?
This is the End of the Mail - in the "od" output the File has two "\n"
and this parts beginns ( linebreaks only from mailclient)
5 28807:1130141327
1135943767.M312321P24833V000000000000000FI2D87E881_0.mail8,S=5487:2,S
5668 28808:1130141327
1135943824.M129273P25264V000000000000000FI2D87E883_0.mail8,S=12492:2,S
12847 28809:1130141327
1135945115.M266543P2366V0000000000000802I2487E882_0.mail8,S=1787:2,S
1824 28810:1130141327
1135945205.M514301P3648V0000000000000802I2487E884_0.mail8,S=10589:2,S
10823 28811:1130141327
1135945366.M860531P5857V0000000000000802I2487E885_0.mail8,S=2333:2,S
2390 28812:1130141327
1135945389.M112532P6184V0000000000000802I2487E887_0.mail8,S=3311:2,S
3391 28813:1130141327
1135945512.M142142P5376V000000000000000FI2D87E886_0.mail8,S=2946:2,S
4214 28814:1130141327
1135945514.M134569P5401V000000000000000FI2D87E889_0.mail8,S=2909:2,S
3012 28815:1130141327
1135945581.M825132P5862V000000000000000FI2D87E888_0.mail8,S=2346:2,S
2406 28816:1130141327
1135945660.M161409P9937V0000000000000802I2487E88B_0.mail8,S=3843:2,S
3960 28817:1130141327
1135945726.M828291P10844V0000000000000802I2487E88A_0.mail8,S=78387:2,S
79724 28818:1130141327
1135946430.M606564P21067V0000000000000802I2487E88C_0.mail8,S=2413:2,S
2472 28819:1130141327
1135946555.M460388P13335V000000000000000FI2D87E88D_0.mail8,S=3005:2,S
3067 28820:1130141327
1135946793.M590835P26374V0000000000000802I2487E88E_0.mail8,S=9277:2,S
9423 28821:1130141327
1135947014.M366813P16832V000000000000000FI2D87E88F_0.mail8,S=2692:2,S
2751 28822:1130141327
1135947298.M110137P18967V000000000000000FI2D87E890_0.mail8,S=4175:2,S
4271 28823:1130141327
1135947301.M494113P19005V000000000000000FI2D87E893_0.mail8,S=9940:2,S
10203 28824:1130141327
1135947341.M765305P19319V000000000000000FI2D87E894_0.mail8,S=2101:2,S
2144 28825:1130141327
1135947375.M99169P19545V000000000000000FI2D87E892_0.mail8,S=27248:2,S
28212 28826:1130141327
1135947442.M929929P20009V000000000000000FI2D87E896_0.mail8,S=1769:2,S
1806 28827:1130141327
1135947463.M939901P20147V000000000000000FI2D87E897_0.mail8,S=1769:2,S
1806 28828:1130141327
1135947880.M537067P9183V0000000000000802I2487E895_0.mail8,S=6320:2,S
6492 28829:1130141327
Please notice that these output is not always the same.
We also had mixed Files from two independ files ( mails).
Since we use Maildir, each Mail is one File, no mess in the Mailserver
is possible. If i dump the Mails to mysql with a wrapper, avoiding any
write to disc, this Problem does not exist.
I don`t know if this is an Bug, feature or just SuSE`s implementation is
crap, but i gues it`s an fs issue or something in the storage part.
I started an search for similar Problems, but found only an old bug (202
if i remember correct).
If i should start an xfs_repair or any operation which need to unmount
the Filesystem we`re getting killed from our customers. The System is
handling about 1,2 Million Mails per Day and unmounting the Homes is
only possible for 1-3h on sunday night. I work on a new storage and it
would be nice to know how to avoid this problem on the new storage.
If you need any information, just ask for it.
And sorry for the bad english...
Greets
Michael
Ps: Operating System is SuSE-Linux 9.3, since dmesg don`t show the XFS
Version:
modinfo xfs
filename: /lib/modules/2.6.11.4-20a-smp/kernel/fs/xfs/xfs.ko
author: Silicon Graphics, Inc.
description: SGI XFS with ACLs, security attributes, realtime, large
block numbers, no debug enabled
license: GPL
vermagic: 2.6.11.4-20a-smp SMP 586 REGPARM gcc-3.3
supported: yes
depends: exportfs
srcversion: 75C138C5A04275B95B29184
|