Bugzilla – Bug 309
xfs_iget_core: ambiguous vns: vp/0xc7e23380, invp/0xc4a2fc80
Last modified: 2004-11-30 17:49:05 CST
Don't know if this is a XFS bug or not. But here goes. This happend on our NFS storage server. OS: Linux wwwfs-01 2.6.2 #2 SMP Tue Feb 10 22:29:17 EST 2004 i686 unknown xfs_iget_core: ambiguous vns: vp/0xc7e23380, invp/0xc4a2fc80 ------------[ cut here ]------------ kernel BUG at fs/xfs/support/debug.c:106! invalid operand: 0000 [#1] CPU: 0 EIP: 0060:[cmn_err+157/173] Not tainted EFLAGS: 00010246 EIP is at cmn_err+0x9d/0xad eax: 00000040 ebx: 00000000 ecx: f761a080 edx: c036e4dc esi: c03483d7 edi: c043459e ebp: 00000293 esp: f6015a68 ds: 007b es: 007b ss: 0068 Process nfsd (pid: 2536, threadinfo=f6014000 task=f761a080) Stack: c034869e c0337a8f c0434560 c04199c0 00c00678 00000000 d338fb70 c0219149 00000000 c0342500 c7e23380 c4a2fc80 f7edfa3c c0167286 c1baea00 c1b5b7a8 c04199c0 c1bc0124 f6014000 c1baea00 f7edfa3c c1b5b7a4 00000000 00000000 Call Trace: [xfs_iget_core+1183/1449] xfs_iget_core+0x49f/0x5a9 [get_new_inode_fast+74/218] get_new_inode_fast+0x4a/0xda [xfs_iget+343/393] xfs_iget+0x157/0x189 [xfs_vget+104/220] xfs_vget+0x68/0xdc [vfs_vget+52/56] vfs_vget+0x34/0x38 [linvfs_get_dentry+83/138] linvfs_get_dentry+0x53/0x8a [find_exported_dentry+68/1691] find_exported_dentry+0x44/0x69b [xfs_iget+247/393] xfs_iget+0xf7/0x189 [iget_locked+105/186] iget_locked+0x69/0xba [xfs_iunlock+55/113] xfs_iunlock+0x37/0x71 [xfs_vget+202/220] xfs_vget+0xca/0xdc [iput+63/124] iput+0x3f/0x7c [in_group_p+37/45] in_group_p+0x25/0x2d [alloc_skb+71/224] alloc_skb+0x47/0xe0 [sock_alloc_send_pskb+197/481] sock_alloc_send_pskb+0xc5/0x1e1 [_end+944038524/1069274584] ip_fw_check+0x75a/0x8b2 [ipchains] [dev_queue_xmit+430/564] dev_queue_xmit+0x1ae/0x234 [ip_finish_output2+166/420] ip_finish_output2+0xa6/0x1a4 [ip_finish_output2+0/420] ip_finish_output2+0x0/0x1a4 [nf_hook_slow+212/291] nf_hook_slow+0xd4/0x123 [exp_find_key+133/152] exp_find_key+0x85/0x98 [export_decode_fh+92/120] export_decode_fh+0x5c/0x78 [nfsd_acceptable+0/252] nfsd_acceptable+0x0/0xfc [fh_verify+473/1338] fh_verify+0x1d9/0x53a [nfsd_acceptable+0/252] nfsd_acceptable+0x0/0xfc [udp_push_pending_frames+330/625] udp_push_pending_frames+0x14a/0x271 [nfsd_open+56/311] nfsd_open+0x38/0x137 [nfsd_read+82/941] nfsd_read+0x52/0x3ad [__wake_up_common+56/87] __wake_up_common+0x38/0x57 [nfsd3_proc_read+222/359] nfsd3_proc_read+0xde/0x167 [nfsd_dispatch+232/485] nfsd_dispatch+0xe8/0x1e5 [svc_process+1184/1635] svc_process+0x4a0/0x663 [apic_timer_interrupt+26/32] apic_timer_interrupt+0x1a/0x20 [nfsd+490/910] nfsd+0x1ea/0x38e
This already was reported to the kernel bugzilla at http://bugme.osdl.org/show_bug.cgi?id=870, but I've failed to reproduce it sofar. I'll try harder to reproduce and fix it.
Can you send me your .config file? I'm still not able to reproduce it, and it'd like to see whether you have any interesting options set.
Here comes the .config. I got bitten by this during the weekend again. Just before the machine hangs I get a lot of nfs-timeouts from the clients. Setting: /sbin/sysctl -w kernel.panic_on_oops="1" /sbin/sysctl -w kernel.panic="60" doesn't help getting the machine to reboot after the "oops". A manual button reboot is needed. Just tell me what more I can do to help and I will do my best. ---- .config for vanilla kernel 2.6.2 ----- # # Automatically generated make config: don't edit # CONFIG_X86=y CONFIG_MMU=y CONFIG_UID16=y CONFIG_GENERIC_ISA_DMA=y # # Code maturity level options # # CONFIG_EXPERIMENTAL is not set CONFIG_CLEAN_COMPILE=y CONFIG_STANDALONE=y # # General setup # CONFIG_SWAP=y CONFIG_SYSVIPC=y CONFIG_BSD_PROCESS_ACCT=y CONFIG_SYSCTL=y CONFIG_LOG_BUF_SHIFT=15 CONFIG_IKCONFIG=y CONFIG_IKCONFIG_PROC=y # CONFIG_EMBEDDED is not set CONFIG_KALLSYMS=y CONFIG_FUTEX=y CONFIG_EPOLL=y CONFIG_IOSCHED_NOOP=y CONFIG_IOSCHED_AS=y CONFIG_IOSCHED_DEADLINE=y # CONFIG_CC_OPTIMIZE_FOR_SIZE is not set # # Loadable module support # CONFIG_MODULES=y CONFIG_MODULE_UNLOAD=y CONFIG_OBSOLETE_MODPARM=y CONFIG_KMOD=y # # Processor type and features # CONFIG_X86_PC=y # CONFIG_X86_VOYAGER is not set # CONFIG_X86_NUMAQ is not set # CONFIG_X86_SUMMIT is not set # CONFIG_X86_BIGSMP is not set # CONFIG_X86_VISWS is not set # CONFIG_X86_GENERICARCH is not set # CONFIG_X86_ES7000 is not set # CONFIG_M386 is not set # CONFIG_M486 is not set # CONFIG_M586 is not set # CONFIG_M586TSC is not set # CONFIG_M586MMX is not set # CONFIG_M686 is not set # CONFIG_MPENTIUMII is not set # CONFIG_MPENTIUMIII is not set CONFIG_MPENTIUM4=y # CONFIG_MK6 is not set # CONFIG_MK7 is not set # CONFIG_MK8 is not set # CONFIG_MELAN is not set # CONFIG_MCRUSOE is not set # CONFIG_MWINCHIPC6 is not set # CONFIG_MWINCHIP2 is not set # CONFIG_MWINCHIP3D is not set # CONFIG_MCYRIXIII is not set # CONFIG_MVIAC3_2 is not set # CONFIG_X86_GENERIC is not set CONFIG_X86_CMPXCHG=y CONFIG_X86_XADD=y CONFIG_X86_L1_CACHE_SHIFT=7 CONFIG_RWSEM_XCHGADD_ALGORITHM=y CONFIG_X86_WP_WORKS_OK=y CONFIG_X86_INVLPG=y CONFIG_X86_BSWAP=y CONFIG_X86_POPAD_OK=y CONFIG_X86_GOOD_APIC=y CONFIG_X86_INTEL_USERCOPY=y CONFIG_X86_USE_PPRO_CHECKSUM=y # CONFIG_HPET_TIMER is not set # CONFIG_HPET_EMULATE_RTC is not set CONFIG_SMP=y CONFIG_NR_CPUS=32 # CONFIG_PREEMPT is not set CONFIG_X86_LOCAL_APIC=y CONFIG_X86_IO_APIC=y CONFIG_X86_TSC=y CONFIG_X86_MCE=y # CONFIG_X86_MCE_NONFATAL is not set # CONFIG_X86_MCE_P4THERMAL is not set # CONFIG_TOSHIBA is not set # CONFIG_I8K is not set CONFIG_MICROCODE=m CONFIG_X86_MSR=m CONFIG_X86_CPUID=m CONFIG_NOHIGHMEM=y # CONFIG_HIGHMEM4G is not set # CONFIG_HIGHMEM64G is not set # CONFIG_MATH_EMULATION is not set CONFIG_MTRR=y CONFIG_HAVE_DEC_LOCK=y # # Power management options (ACPI, APM) # # CONFIG_PM is not set # # ACPI (Advanced Configuration and Power Interface) Support # # CONFIG_ACPI is not set CONFIG_ACPI_BOOT=y # # CPU Frequency scaling # # CONFIG_CPU_FREQ is not set # # Bus options (PCI, PCMCIA, EISA, MCA, ISA) # CONFIG_PCI=y # CONFIG_PCI_GOBIOS is not set # CONFIG_PCI_GODIRECT is not set CONFIG_PCI_GOANY=y CONFIG_PCI_BIOS=y CONFIG_PCI_DIRECT=y # CONFIG_PCI_USE_VECTOR is not set # CONFIG_PCI_LEGACY_PROC is not set CONFIG_PCI_NAMES=y CONFIG_ISA=y CONFIG_EISA=y # CONFIG_EISA_VLB_PRIMING is not set CONFIG_EISA_PCI_EISA=y # CONFIG_EISA_VIRTUAL_ROOT is not set # CONFIG_EISA_NAMES is not set # CONFIG_MCA is not set # CONFIG_SCx200 is not set # CONFIG_HOTPLUG is not set # # Executable file formats # CONFIG_BINFMT_ELF=y CONFIG_BINFMT_AOUT=m CONFIG_BINFMT_MISC=y # # Device Drivers # # # Generic Driver Options # # # Memory Technology Devices (MTD) # # CONFIG_MTD is not set # # Parallel port support # # CONFIG_PARPORT is not set # # Plug and Play support # # CONFIG_PNP is not set # # Block devices # CONFIG_BLK_DEV_FD=y # CONFIG_BLK_DEV_XD is not set # CONFIG_BLK_CPQ_DA is not set # CONFIG_BLK_CPQ_CISS_DA is not set # CONFIG_BLK_DEV_DAC960 is not set CONFIG_BLK_DEV_LOOP=m # CONFIG_BLK_DEV_CRYPTOLOOP is not set # CONFIG_BLK_DEV_NBD is not set # CONFIG_BLK_DEV_RAM is not set CONFIG_BLK_DEV_INITRD=y # CONFIG_LBD is not set # # ATA/ATAPI/MFM/RLL support # CONFIG_IDE=y CONFIG_BLK_DEV_IDE=y # # Please see Documentation/ide.txt for help/info on IDE drives # # CONFIG_BLK_DEV_HD_IDE is not set CONFIG_BLK_DEV_IDEDISK=y CONFIG_IDEDISK_MULTI_MODE=y CONFIG_IDEDISK_STROKE=y CONFIG_BLK_DEV_IDECD=y # CONFIG_BLK_DEV_IDEFLOPPY is not set # CONFIG_BLK_DEV_IDESCSI is not set # CONFIG_IDE_TASK_IOCTL is not set # # IDE chipset support/bugfixes # CONFIG_IDE_GENERIC=y # CONFIG_BLK_DEV_CMD640 is not set CONFIG_BLK_DEV_IDEPCI=y CONFIG_IDEPCI_SHARE_IRQ=y # CONFIG_BLK_DEV_OFFBOARD is not set CONFIG_BLK_DEV_GENERIC=y # CONFIG_BLK_DEV_RZ1000 is not set CONFIG_BLK_DEV_IDEDMA_PCI=y # CONFIG_BLK_DEV_IDEDMA_FORCED is not set # CONFIG_IDEDMA_PCI_AUTO is not set CONFIG_BLK_DEV_ADMA=y # CONFIG_BLK_DEV_AEC62XX is not set # CONFIG_BLK_DEV_ALI15X3 is not set # CONFIG_BLK_DEV_AMD74XX is not set # CONFIG_BLK_DEV_CMD64X is not set # CONFIG_BLK_DEV_TRIFLEX is not set # CONFIG_BLK_DEV_CY82C693 is not set # CONFIG_BLK_DEV_CS5530 is not set # CONFIG_BLK_DEV_HPT34X is not set # CONFIG_BLK_DEV_HPT366 is not set # CONFIG_BLK_DEV_SC1200 is not set # CONFIG_BLK_DEV_PIIX is not set # CONFIG_BLK_DEV_NS87415 is not set # CONFIG_BLK_DEV_PDC202XX_OLD is not set # CONFIG_BLK_DEV_PDC202XX_NEW is not set CONFIG_BLK_DEV_SVWKS=y # CONFIG_BLK_DEV_SIIMAGE is not set # CONFIG_BLK_DEV_SIS5513 is not set # CONFIG_BLK_DEV_SLC90E66 is not set # CONFIG_BLK_DEV_TRM290 is not set # CONFIG_BLK_DEV_VIA82CXXX is not set # CONFIG_IDE_CHIPSETS is not set CONFIG_BLK_DEV_IDEDMA=y # CONFIG_IDEDMA_IVB is not set # CONFIG_IDEDMA_AUTO is not set # CONFIG_DMA_NONPCI is not set # CONFIG_BLK_DEV_HD is not set # # SCSI device support # CONFIG_SCSI=y CONFIG_SCSI_PROC_FS=y # # SCSI support type (disk, tape, CD-ROM) # CONFIG_BLK_DEV_SD=y # CONFIG_CHR_DEV_ST is not set # CONFIG_CHR_DEV_OSST is not set CONFIG_BLK_DEV_SR=m CONFIG_BLK_DEV_SR_VENDOR=y CONFIG_CHR_DEV_SG=m # # Some SCSI devices (e.g. CD jukebox) support multiple LUNs # # CONFIG_SCSI_MULTI_LUN is not set CONFIG_SCSI_REPORT_LUNS=y # CONFIG_SCSI_CONSTANTS is not set # CONFIG_SCSI_LOGGING is not set # # SCSI low-level drivers # # CONFIG_BLK_DEV_3W_XXXX_RAID is not set # CONFIG_SCSI_7000FASST is not set # CONFIG_SCSI_ACARD is not set # CONFIG_SCSI_AHA152X is not set # CONFIG_SCSI_AHA1542 is not set # CONFIG_SCSI_AHA1740 is not set # CONFIG_SCSI_AIC7XXX is not set # CONFIG_SCSI_AIC7XXX_OLD is not set # CONFIG_SCSI_AIC79XX is not set # CONFIG_SCSI_ADVANSYS is not set # CONFIG_SCSI_IN2000 is not set # CONFIG_SCSI_MEGARAID is not set # CONFIG_SCSI_BUSLOGIC is not set # CONFIG_SCSI_CPQFCTS is not set # CONFIG_SCSI_DMX3191D is not set # CONFIG_SCSI_DTC3280 is not set # CONFIG_SCSI_EATA is not set # CONFIG_SCSI_EATA_PIO is not set # CONFIG_SCSI_FUTURE_DOMAIN is not set # CONFIG_SCSI_GDTH is not set # CONFIG_SCSI_GENERIC_NCR5380 is not set # CONFIG_SCSI_GENERIC_NCR5380_MMIO is not set CONFIG_SCSI_IPS=y # CONFIG_SCSI_INIA100 is not set # CONFIG_SCSI_NCR53C406A is not set CONFIG_53C700_IO_MAPPED=y # CONFIG_SCSI_SYM53C8XX_2 is not set # CONFIG_SCSI_PAS16 is not set # CONFIG_SCSI_PSI240I is not set # CONFIG_SCSI_QLOGIC_FAS is not set # CONFIG_SCSI_QLOGIC_ISP is not set # CONFIG_SCSI_QLOGIC_FC is not set # CONFIG_SCSI_QLOGIC_1280 is not set CONFIG_SCSI_QLA2XXX_CONFIG=y # CONFIG_SCSI_QLA21XX is not set # CONFIG_SCSI_QLA23XX is not set CONFIG_SCSI_SIM710=m CONFIG_SCSI_SYM53C416=m CONFIG_SCSI_DC390T=m # CONFIG_SCSI_DC390T_NOGENSUPP is not set CONFIG_SCSI_T128=m CONFIG_SCSI_U14_34F=m # CONFIG_SCSI_U14_34F_TAGGED_QUEUE is not set # CONFIG_SCSI_U14_34F_LINKED_COMMANDS is not set CONFIG_SCSI_U14_34F_MAX_TAGS=8 CONFIG_SCSI_ULTRASTOR=m CONFIG_SCSI_NSP32=m CONFIG_SCSI_DEBUG=m # # Old CD-ROM drivers (not SCSI, not IDE) # # CONFIG_CD_NO_IDESCSI is not set # # Multi-device support (RAID and LVM) # # CONFIG_MD is not set # # Fusion MPT device support # # CONFIG_FUSION is not set # # I2O device support # # CONFIG_I2O is not set # # Networking support # CONFIG_NET=y # # Networking options # CONFIG_PACKET=m CONFIG_PACKET_MMAP=y CONFIG_NETLINK_DEV=m CONFIG_UNIX=y # CONFIG_NET_KEY is not set CONFIG_INET=y CONFIG_IP_MULTICAST=y # CONFIG_IP_ADVANCED_ROUTER is not set # CONFIG_IP_PNP is not set # CONFIG_NET_IPIP is not set # CONFIG_NET_IPGRE is not set # CONFIG_IP_MROUTE is not set # CONFIG_INET_ECN is not set CONFIG_SYN_COOKIES=y # CONFIG_INET_AH is not set # CONFIG_INET_ESP is not set # CONFIG_INET_IPCOMP is not set # # IP: Virtual Server Configuration # # CONFIG_IP_VS is not set # CONFIG_DECNET is not set # CONFIG_BRIDGE is not set CONFIG_NETFILTER=y # CONFIG_NETFILTER_DEBUG is not set # # IP: Netfilter Configuration # # CONFIG_IP_NF_CONNTRACK is not set CONFIG_IP_NF_QUEUE=m CONFIG_IP_NF_IPTABLES=m CONFIG_IP_NF_MATCH_LIMIT=m CONFIG_IP_NF_MATCH_IPRANGE=m CONFIG_IP_NF_MATCH_MAC=m CONFIG_IP_NF_MATCH_PKTTYPE=m CONFIG_IP_NF_MATCH_MARK=m CONFIG_IP_NF_MATCH_MULTIPORT=m CONFIG_IP_NF_MATCH_TOS=m CONFIG_IP_NF_MATCH_RECENT=m CONFIG_IP_NF_MATCH_ECN=m CONFIG_IP_NF_MATCH_DSCP=m CONFIG_IP_NF_MATCH_AH_ESP=m CONFIG_IP_NF_MATCH_LENGTH=m CONFIG_IP_NF_MATCH_TTL=m CONFIG_IP_NF_MATCH_TCPMSS=m CONFIG_IP_NF_MATCH_OWNER=m CONFIG_IP_NF_FILTER=m CONFIG_IP_NF_TARGET_REJECT=m CONFIG_IP_NF_NAT_NEEDED=y CONFIG_IP_NF_MANGLE=m CONFIG_IP_NF_TARGET_TOS=m CONFIG_IP_NF_TARGET_ECN=m CONFIG_IP_NF_TARGET_DSCP=m CONFIG_IP_NF_TARGET_MARK=m CONFIG_IP_NF_TARGET_CLASSIFY=m CONFIG_IP_NF_TARGET_LOG=m CONFIG_IP_NF_TARGET_ULOG=m CONFIG_IP_NF_TARGET_TCPMSS=m CONFIG_IP_NF_ARPTABLES=m CONFIG_IP_NF_ARPFILTER=m CONFIG_IP_NF_ARP_MANGLE=m CONFIG_IP_NF_COMPAT_IPCHAINS=m # CONFIG_IP_NF_COMPAT_IPFWADM is not set # CONFIG_VLAN_8021Q is not set # CONFIG_LLC2 is not set # CONFIG_IPX is not set # CONFIG_ATALK is not set # # QoS and/or fair queueing # # CONFIG_NET_SCHED is not set # # Network testing # # CONFIG_NET_PKTGEN is not set CONFIG_NETDEVICES=y # # ARCnet devices # # CONFIG_ARCNET is not set CONFIG_DUMMY=m # CONFIG_BONDING is not set # CONFIG_EQUALIZER is not set # CONFIG_TUN is not set # # Ethernet (10 or 100Mbit) # # CONFIG_NET_ETHERNET is not set # # Ethernet (1000 Mbit) # # CONFIG_ACENIC is not set # CONFIG_DL2K is not set CONFIG_E1000=m # CONFIG_E1000_NAPI is not set # CONFIG_NS83820 is not set # CONFIG_HAMACHI is not set # CONFIG_R8169 is not set # CONFIG_SK98LIN is not set # CONFIG_TIGON3 is not set # # Ethernet (10000 Mbit) # # CONFIG_IXGB is not set # CONFIG_FDDI is not set # CONFIG_PPP is not set # CONFIG_SLIP is not set # # Wireless LAN (non-hamradio) # # CONFIG_NET_RADIO is not set # # Token Ring devices # # CONFIG_TR is not set # CONFIG_NET_FC is not set # # Wan interfaces # # CONFIG_WAN is not set # # Amateur Radio support # # CONFIG_HAMRADIO is not set # # IrDA (infrared) support # # CONFIG_IRDA is not set # # Bluetooth support # # CONFIG_BT is not set # # ISDN subsystem # # CONFIG_ISDN_BOOL is not set # # Telephony Support # # CONFIG_PHONE is not set # # Input device support # CONFIG_INPUT=y # # Userland interfaces # CONFIG_INPUT_MOUSEDEV=y CONFIG_INPUT_MOUSEDEV_PSAUX=y CONFIG_INPUT_MOUSEDEV_SCREEN_X=1024 CONFIG_INPUT_MOUSEDEV_SCREEN_Y=768 # CONFIG_INPUT_JOYDEV is not set # CONFIG_INPUT_TSDEV is not set # CONFIG_INPUT_EVDEV is not set # CONFIG_INPUT_EVBUG is not set # # Input I/O drivers # # CONFIG_GAMEPORT is not set CONFIG_SOUND_GAMEPORT=y CONFIG_SERIO=y CONFIG_SERIO_I8042=y # CONFIG_SERIO_SERPORT is not set # CONFIG_SERIO_CT82C710 is not set # CONFIG_SERIO_PCIPS2 is not set # # Input Device Drivers # CONFIG_INPUT_KEYBOARD=y CONFIG_KEYBOARD_ATKBD=y # CONFIG_KEYBOARD_SUNKBD is not set # CONFIG_KEYBOARD_XTKBD is not set # CONFIG_KEYBOARD_NEWTON is not set # CONFIG_INPUT_MOUSE is not set # CONFIG_INPUT_JOYSTICK is not set # CONFIG_INPUT_TOUCHSCREEN is not set # CONFIG_INPUT_MISC is not set # # Character devices # CONFIG_VT=y CONFIG_VT_CONSOLE=y CONFIG_HW_CONSOLE=y # CONFIG_SERIAL_NONSTANDARD is not set # # Serial drivers # CONFIG_SERIAL_8250=m CONFIG_SERIAL_8250_NR_UARTS=4 # CONFIG_SERIAL_8250_EXTENDED is not set # # Non-8250 serial port support # CONFIG_SERIAL_CORE=m CONFIG_UNIX98_PTYS=y CONFIG_UNIX98_PTY_COUNT=256 # # Mice # # CONFIG_BUSMOUSE is not set # CONFIG_QIC02_TAPE is not set # # IPMI # # CONFIG_IPMI_HANDLER is not set # # Watchdog Cards # # CONFIG_WATCHDOG is not set # CONFIG_HW_RANDOM is not set # CONFIG_NVRAM is not set CONFIG_RTC=m CONFIG_GEN_RTC=m CONFIG_GEN_RTC_X=y # CONFIG_DTLK is not set # CONFIG_R3964 is not set # CONFIG_APPLICOM is not set # # Ftape, the floppy tape device driver # # CONFIG_AGP is not set # CONFIG_DRM is not set # CONFIG_MWAVE is not set # CONFIG_RAW_DRIVER is not set # CONFIG_HANGCHECK_TIMER is not set # # I2C support # # CONFIG_I2C is not set # # Multimedia devices # # CONFIG_VIDEO_DEV is not set # # Digital Video Broadcasting Devices # # CONFIG_DVB is not set # # Graphics support # # CONFIG_FB is not set CONFIG_VIDEO_SELECT=y # # Console display driver support # CONFIG_VGA_CONSOLE=y CONFIG_MDA_CONSOLE=m CONFIG_DUMMY_CONSOLE=y # # Sound # # CONFIG_SOUND is not set # # USB support # # CONFIG_USB is not set # # USB Gadget Support # CONFIG_USB_GADGET=y CONFIG_USB_GADGET_NET2280=y CONFIG_USB_NET2280=y # CONFIG_USB_GADGET_PXA2XX is not set # CONFIG_USB_GADGET_GOKU is not set # CONFIG_USB_GADGET_SA1100 is not set # CONFIG_USB_ZERO is not set CONFIG_USB_ETH=m # CONFIG_USB_GADGETFS is not set # CONFIG_USB_FILE_STORAGE is not set # CONFIG_USB_G_SERIAL is not set # # File systems # CONFIG_EXT2_FS=y # CONFIG_EXT2_FS_XATTR is not set CONFIG_EXT3_FS=y CONFIG_EXT3_FS_XATTR=y # CONFIG_EXT3_FS_POSIX_ACL is not set # CONFIG_EXT3_FS_SECURITY is not set CONFIG_JBD=y # CONFIG_JBD_DEBUG is not set CONFIG_FS_MBCACHE=y # CONFIG_REISERFS_FS is not set # CONFIG_JFS_FS is not set CONFIG_XFS_FS=y CONFIG_XFS_QUOTA=y # CONFIG_XFS_POSIX_ACL is not set # CONFIG_MINIX_FS is not set # CONFIG_ROMFS_FS is not set # CONFIG_QUOTA is not set CONFIG_QUOTACTL=y # CONFIG_AUTOFS_FS is not set CONFIG_AUTOFS4_FS=m # # CD-ROM/DVD Filesystems # CONFIG_ISO9660_FS=y CONFIG_JOLIET=y CONFIG_ZISOFS=y CONFIG_ZISOFS_FS=y CONFIG_UDF_FS=m # # DOS/FAT/NT Filesystems # CONFIG_FAT_FS=y CONFIG_MSDOS_FS=m CONFIG_VFAT_FS=y # CONFIG_NTFS_FS is not set # # Pseudo filesystems # CONFIG_PROC_FS=y CONFIG_PROC_KCORE=y CONFIG_DEVPTS_FS=y # CONFIG_DEVPTS_FS_XATTR is not set CONFIG_TMPFS=y # CONFIG_HUGETLBFS is not set # CONFIG_HUGETLB_PAGE is not set CONFIG_RAMFS=y # # Miscellaneous filesystems # # CONFIG_CRAMFS is not set # CONFIG_VXFS_FS is not set # CONFIG_HPFS_FS is not set # CONFIG_QNX4FS_FS is not set # CONFIG_SYSV_FS is not set # CONFIG_UFS_FS is not set # # Network File Systems # CONFIG_NFS_FS=y CONFIG_NFS_V3=y CONFIG_NFSD=y CONFIG_NFSD_V3=y CONFIG_LOCKD=y CONFIG_LOCKD_V4=y CONFIG_EXPORTFS=y CONFIG_SUNRPC=y # CONFIG_SMB_FS is not set # CONFIG_CIFS is not set # CONFIG_NCP_FS is not set # CONFIG_CODA_FS is not set # # Partition Types # # CONFIG_PARTITION_ADVANCED is not set CONFIG_MSDOS_PARTITION=y # # Native Language Support # CONFIG_NLS=y CONFIG_NLS_DEFAULT="iso8859-1" CONFIG_NLS_CODEPAGE_437=m # CONFIG_NLS_CODEPAGE_737 is not set # CONFIG_NLS_CODEPAGE_775 is not set CONFIG_NLS_CODEPAGE_850=m # CONFIG_NLS_CODEPAGE_852 is not set # CONFIG_NLS_CODEPAGE_855 is not set # CONFIG_NLS_CODEPAGE_857 is not set # CONFIG_NLS_CODEPAGE_860 is not set # CONFIG_NLS_CODEPAGE_861 is not set # CONFIG_NLS_CODEPAGE_862 is not set # CONFIG_NLS_CODEPAGE_863 is not set # CONFIG_NLS_CODEPAGE_864 is not set # CONFIG_NLS_CODEPAGE_865 is not set # CONFIG_NLS_CODEPAGE_866 is not set # CONFIG_NLS_CODEPAGE_869 is not set # CONFIG_NLS_CODEPAGE_936 is not set # CONFIG_NLS_CODEPAGE_950 is not set # CONFIG_NLS_CODEPAGE_932 is not set # CONFIG_NLS_CODEPAGE_949 is not set # CONFIG_NLS_CODEPAGE_874 is not set # CONFIG_NLS_ISO8859_8 is not set # CONFIG_NLS_CODEPAGE_1250 is not set # CONFIG_NLS_CODEPAGE_1251 is not set CONFIG_NLS_ISO8859_1=m # CONFIG_NLS_ISO8859_2 is not set # CONFIG_NLS_ISO8859_3 is not set # CONFIG_NLS_ISO8859_4 is not set # CONFIG_NLS_ISO8859_5 is not set # CONFIG_NLS_ISO8859_6 is not set # CONFIG_NLS_ISO8859_7 is not set # CONFIG_NLS_ISO8859_9 is not set # CONFIG_NLS_ISO8859_13 is not set # CONFIG_NLS_ISO8859_14 is not set # CONFIG_NLS_ISO8859_15 is not set # CONFIG_NLS_KOI8_R is not set # CONFIG_NLS_KOI8_U is not set # CONFIG_NLS_UTF8 is not set # # Kernel hacking # # CONFIG_DEBUG_KERNEL is not set # CONFIG_DEBUG_SPINLOCK_SLEEP is not set # CONFIG_FRAME_POINTER is not set CONFIG_X86_FIND_SMP_CONFIG=y CONFIG_X86_MPPARSE=y # # Security options # # CONFIG_SECURITY is not set # # Cryptographic options # # CONFIG_CRYPTO is not set # # Library routines # CONFIG_CRC32=m CONFIG_ZLIB_INFLATE=y CONFIG_X86_SMP=y CONFIG_X86_HT=y CONFIG_X86_BIOS_REBOOT=y CONFIG_X86_TRAMPOLINE=y CONFIG_PC=y
Created attachment 98 [details] debugging patch Patch to give some more debugging output in the failure case
Can you try the patch above? In addition could you recompile the kernel with CONFIG_DEBUG_SLAB (hidden under CONFIG_DEBUG_KERNEL) set?
Patch downloaded and applied to vanilla 2.6.3 source. I enabled CONFIG_DEBUG_SLAB and recompiled. Running 16h nfs_fsstress.sh test now.. I will get back with the results.
Created attachment 99 [details] Debugging output after patch_1 Here is the output from run last night. It took about 7h to trigger the bug. I hope this will be useful.
Created attachment 100 [details] more verbose debugging
Hmm, that output is more than strange, I suspect we have a bad inode lying around somewhere. Can you rety with the more verbose debugging patch and especially look for the printks prefixed with WARNING in your logs?
The patch doesn't apply to vanilla 2.6.3 source. Seems like the file (xfs_iget.c) the patch comes from is very diffrent the vanilla one. I tried to solve the ".rej" and didn't for instance find the line with: remove_inode_hash(inode); The dirtree in vanilla is fs/xfs/linux and in the patch fs/xfs/linux-2.6. Could you attach a new patch?
Created attachment 101 [details] last patch for Linus' 2.6 tree instead of the oss.sgi.com CVS
The patch applied cleanly. I will run the test now.
Some preliminary test results: I get a lot of (like 7-10 per minute): WARNING: xfs_iput_new on new inode
Okay, I think which caller it is. I'll hack a quick & dirty fix for it up. I'll also upload a new patch ASAP that has more debugging output. If you have some more spare cycles to test it that would be cool.
Created attachment 102 [details] even more verbose debugging
Created attachment 103 [details] debugging info after patch 2 Here is the output from the last run.
The latest patch http://oss.sgi.com/bugzilla/attachment.cgi?id=102&action=view dosen't apply cleanly to the vanilla 26.3 tree...
Hmm, patch 102 was diffed vs Linus' current BK tree and I don't see any XFS changes since 2.6.3. Maybe you had the previous patch still applied? Anyway, I have a patch now that I thikn should fix your problems.
Created attachment 104 [details] potential fix
The source was freshly unpacked. It was the "scsi" part that failed. Anyway I will apply the "potential fix" patch and do a long run. To be continued...
No wonder that patch 102 didn't apply - I uploaded a completely wrong patch, sorry :)
Created attachment 105 [details] bug output after potential fix Here is the result of the nights run after applying patch 104 (potential fix). I have attached the "oops".
Created attachment 106 [details] Oops'es etc. with and without proposed fix I was running a test setup with a Linux 2.6.3 serving a 700 GB XFS filesystem over NFS and a client (also 2.6.3) running two copies of test.sh (in the attached file) on two different NFS mounts of the server over separate network connections. During this test the server oops'ed and froze, so I couldn't record the initial oops, but when I restarted it, it immediately oops'ed again after starting the NFS mountd service - and this kept happening after each reboot. I hadn't done anything to stop the client, and apparantly it kept retrying some operation, that causes the server to oops. I recompiled Linux on the server with serial console support, and was able to to catch the oops (oops1 in the attached file). I then searched the net and found this bug report, which seem to matches my problem. I applied patch id=101 (for debugging output), id=104 (the possible fix), enabled CONFIG_DEBUG_SLAB, and recompiled the kernel. The resulting .config is in the attachment as kernel-config-2. After a reboot with the new kernel, I started the NFS services, and the server immediately oops'ed again (oops2 - also includes complete dmesg from booting). This oops was different from oops1 and the server didn't freeze totally, so to see if the problem was stilll immediately reproducable, I rebooted once more and after starting the NFS services got oops3, which is almost identical to oops2. I ran all the oops'es through ksymoops, which gave oops?.ksymoops (also in the attachment). The test client is still running (and I'll try to keep it that way), so if there's any possible fixes, I'd love to test them. As this isn't in production yet, I don't mind testing things.
Created attachment 107 [details] Oops'es etc. with and without proposed fix
I have to take down the test server and change the filesystem on our production servers next week (Tuesday) we are getting hit by this quite hard. If you need any more debugging / tests please let me know.
Created attachment 108 [details] disable delayed inode reclamation The only quickfix that I could imagien that it helps you would be to disable the delayed inode reclamation. This is the sledgehammer approach, but if it helps until I have a real fix..
Created attachment 109 [details] Errors with 2.6.4-rc2 and new patch I wanted to try 2.6.4-rc2 as I noticed major changes/fixes to XFS. While testing, the new fix (108) showed up, so I tried that as well. The client continues to run the test.sh described previously. The attached kernel.log shows the results - the following is what happened at various times: 17:25:20 Initial boot with previous 2.6.3 (with patches 101 and 104) to verify, that it would still OOPS, which it did at 17:25:32 - unlike previously, it actually ran for 3 seconds after starting the NFS services before the OOPS, so I did one more reboot with this kernel to verify ... 19:06:48 Second boot with previous 2.6.3. This time it actually ran for an hour before OOPS'ing at 20:06:19. 20:21:05 Reboot with 2.6.4-rc2 (with patch 101 and 104 as they applied cleanly). About a minute after starting the NFS services, it failed with: Mar 4 20:23:12 db1 kernel: Filesystem "sdc1": xfs_log_write: reservation ran out. Need to up reservation Mar 4 20:23:12 db1 kernel: xfs_force_shutdown(sdc1,0x8) called from line 1693 of file fs/xfs/xfs_log.c. Return address = 0xc0219716 Mar 4 20:23:12 db1 kernel: Filesystem "sdc1": Corruption of in-memory data detected. Shutting down filesystem: sdc1 Mar 4 20:23:12 db1 kernel: Please umount the filesystem, and rectify the problem(s) Mar 4 20:23:12 db1 kernel: xfs_force_shutdown(sdc1,0x2) called from line 1291 of file fs/xfs/xfs_log.c. Return address = 0xc0219716 followed by slab corruption messages. 20:50:07 I noticed the new patch (108) and applied this to both the 2.6.3 and the 2.6.4-rc2 kernel (so both of them are now at 101+108). I first tried to boot with 2.6.4-rc2, but before the NFS services got started it failed at 20:50:10 with the following errors: Mar 4 20:50:10 db1 kernel: Filesystem "sdc1": xfs_log_write: reservation ran out. Need to up reservation Mar 4 20:50:10 db1 kernel: xfs_force_shutdown(sdc1,0x8) called from line 1693 of file fs/xfs/xfs_log.c. Return address = 0xc0219676 Mar 4 20:50:10 db1 kernel: Filesystem "sdc1": Corruption of in-memory data detected. Shutting down filesystem: sdc1 Mar 4 20:50:10 db1 kernel: Please umount the filesystem, and rectify the problem(s) Mar 4 20:50:10 db1 kernel: xfs_force_shutdown(sdc1,0x2) called from line 1291 of file fs/xfs/xfs_log.c. Return address = 0xc0219676 I guess this should be reported as a separate bug? Anyway, I rebooted with 2.6.3 (with patches 101 and 108), and this is running well so far ...
Created attachment 110 [details] Oops with patch 108 too 2.6.3 with patches 101 and 108 crashed today with similar oops as before 108 as shown in the attached kernel log. The timeline is: 20:56:42 (Mar 4th) Booted with 2.6.3 (101+108) and started NFS services, so the test client continued it's pounding. 12:55:36 (today) "xfs_iget_core: ambiguous vns:" etc. oops 13:04:07 Somehow the server automatically rebootet, and the default at this time was 2.6.4-rc2 (with patches 101+108). 13:04:19 "xfs_iget_core: ambiguous vns:" oops immediately after boot.
Christoph, thanx I will try the patch right away!
Got hit by the same bug again with the "disable delayed inode reclamation" patch. Is there anything more I can do to help debug the problem?
Created attachment 111 [details] kernel BUG at inode.c:334 (This time with 2.4.25) Don't know if this is related. But I started to downgrade today to 2.4.25 and got hit by another bug. The output is attached to this mail. I don't know if this has anything to do with XFS but maybee.. :)
Sorry, I've been sidetracked a little. Your oops with Patch 108 looks not like only 108 but with one of the previous patches applied, too. Can you try with _only_ 108? The inode you're hitting has I_FREEING set in i_state, something the code without any previous patch does handle, but the one of the previous patches disables to make debugging easier.
Can you open another PV for the 2.4 OOPS? I don't look XFS related, but a separate Bug makes tracking it much easier..
Created attachment 113 [details] Debug output after patch108 Got the same bug even with patch 108. But it feels like it takes longer time to trigger the bug after applying patch 108.
*** Bug 318 has been marked as a duplicate of this bug. ***
Our test server ran with Linux 2.6.3+patch 108 for about a week without any problems. This setup has now been promoted to production - again without any problems so far.
I have tested 2.6.3+patch 108 again and i probably did it right this time. The server has been running nfs_fsstress.sh now for more than 24h without problem.
Comment on attachment 111 [details] kernel BUG at inode.c:334 (This time with 2.4.25) Some more info. Reported to: http://bugme.osdl.org/show_bug.cgi?id=2367 and resolved.
I don't know if it can be of any help, but I still get that with kernel 2.6.6 ------------[ cut here ]------------ kernel BUG at fs/xfs/support/debug.c:106! invalid operand: 0000 [#1] SMP CPU: 1 EIP: 0060:[pg0+945878871/1069899776] Not tainted EFLAGS: 00010246 (2.6.6k7bigmem1.2) EIP is at cmn_err+0x97/0xb0 [xfs] eax: 00000040 ebx: 00000293 ecx: c18140c8 edx: c02e87a4 esi: f89c0dc7 edi: f89cf6de ebp: 00000000 esp: c2a0bb88 ds: 007b es: 007b ss: 0068 Process nfsd (pid: 12173, threadinfo=c2a0a000 task=f767e0b0) ------------[ cut here ]------------ ------------[ cut here ]------------ kernel BUG at fs/xfs/support/debug.c:106! invalid operand: 0000 [#1] SMP CPU: 1 EIP: 0060:[pg0+945878871/1069899776] Not tainted EFLAGS: 00010246 (2.6.6k7bigmem1.2) EIP is at cmn_err+0x97/0xb0 [xfs] eax: 00000040 ebx: 00000293 ecx: c18140c8 edx: c02e87a4 esi: f89c0dc7 edi: f89cf6de ebp: 00000000 esp: c2a0bb88 ds: 007b es: 007b ss: 0068 Process nfsd (pid: 12173, threadinfo=c2a0a000 task=f767e0b0) Stack: c037ed20 f7b04588 c2a0a000 f7bc8928 dcaefe20 f898a5f3 00000000 f89bb5a0 ce05c3c0 dcaefe00 dcaefe20 dcaefe00 c2a0a000 00000008 f7b0458c dd1cfad0 f898aa1c dcaefe00 f7bc8800 00000000 0400120f 00000000 00000008 c2a0bc38 Call Trace: [pg0+945694195/1069899776] xfs_iget_core+0x163/0x500 [xfs] [pg0+945695260/1069899776] xfs_iget+0x8c/0x160 [xfs] [pg0+945810388/1069899776] xfs_vget+0x44/0xc0 [xfs] [pg0+945875957/1069899776] vfs_vget+0x25/0x30 [xfs] Stack: c037ed20 f7b04588 c2a0a000 f7bc8928 dcaefe20 f898a5f3 00000000 f89bb5a0 ce05c3c0 dcaefe00 dcaefe20 dcaefe00 c2a0a000 00000008 f7b0458c dd1cfad0 f898aa1c dcaefe00 f7bc8800 00000000 0400120f 00000000 00000008 c2a0bc38 Call Trace: [pg0+945694195/1069899776] xfs_iget_core+0x163/0x500 [xfs] [pg0+945695260/1069899776] xfs_iget+0x8c/0x160 [xfs] [pg0+945810388/1069899776] xfs_vget+0x44/0xc0 [xfs] [pg0+945875957/1069899776] vfs_vget+0x25/0x30 [xfs] Stack: c037ed20 f7b04588 c2a0a000 f7bc8928 dcaefe20 f898a5f3 00000000 f89bb5a0 ce05c3c0 dcaefe00 dcaefe20 dcaefe00 c2a0a000 00000008 f7b0458c dd1cfad0 f898aa1c dcaefe00 f7bc8800 00000000 0400120f 00000000 00000008 c2a0bc38 Call Trace: [pg0+945694195/1069899776] xfs_iget_core+0x163/0x500 [xfs] [pg0+945695260/1069899776] xfs_iget+0x8c/0x160 [xfs] [pg0+945810388/1069899776] xfs_vget+0x44/0xc0 [xfs] [pg0+945875957/1069899776] vfs_vget+0x25/0x30 [xfs] Stack: c037ed20 f7b04588 c2a0a000 f7bc8928 dcaefe20 f898a5f3 00000000 f89bb5a0 ce05c3c0 dcaefe00 dcaefe20 dcaefe00 c2a0a000 00000008 f7b0458c dd1cfad0 f898aa1c dcaefe00 f7bc8800 00000000 0400120f 00000000 00000008 c2a0bc38 Call Trace: [pg0+945694195/1069899776] xfs_iget_core+0x163/0x500 [xfs] [pg0+945695260/1069899776] xfs_iget+0x8c/0x160 [xfs] [pg0+945810388/1069899776] xfs_vget+0x44/0xc0 [xfs] [pg0+945875957/1069899776] vfs_vget+0x25/0x30 [xfs] [pg0+945874424/1069899776] linvfs_get_dentry+0x48/0x90 [xfs] [find_exported_dentry+61/1568] find_exported_dentry+0x3d/0x620 [sock_alloc_send_skb+28/48] sock_alloc_send_skb+0x1c/0x30 [ip_append_data+752/1760] ip_append_data+0x2f0/0x6e0 [udp_sendmsg+1350/1600] udp_sendmsg+0x546/0x640 [ip_generic_getfrag+0/144] ip_generic_getfrag+0x0/0x90 [release_sock+92/96] release_sock+0x5c/0x60 [udp_sendmsg+1406/1600] udp_sendmsg+0x57e/0x640 [boomerang_start_xmit+650/800] boomerang_start_xmit+0x28a/0x320 [qdisc_restart+19/416] qdisc_restart+0x13/0x1a0 [dev_queue_xmit+258/544] dev_queue_xmit+0x102/0x220 [ip_finish_output+381/464] ip_finish_output+0x17d/0x1d0 [ip_output+118/128] ip_output+0x76/0x80 [ip_push_pending_frames+697/896] ip_push_pending_frames+0x2b9/0x380 [udp_push_pending_frames+468/512] udp_push_pending_frames+0x1d4/0x200 [groups_free+59/80] groups_free+0x3b/0x50 [export_decode_fh+102/110] export_decode_fh+0x66/0x6e [nfsd_acceptable+0/224] nfsd_acceptable+0x0/0xe0 [fh_verify+916/1360] fh_verify+0x394/0x550 [nfsd_acceptable+0/224] nfsd_acceptable+0x0/0xe0 [svcauth_unix_accept+540/688] svcauth_unix_accept+0x21c/0x2b0 [nfsd_readlink+26/160] nfsd_readlink+0x1a/0xa0 [nfsd_proc_readlink+64/80] nfsd_proc_readlink+0x40/0x50 [nfsd_dispatch+225/403] nfsd_dispatch+0xe1/0x193 [svc_process+875/1512] svc_process+0x36b/0x5e8 [nfsd+492/864] nfsd+0x1ec/0x360 [nfsd+0/864] nfsd+0x0/0x360 [kernel_thread_helper+5/16] kernel_thread_helper+0x5/0x10 Code: 0f 0b 6a 00 ae 0d 9c f8 90 5b 5e 5f 5d 59 c3 8d 76 00 8d bc [pg0+945874424/1069899776] linvfs_get_dentry+0x48/0x90 [xfs] [find_exported_dentry+61/1568] find_exported_dentry+0x3d/0x620 [sock_alloc_send_skb+28/48] sock_alloc_send_skb+0x1c/0x30 [ip_append_data+752/1760] ip_append_data+0x2f0/0x6e0 [udp_sendmsg+1350/1600] udp_sendmsg+0x546/0x640 [ip_generic_getfrag+0/144] ip_generic_getfrag+0x0/0x90 [release_sock+92/96] release_sock+0x5c/0x60 [udp_sendmsg+1406/1600] udp_sendmsg+0x57e/0x640 [boomerang_start_xmit+650/800] boomerang_start_xmit+0x28a/0x320 [qdisc_restart+19/416] qdisc_restart+0x13/0x1a0 [dev_queue_xmit+258/544] dev_queue_xmit+0x102/0x220 [ip_finish_output+381/464] ip_finish_output+0x17d/0x1d0 [ip_output+118/128] ip_output+0x76/0x80 [ip_push_pending_frames+697/896] ip_push_pending_frames+0x2b9/0x380 [udp_push_pending_frames+468/512] udp_push_pending_frames+0x1d4/0x200 [groups_free+59/80] groups_free+0x3b/0x50 [export_decode_fh+102/110] export_decode_fh+0x66/0x6e [nfsd_acceptable+0/224] nfsd_acceptable+0x0/0xe0 [fh_verify+916/1360] fh_verify+0x394/0x550 [nfsd_acceptable+0/224] nfsd_acceptable+0x0/0xe0 [svcauth_unix_accept+540/688] svcauth_unix_accept+0x21c/0x2b0 [nfsd_readlink+26/160] nfsd_readlink+0x1a/0xa0 [nfsd_proc_readlink+64/80] nfsd_proc_readlink+0x40/0x50 [nfsd_dispatch+225/403] nfsd_dispatch+0xe1/0x193 [svc_process+875/1512] svc_process+0x36b/0x5e8 [nfsd+492/864] nfsd+0x1ec/0x360 [nfsd+0/864] nfsd+0x0/0x360 [kernel_thread_helper+5/16] kernel_thread_helper+0x5/0x10 Code: 0f 0b 6a 00 ae 0d 9c f8 90 5b 5e 5f 5d 59 c3 8d 76 00 8d bc [pg0+945874424/1069899776] linvfs_get_dentry+0x48/0x90 [xfs] [find_exported_dentry+61/1568] find_exported_dentry+0x3d/0x620 [sock_alloc_send_skb+28/48] sock_alloc_send_skb+0x1c/0x30 [ip_append_data+752/1760] ip_append_data+0x2f0/0x6e0 [udp_sendmsg+1350/1600] udp_sendmsg+0x546/0x640 [ip_generic_getfrag+0/144] ip_generic_getfrag+0x0/0x90 [release_sock+92/96] release_sock+0x5c/0x60 [udp_sendmsg+1406/1600] udp_sendmsg+0x57e/0x640 [boomerang_start_xmit+650/800] boomerang_start_xmit+0x28a/0x320 [qdisc_restart+19/416] qdisc_restart+0x13/0x1a0 [dev_queue_xmit+258/544] dev_queue_xmit+0x102/0x220 [ip_finish_output+381/464] ip_finish_output+0x17d/0x1d0 [ip_output+118/128] ip_output+0x76/0x80 [ip_push_pending_frames+697/896] ip_push_pending_frames+0x2b9/0x380 [udp_push_pending_frames+468/512] udp_push_pending_frames+0x1d4/0x200 [groups_free+59/80] groups_free+0x3b/0x50 [export_decode_fh+102/110] export_decode_fh+0x66/0x6e [nfsd_acceptable+0/224] nfsd_acceptable+0x0/0xe0 [fh_verify+916/1360] fh_verify+0x394/0x550 [nfsd_acceptable+0/224] nfsd_acceptable+0x0/0xe0 [svcauth_unix_accept+540/688] svcauth_unix_accept+0x21c/0x2b0 [nfsd_readlink+26/160] nfsd_readlink+0x1a/0xa0 [nfsd_proc_readlink+64/80] nfsd_proc_readlink+0x40/0x50 [nfsd_dispatch+225/403] nfsd_dispatch+0xe1/0x193 [svc_process+875/1512] svc_process+0x36b/0x5e8 [nfsd+492/864] nfsd+0x1ec/0x360 [nfsd+0/864] nfsd+0x0/0x360 [kernel_thread_helper+5/16] kernel_thread_helper+0x5/0x10 Code: 0f 0b 6a 00 ae 0d 9c f8 90 5b 5e 5f 5d 59 c3 8d 76 00 8d bc [pg0+945874424/1069899776] linvfs_get_dentry+0x48/0x90 [xfs] [find_exported_dentry+61/1568] find_exported_dentry+0x3d/0x620 [sock_alloc_send_skb+28/48] sock_alloc_send_skb+0x1c/0x30 [ip_append_data+752/1760] ip_append_data+0x2f0/0x6e0 [udp_sendmsg+1350/1600] udp_sendmsg+0x546/0x640 [ip_generic_getfrag+0/144] ip_generic_getfrag+0x0/0x90 [release_sock+92/96] release_sock+0x5c/0x60 [udp_sendmsg+1406/1600] udp_sendmsg+0x57e/0x640 [boomerang_start_xmit+650/800] boomerang_start_xmit+0x28a/0x320 [qdisc_restart+19/416] qdisc_restart+0x13/0x1a0 [dev_queue_xmit+258/544] dev_queue_xmit+0x102/0x220 [ip_finish_output+381/464] ip_finish_output+0x17d/0x1d0 [ip_output+118/128] ip_output+0x76/0x80 [ip_push_pending_frames+697/896] ip_push_pending_frames+0x2b9/0x380 [udp_push_pending_frames+468/512] udp_push_pending_frames+0x1d4/0x200 [groups_free+59/80] groups_free+0x3b/0x50 [export_decode_fh+102/110] export_decode_fh+0x66/0x6e [nfsd_acceptable+0/224] nfsd_acceptable+0x0/0xe0 [fh_verify+916/1360] fh_verify+0x394/0x550 [nfsd_acceptable+0/224] nfsd_acceptable+0x0/0xe0 [svcauth_unix_accept+540/688] svcauth_unix_accept+0x21c/0x2b0 [nfsd_readlink+26/160] nfsd_readlink+0x1a/0xa0 [nfsd_proc_readlink+64/80] nfsd_proc_readlink+0x40/0x50 [nfsd_dispatch+225/403] nfsd_dispatch+0xe1/0x193 [svc_process+875/1512] svc_process+0x36b/0x5e8 [nfsd+492/864] nfsd+0x1ec/0x360 [nfsd+0/864] nfsd+0x0/0x360 [kernel_thread_helper+5/16] kernel_thread_helper+0x5/0x10 Code: 0f 0b 6a 00 ae 0d 9c f8 90 5b 5e 5f 5d 59 c3 8d 76 00 8d bc
Hi, just adding another veggie to this pot... On a system that's going live in 8 hours (now using Reiserfs), I've gotten this bug that's biting others as well. Pathology of this box is as follows: After removing /proc/fs/nfsd from mounting because is reliably/ repeatably causes hangs under NFS load (at least with many concurrent threads), I got what is known as bug# 309 on OSS's bugzilla, and 807 at OSDL's. After being up for less than 3 hours, load was applied (256 clients requesting files from one RO nfs filesystem (3-disk RAID5), and RW one RAID1 2-disk filesystem. The system then shortly barfed on it, as has not occured before. This box has been up for a week on the same hardware/OS. The only effective change to produce this was removing the nfsd filesystem in proc, as I've shown it buggy since 2.6.0, and never works for my needs. I got in the logs: Jul 20 17:43:16 southwindow kernel: xfs_iget_core: ambiguous vns: vp/0x00000100395c7540, invp/ 0x000001007f52a2c0 followed by what was fed to the grinder to produce the ksymoops output that follows. System exhibiting the crash is: Dual Opteron 240 (Arima/Rioworks HDAMA v1.89 BIOS) 2GB RAM 3W-7506-12 (current BIOS/Firmware flash) I'm running SuSE 9, x86-64. Kernel is kernel.org 2.6.7, with Trond's NFS_ALL applied. DEVFS is _not_ loaded on this system. ###uname -a Linux southwindow 2.6.7-chpc.utah.edu_DEVFS_NUMA_NFSALL #4 SMP Wed Jul 14 06:20:59 MDT 2004 x86_64 x86_64 x86_64 GNU/Linux ###lsmod Module Size Used by st 42148 0 sr_mod 18404 0 cdrom 40872 1 sr_mod sg 38840 0 xfs 483728 2 sd_mod 20672 8 3w_xxxx 43300 5 scsi_mod 129920 5 st,sr_mod,sg,sd_mod,3w_xxxx eli@southwindow:~> ksymoops -k /proc/ksyms -l /proc/modules -o /lib/modules/2.6.7- chpc.utah.edu_DEVFS_NUMA_NFSALL/ -m /usr/src/linux/System.map 7-20-04_SW-CRASH.txt ksymoops 2.4.9 on x86_64 2.6.7-chpc.utah.edu_DEVFS_NUMA_NFSALL. Options used -V (default) -k /proc/ksyms (specified) -l /proc/modules (specified) -o /lib/modules/2.6.7-chpc.utah.edu_DEVFS_NUMA_NFSALL/ (specified) -m /usr/src/linux/System.map (specified) Error (regular_file): read_ksyms stat /proc/ksyms failed ksymoops: No such file or directory No modules in ksyms, skipping objects No ksyms, skipping lsmod Jul 20 17:43:16 southwindow kernel: Kernel BUG at debug:106 Jul 20 17:43:16 southwindow kernel: invalid operand: 0000 [1] SMP Jul 20 17:43:16 southwindow kernel: CPU 1 Jul 20 17:43:16 southwindow kernel: Pid: 1241, comm: nfsd Not tainted 2.6.7- chpc.utah.edu_DEVFS_NUMA_NFSALL Jul 20 17:43:16 southwindow kernel: RIP: 0010:[<ffffffffa0091876>] <ffffffffa0091876>{:xfs: cmn_err+278} Using defaults from ksymoops -t elf64-x86-64 -a i386:x86-64 Jul 20 17:43:16 southwindow kernel: RSP: 0018:000001003d71d9a8 EFLAGS: 00010246 Jul 20 17:43:16 southwindow kernel: RAX: 0000000000000050 RBX: 0000000000000000 RCX: 0000010001e10800 Jul 20 17:43:16 southwindow kernel: RDX: 000001003e27d501 RSI: 0000010001e100a0 RDI: 000001003d694730 Jul 20 17:43:16 southwindow kernel: RBP: 000001007f52a2c0 R08: 0000000000000000 R09: 0000000000000001 Jul 20 17:43:16 southwindow kernel: R10: 0000000000000000 R11: 0000000000000000 R12: 000001007f52a2f0 Jul 20 17:43:16 southwindow kernel: R13: 000000002e0efe06 R14: 000001003eefa800 R15: 000001003e7d9d18 Jul 20 17:43:16 southwindow kernel: FS: 0000000000576060(0000) GS:ffffffff8043de40(0000) knlGS: 0000000000000000 Jul 20 17:43:16 southwindow kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b Jul 20 17:43:16 southwindow kernel: CR2: 0000000055555000 CR3: 000000003ff8d000 CR4: 00000000000006e0 Jul 20 17:43:16 southwindow kernel: Stack: 000001003d71dd08 0000000000000293 0000003000000020 000001003d71da98 Jul 20 17:43:16 southwindow kernel: 000001003d71d9d8 000000000000006c 0000000000000004 ffffffff802b517f Jul 20 17:43:16 southwindow kernel: 00000100395c7540 000001007f52a2c0 Jul 20 17:43:16 southwindow kernel: Call Trace:<ffffffff802b517f>{skb_copy_datagram_iovec+79} <ffffffffa0090029>{:xfs:linvfs_alloc_inode+41} Jul 20 17:43:16 southwindow kernel: <ffffffff8018a816>{iget_locked+230} <ffffffffa009163c>{: xfs:vn_initialize+124} Jul 20 17:43:16 southwindow kernel: <ffffffffa00673d6>{:xfs:xfs_iget+358} <ffffffffa007f003>{: xfs:xfs_vget+51} Jul 20 17:43:16 southwindow kernel: <ffffffffa0090b98>{:xfs:vfs_vget+40} <ffffffffa008fbbb>{:xfs: linvfs_get_dentry+59} Jul 20 17:43:16 southwindow kernel: <ffffffff802cdc0c>{ip_finish_output+380} <ffffffff8020c230>{find_exported_dentry+64} Jul 20 17:43:16 southwindow kernel: <ffffffff8020f880>{nfsd_acceptable+0} <ffffffff80150b2a>{find_get_pages_tag+42} Jul 20 17:43:16 southwindow kernel: <ffffffff8015ae2a>{pagevec_lookup_tag+26} <ffffffff80151ead>{filemap_fdatawait+205} Jul 20 17:43:16 southwindow kernel: <ffffffff80316f90>{svc_recvfrom+224} <ffffffff803186cb>{svc_tcp_recvfrom+1931} Jul 20 17:43:16 southwindow kernel: <ffffffff802140fe>{exp_find_key+126} <ffffffff8020c8bb>{export_decode_fh+123} Jul 20 17:43:16 southwindow kernel: <ffffffff8020f6c6>{fh_verify+966} <ffffffff80217ca6>{nfsd3_proc_getattr+150} Jul 20 17:43:16 southwindow kernel: <ffffffff8020caa0>{nfsd_dispatch+256} <ffffffff803162ca>{svc_process+954} Jul 20 17:43:16 southwindow kernel: <ffffffff8020cd60>{nfsd+0} <ffffffff8020cfa5>{nfsd+581} Jul 20 17:43:16 southwindow kernel: <ffffffff801325be>{schedule_tail+14} <ffffffff801101d7>{child_rip+8} Jul 20 17:43:16 southwindow kernel: <ffffffff8020cd60>{nfsd+0} <ffffffff8020cd60>{nfsd+0} Jul 20 17:43:16 southwindow kernel: <ffffffff801101cf>{child_rip+0} Jul 20 17:43:16 southwindow kernel: Code: 0f 0b 39 41 09 a0 ff ff ff ff 6a 00 48 81 c4 e0 00 00 00 5b >>RIP; ffffffffa0091876 <_end+1fbd8876/7f147000> <===== >>RCX; 0000010001e10800 <__crc___alloc_pages+ff01e57967/fffffffe80147167> >>RDX; 000001003e27d501 <__crc___alloc_pages+ff3e2c4668/fffffffe80147167> >>RSI; 0000010001e100a0 <__crc___alloc_pages+ff01e57207/fffffffe80147167> >>RDI; 000001003d694730 <__crc___alloc_pages+ff3d6db897/fffffffe80147167> >>RBP; 000001007f52a2c0 <__crc___alloc_pages+ff7f571427/fffffffe80147167> >>R12; 000001007f52a2f0 <__crc___alloc_pages+ff7f571457/fffffffe80147167> >>R13; 000000002e0efe06 <__crc_ide_setup_pci_devices+1e6f0/259c00> >>R14; 000001003eefa800 <__crc___alloc_pages+ff3ef41967/fffffffe80147167> >>R15; 000001003e7d9d18 <__crc___alloc_pages+ff3e820e7f/fffffffe80147167> Trace; ffffffff802b517f <skb_copy_datagram_iovec+4f/220> Trace; ffffffff8018a816 <iget_locked+e6/1a0> Trace; ffffffffa00673d6 <_end+1fbae3d6/7f147000> Trace; ffffffffa0090b98 <_end+1fbd7b98/7f147000> Trace; ffffffff802cdc0c <ip_finish_output+17c/1f0> Trace; ffffffff8020f880 <nfsd_acceptable+0/ff> Trace; ffffffff8015ae2a <pagevec_lookup_tag+1a/20> Trace; ffffffff80316f90 <svc_recvfrom+e0/140> Trace; ffffffff802140fe <exp_find_key+7e/a0> Trace; ffffffff8020f6c6 <fh_verify+3c6/580> Trace; ffffffff8020caa0 <nfsd_dispatch+100/1d0> Trace; ffffffff8020cd60 <nfsd+0/3e1> Trace; ffffffff801325be <schedule_tail+e/6e> Trace; ffffffff8020cd60 <nfsd+0/3e1> Trace; ffffffff801101cf <child_rip+0/11> Code; ffffffffa0091876 <_end+1fbd8876/7f147000> 0000000000000000 <_RIP>: Code; ffffffffa0091876 <_end+1fbd8876/7f147000> <===== 0: 0f 0b ud2a <===== Code; ffffffffa0091878 <_end+1fbd8878/7f147000> 2: 39 41 09 cmp %eax,0x9(%rcx) Code; ffffffffa009187b <_end+1fbd887b/7f147000> 5: a0 ff ff ff ff 6a 00 mov 0x8148006affffffff,%al Code; ffffffffa0091882 <_end+1fbd8882/7f147000> c: 48 81 Code; ffffffffa0091884 <_end+1fbd8884/7f147000> e: c4 (bad) Code; ffffffffa0091885 <_end+1fbd8885/7f147000> f: e0 00 loopne 11 <_RIP+0x11> Code; ffffffffa0091887 <_end+1fbd8887/7f147000> 11: 00 00 add %al,(%rax) Code; ffffffffa0091889 <_end+1fbd8889/7f147000> 13: 5b pop %rbx 1 error issued. Results may not be reliable. ####kernel .config # Automatically generated make config: don't edit # CONFIG_X86_64=y CONFIG_64BIT=y CONFIG_X86=y CONFIG_MMU=y CONFIG_RWSEM_GENERIC_SPINLOCK=y CONFIG_X86_CMPXCHG=y CONFIG_EARLY_PRINTK=y CONFIG_HPET_TIMER=y CONFIG_HPET_EMULATE_RTC=y CONFIG_GENERIC_ISA_DMA=y # # Code maturity level options # CONFIG_EXPERIMENTAL=y CONFIG_CLEAN_COMPILE=y CONFIG_STANDALONE=y # # General setup # CONFIG_SWAP=y CONFIG_SYSVIPC=y CONFIG_POSIX_MQUEUE=y CONFIG_BSD_PROCESS_ACCT=y CONFIG_SYSCTL=y # CONFIG_AUDIT is not set CONFIG_LOG_BUF_SHIFT=15 # CONFIG_HOTPLUG is not set CONFIG_IKCONFIG=y CONFIG_IKCONFIG_PROC=y # CONFIG_EMBEDDED is not set CONFIG_KALLSYMS=y CONFIG_FUTEX=y CONFIG_EPOLL=y CONFIG_IOSCHED_NOOP=y CONFIG_IOSCHED_AS=y CONFIG_IOSCHED_DEADLINE=y CONFIG_IOSCHED_CFQ=y # CONFIG_CC_OPTIMIZE_FOR_SIZE is not set # # Loadable module support # CONFIG_MODULES=y CONFIG_MODULE_UNLOAD=y # CONFIG_MODULE_FORCE_UNLOAD is not set CONFIG_OBSOLETE_MODPARM=y CONFIG_MODVERSIONS=y CONFIG_KMOD=y CONFIG_STOP_MACHINE=y # # Processor type and features # CONFIG_MK8=y # CONFIG_MPSC is not set # CONFIG_GENERIC_CPU is not set CONFIG_X86_L1_CACHE_BYTES=64 CONFIG_X86_L1_CACHE_SHIFT=6 CONFIG_X86_TSC=y CONFIG_X86_GOOD_APIC=y # CONFIG_MICROCODE is not set CONFIG_X86_MSR=y CONFIG_X86_CPUID=y CONFIG_X86_IO_APIC=y CONFIG_X86_LOCAL_APIC=y CONFIG_MTRR=y CONFIG_SMP=y # CONFIG_PREEMPT is not set # CONFIG_SCHED_SMT is not set CONFIG_K8_NUMA=y CONFIG_DISCONTIGMEM=y CONFIG_NUMA=y CONFIG_HAVE_DEC_LOCK=y CONFIG_NR_CPUS=2 CONFIG_GART_IOMMU=y CONFIG_SWIOTLB=y CONFIG_X86_MCE=y # # Power management options # CONFIG_PM=y # CONFIG_SOFTWARE_SUSPEND is not set # # ACPI (Advanced Configuration and Power Interface) Support # CONFIG_ACPI=y CONFIG_ACPI_BOOT=y CONFIG_ACPI_INTERPRETER=y # CONFIG_ACPI_SLEEP is not set # CONFIG_ACPI_AC is not set # CONFIG_ACPI_BATTERY is not set CONFIG_ACPI_BUTTON=m CONFIG_ACPI_FAN=m CONFIG_ACPI_PROCESSOR=m CONFIG_ACPI_THERMAL=m # CONFIG_ACPI_ASUS is not set # CONFIG_ACPI_TOSHIBA is not set # CONFIG_ACPI_DEBUG is not set CONFIG_ACPI_BUS=y CONFIG_ACPI_EC=y CONFIG_ACPI_POWER=y CONFIG_ACPI_PCI=y CONFIG_ACPI_SYSTEM=y # # CPU Frequency scaling # # CONFIG_CPU_FREQ is not set # # Bus options (PCI etc.) # CONFIG_PCI=y CONFIG_PCI_DIRECT=y CONFIG_PCI_MMCONFIG=y CONFIG_PCI_LEGACY_PROC=y CONFIG_PCI_NAMES=y # # Executable file formats / Emulations # CONFIG_BINFMT_ELF=y CONFIG_BINFMT_MISC=y CONFIG_IA32_EMULATION=y # CONFIG_IA32_AOUT is not set CONFIG_COMPAT=y CONFIG_SYSVIPC_COMPAT=y CONFIG_UID16=y # # Device Drivers # # # Generic Driver Options # # # Memory Technology Devices (MTD) # CONFIG_MTD=m # CONFIG_MTD_DEBUG is not set # CONFIG_MTD_PARTITIONS is not set # CONFIG_MTD_CONCAT is not set # # User Modules And Translation Layers # CONFIG_MTD_CHAR=m # CONFIG_MTD_BLOCK is not set # CONFIG_MTD_BLOCK_RO is not set # CONFIG_FTL is not set # CONFIG_NFTL is not set # CONFIG_INFTL is not set # # RAM/ROM/Flash chip drivers # CONFIG_MTD_CFI=m CONFIG_MTD_JEDECPROBE=m CONFIG_MTD_GEN_PROBE=m # CONFIG_MTD_CFI_ADV_OPTIONS is not set # CONFIG_MTD_CFI_INTELEXT is not set CONFIG_MTD_CFI_AMDSTD=m # CONFIG_MTD_CFI_STAA is not set # CONFIG_MTD_RAM is not set # CONFIG_MTD_ROM is not set # CONFIG_MTD_ABSENT is not set # CONFIG_MTD_OBSOLETE_CHIPS is not set # # Mapping drivers for chip access # # CONFIG_MTD_COMPLEX_MAPPINGS is not set # CONFIG_MTD_PHYSMAP is not set # CONFIG_MTD_SC520CDP is not set CONFIG_MTD_SCx200_DOCFLASH=m CONFIG_MTD_AMD76XROM=m # CONFIG_MTD_SCB2_FLASH is not set # CONFIG_MTD_L440GX is not set # # Self-contained MTD device drivers # # CONFIG_MTD_PMC551 is not set # CONFIG_MTD_SLRAM is not set # CONFIG_MTD_MTDRAM is not set # CONFIG_MTD_BLKMTD is not set # # Disk-On-Chip Device Drivers # # CONFIG_MTD_DOC2000 is not set # CONFIG_MTD_DOC2001 is not set # CONFIG_MTD_DOC2001PLUS is not set # # NAND Flash Device Drivers # # CONFIG_MTD_NAND is not set # # Parallel port support # # CONFIG_PARPORT is not set # # Plug and Play support # # # Block devices # CONFIG_BLK_DEV_FD=m # CONFIG_BLK_CPQ_DA is not set # CONFIG_BLK_CPQ_CISS_DA is not set # CONFIG_BLK_DEV_DAC960 is not set # CONFIG_BLK_DEV_UMEM is not set CONFIG_BLK_DEV_LOOP=m CONFIG_BLK_DEV_CRYPTOLOOP=m CONFIG_BLK_DEV_NBD=m # CONFIG_BLK_DEV_CARMEL is not set CONFIG_BLK_DEV_RAM=y CONFIG_BLK_DEV_RAM_SIZE=4096 CONFIG_BLK_DEV_INITRD=y CONFIG_LBD=y # # ATA/ATAPI/MFM/RLL support # CONFIG_IDE=y CONFIG_BLK_DEV_IDE=y # # Please see Documentation/ide.txt for help/info on IDE drives # # CONFIG_BLK_DEV_HD_IDE is not set CONFIG_BLK_DEV_IDEDISK=y # CONFIG_IDEDISK_MULTI_MODE is not set CONFIG_BLK_DEV_IDECD=m # CONFIG_BLK_DEV_IDETAPE is not set # CONFIG_BLK_DEV_IDEFLOPPY is not set # CONFIG_BLK_DEV_IDESCSI is not set # CONFIG_IDE_TASK_IOCTL is not set # CONFIG_IDE_TASKFILE_IO is not set # # IDE chipset support/bugfixes # CONFIG_IDE_GENERIC=y # CONFIG_BLK_DEV_CMD640 is not set CONFIG_BLK_DEV_IDEPCI=y # CONFIG_IDEPCI_SHARE_IRQ is not set # CONFIG_BLK_DEV_OFFBOARD is not set CONFIG_BLK_DEV_GENERIC=y # CONFIG_BLK_DEV_OPTI621 is not set # CONFIG_BLK_DEV_RZ1000 is not set CONFIG_BLK_DEV_IDEDMA_PCI=y # CONFIG_BLK_DEV_IDEDMA_FORCED is not set CONFIG_IDEDMA_PCI_AUTO=y # CONFIG_IDEDMA_ONLYDISK is not set CONFIG_BLK_DEV_ADMA=y # CONFIG_BLK_DEV_AEC62XX is not set # CONFIG_BLK_DEV_ALI15X3 is not set CONFIG_BLK_DEV_AMD74XX=y # CONFIG_BLK_DEV_ATIIXP is not set # CONFIG_BLK_DEV_CMD64X is not set # CONFIG_BLK_DEV_TRIFLEX is not set # CONFIG_BLK_DEV_CY82C693 is not set # CONFIG_BLK_DEV_CS5520 is not set # CONFIG_BLK_DEV_CS5530 is not set # CONFIG_BLK_DEV_HPT34X is not set # CONFIG_BLK_DEV_HPT366 is not set # CONFIG_BLK_DEV_SC1200 is not set # CONFIG_BLK_DEV_PIIX is not set # CONFIG_BLK_DEV_NS87415 is not set # CONFIG_BLK_DEV_PDC202XX_OLD is not set # CONFIG_BLK_DEV_PDC202XX_NEW is not set # CONFIG_BLK_DEV_SVWKS is not set # CONFIG_BLK_DEV_SIIMAGE is not set # CONFIG_BLK_DEV_SIS5513 is not set # CONFIG_BLK_DEV_SLC90E66 is not set # CONFIG_BLK_DEV_TRM290 is not set # CONFIG_BLK_DEV_VIA82CXXX is not set # CONFIG_IDE_ARM is not set CONFIG_BLK_DEV_IDEDMA=y # CONFIG_IDEDMA_IVB is not set CONFIG_IDEDMA_AUTO=y # CONFIG_BLK_DEV_HD is not set # # SCSI device support # CONFIG_SCSI=m CONFIG_SCSI_PROC_FS=y # # SCSI support type (disk, tape, CD-ROM) # CONFIG_BLK_DEV_SD=m CONFIG_CHR_DEV_ST=m # CONFIG_CHR_DEV_OSST is not set CONFIG_BLK_DEV_SR=m # CONFIG_BLK_DEV_SR_VENDOR is not set CONFIG_CHR_DEV_SG=m # # Some SCSI devices (e.g. CD jukebox) support multiple LUNs # # CONFIG_SCSI_MULTI_LUN is not set CONFIG_SCSI_CONSTANTS=y # CONFIG_SCSI_LOGGING is not set # # SCSI Transport Attributes # CONFIG_SCSI_SPI_ATTRS=m CONFIG_SCSI_FC_ATTRS=m # # SCSI low-level drivers # CONFIG_BLK_DEV_3W_XXXX_RAID=m # CONFIG_SCSI_ACARD is not set # CONFIG_SCSI_AACRAID is not set # CONFIG_SCSI_AIC7XXX is not set # CONFIG_SCSI_AIC7XXX_OLD is not set # CONFIG_SCSI_AIC79XX is not set # CONFIG_SCSI_ADVANSYS is not set # CONFIG_SCSI_MEGARAID is not set # CONFIG_SCSI_SATA is not set # CONFIG_SCSI_BUSLOGIC is not set # CONFIG_SCSI_DMX3191D is not set # CONFIG_SCSI_EATA is not set # CONFIG_SCSI_EATA_PIO is not set # CONFIG_SCSI_FUTURE_DOMAIN is not set # CONFIG_SCSI_GDTH is not set # CONFIG_SCSI_IPS is not set # CONFIG_SCSI_INIA100 is not set # CONFIG_SCSI_SYM53C8XX_2 is not set # CONFIG_SCSI_IPR is not set # CONFIG_SCSI_QLOGIC_ISP is not set # CONFIG_SCSI_QLOGIC_FC is not set # CONFIG_SCSI_QLOGIC_1280 is not set CONFIG_SCSI_QLA2XXX=m # CONFIG_SCSI_QLA21XX is not set # CONFIG_SCSI_QLA22XX is not set # CONFIG_SCSI_QLA2300 is not set # CONFIG_SCSI_QLA2322 is not set # CONFIG_SCSI_QLA6312 is not set # CONFIG_SCSI_QLA6322 is not set # CONFIG_SCSI_DC395x is not set # CONFIG_SCSI_DC390T is not set # CONFIG_SCSI_DEBUG is not set # # Multi-device support (RAID and LVM) # # CONFIG_MD is not set # # Fusion MPT device support # # CONFIG_FUSION is not set # # IEEE 1394 (FireWire) support # # CONFIG_IEEE1394 is not set # # I2O device support # CONFIG_I2O=m CONFIG_I2O_CONFIG=m CONFIG_I2O_BLOCK=m CONFIG_I2O_SCSI=m CONFIG_I2O_PROC=m # # Networking support # CONFIG_NET=y # # Networking options # CONFIG_PACKET=y CONFIG_PACKET_MMAP=y CONFIG_NETLINK_DEV=m CONFIG_UNIX=y CONFIG_NET_KEY=y CONFIG_INET=y CONFIG_IP_MULTICAST=y # CONFIG_IP_ADVANCED_ROUTER is not set CONFIG_IP_PNP=y CONFIG_IP_PNP_DHCP=y CONFIG_IP_PNP_BOOTP=y CONFIG_IP_PNP_RARP=y # CONFIG_NET_IPIP is not set # CONFIG_NET_IPGRE is not set # CONFIG_IP_MROUTE is not set # CONFIG_ARPD is not set # CONFIG_SYN_COOKIES is not set CONFIG_INET_AH=m CONFIG_INET_ESP=m CONFIG_INET_IPCOMP=m # CONFIG_IPV6 is not set # CONFIG_NETFILTER is not set CONFIG_XFRM=y CONFIG_XFRM_USER=y # # SCTP Configuration (EXPERIMENTAL) # # CONFIG_IP_SCTP is not set # CONFIG_ATM is not set # CONFIG_BRIDGE is not set # CONFIG_VLAN_8021Q is not set # CONFIG_DECNET is not set # CONFIG_LLC2 is not set # CONFIG_IPX is not set # CONFIG_ATALK is not set # CONFIG_X25 is not set # CONFIG_LAPB is not set # CONFIG_NET_DIVERT is not set # CONFIG_ECONET is not set # CONFIG_WAN_ROUTER is not set # CONFIG_NET_FASTROUTE is not set # CONFIG_NET_HW_FLOWCONTROL is not set # # QoS and/or fair queueing # # CONFIG_NET_SCHED is not set # # Network testing # # CONFIG_NET_PKTGEN is not set # CONFIG_NETPOLL is not set # CONFIG_NET_POLL_CONTROLLER is not set # CONFIG_HAMRADIO is not set # CONFIG_IRDA is not set # CONFIG_BT is not set CONFIG_NETDEVICES=y CONFIG_DUMMY=m CONFIG_BONDING=m # CONFIG_EQUALIZER is not set CONFIG_TUN=y # CONFIG_ETHERTAP is not set # # ARCnet devices # # CONFIG_ARCNET is not set # # Ethernet (10 or 100Mbit) # # CONFIG_NET_ETHERNET is not set # # Ethernet (1000 Mbit) # # CONFIG_ACENIC is not set # CONFIG_DL2K is not set # CONFIG_E1000 is not set # CONFIG_NS83820 is not set # CONFIG_HAMACHI is not set # CONFIG_YELLOWFIN is not set # CONFIG_R8169 is not set # CONFIG_SK98LIN is not set CONFIG_TIGON3=y # # Ethernet (10000 Mbit) # # CONFIG_IXGB is not set # CONFIG_S2IO is not set # # Token Ring devices # # CONFIG_TR is not set # # Wireless LAN (non-hamradio) # # CONFIG_NET_RADIO is not set # # Wan interfaces # # CONFIG_WAN is not set # CONFIG_FDDI is not set # CONFIG_HIPPI is not set # CONFIG_PPP is not set # CONFIG_SLIP is not set # CONFIG_NET_FC is not set # CONFIG_SHAPER is not set # CONFIG_NETCONSOLE is not set # # ISDN subsystem # # CONFIG_ISDN is not set # # Telephony Support # # CONFIG_PHONE is not set # # Input device support # CONFIG_INPUT=y # # Userland interfaces # CONFIG_INPUT_MOUSEDEV=y CONFIG_INPUT_MOUSEDEV_PSAUX=y CONFIG_INPUT_MOUSEDEV_SCREEN_X=1024 CONFIG_INPUT_MOUSEDEV_SCREEN_Y=768 # CONFIG_INPUT_JOYDEV is not set # CONFIG_INPUT_TSDEV is not set # CONFIG_INPUT_EVDEV is not set # CONFIG_INPUT_EVBUG is not set # # Input I/O drivers # # CONFIG_GAMEPORT is not set CONFIG_SOUND_GAMEPORT=y CONFIG_SERIO=y CONFIG_SERIO_I8042=y # CONFIG_SERIO_SERPORT is not set # CONFIG_SERIO_CT82C710 is not set # CONFIG_SERIO_PCIPS2 is not set # # Input Device Drivers # CONFIG_INPUT_KEYBOARD=y CONFIG_KEYBOARD_ATKBD=y # CONFIG_KEYBOARD_SUNKBD is not set # CONFIG_KEYBOARD_LKKBD is not set # CONFIG_KEYBOARD_XTKBD is not set # CONFIG_KEYBOARD_NEWTON is not set CONFIG_INPUT_MOUSE=y CONFIG_MOUSE_PS2=y # CONFIG_MOUSE_SERIAL is not set # CONFIG_MOUSE_VSXXXAA is not set # CONFIG_INPUT_JOYSTICK is not set # CONFIG_INPUT_TOUCHSCREEN is not set # CONFIG_INPUT_MISC is not set # # Character devices # CONFIG_VT=y CONFIG_VT_CONSOLE=y CONFIG_HW_CONSOLE=y # CONFIG_SERIAL_NONSTANDARD is not set # # Serial drivers # CONFIG_SERIAL_8250=y CONFIG_SERIAL_8250_CONSOLE=y # CONFIG_SERIAL_8250_ACPI is not set CONFIG_SERIAL_8250_NR_UARTS=4 # CONFIG_SERIAL_8250_EXTENDED is not set # # Non-8250 serial port support # CONFIG_SERIAL_CORE=y CONFIG_SERIAL_CORE_CONSOLE=y CONFIG_UNIX98_PTYS=y # CONFIG_LEGACY_PTYS is not set # CONFIG_QIC02_TAPE is not set # # IPMI # # CONFIG_IPMI_HANDLER is not set # # Watchdog Cards # # CONFIG_WATCHDOG is not set CONFIG_HW_RANDOM=m CONFIG_NVRAM=m CONFIG_RTC=y # CONFIG_DTLK is not set # CONFIG_R3964 is not set # CONFIG_APPLICOM is not set # # Ftape, the floppy tape device driver # CONFIG_AGP=y CONFIG_AGP_AMD64=y # CONFIG_AGP_INTEL_MCH is not set # CONFIG_DRM is not set # CONFIG_MWAVE is not set CONFIG_RAW_DRIVER=m CONFIG_MAX_RAW_DEVS=256 CONFIG_HANGCHECK_TIMER=m # # I2C support # CONFIG_I2C=m CONFIG_I2C_CHARDEV=m # # I2C Algorithms # CONFIG_I2C_ALGOBIT=m CONFIG_I2C_ALGOPCF=m # # I2C Hardware Bus support # # CONFIG_I2C_ALI1535 is not set # CONFIG_I2C_ALI1563 is not set # CONFIG_I2C_ALI15X3 is not set CONFIG_I2C_AMD756=m CONFIG_I2C_AMD8111=m # CONFIG_I2C_I801 is not set # CONFIG_I2C_I810 is not set CONFIG_I2C_ISA=m CONFIG_I2C_NFORCE2=m # CONFIG_I2C_PARPORT_LIGHT is not set # CONFIG_I2C_PROSAVAGE is not set # CONFIG_I2C_SAVAGE4 is not set CONFIG_SCx200_ACB=m # CONFIG_I2C_SIS5595 is not set # CONFIG_I2C_SIS630 is not set # CONFIG_I2C_SIS96X is not set # CONFIG_I2C_VIA is not set # CONFIG_I2C_VIAPRO is not set # CONFIG_I2C_VOODOO3 is not set # # Hardware Sensors Chip support # CONFIG_I2C_SENSOR=m CONFIG_SENSORS_ADM1021=m # CONFIG_SENSORS_ASB100 is not set # CONFIG_SENSORS_DS1621 is not set # CONFIG_SENSORS_FSCHER is not set # CONFIG_SENSORS_GL518SM is not set CONFIG_SENSORS_IT87=m CONFIG_SENSORS_LM75=m CONFIG_SENSORS_LM78=m # CONFIG_SENSORS_LM80 is not set CONFIG_SENSORS_LM83=m CONFIG_SENSORS_LM85=m # CONFIG_SENSORS_LM90 is not set # CONFIG_SENSORS_MAX1619 is not set CONFIG_SENSORS_VIA686A=m CONFIG_SENSORS_W83781D=m # CONFIG_SENSORS_W83L785TS is not set # CONFIG_SENSORS_W83627HF is not set # # Other I2C Chip support # CONFIG_SENSORS_EEPROM=m # CONFIG_SENSORS_PCF8574 is not set # CONFIG_SENSORS_PCF8591 is not set # CONFIG_SENSORS_RTC8564 is not set # CONFIG_I2C_DEBUG_CORE is not set # CONFIG_I2C_DEBUG_ALGO is not set # CONFIG_I2C_DEBUG_BUS is not set # CONFIG_I2C_DEBUG_CHIP is not set # # Misc devices # # CONFIG_IBM_ASM is not set # # Multimedia devices # # CONFIG_VIDEO_DEV is not set # # Digital Video Broadcasting Devices # # CONFIG_DVB is not set # # Graphics support # # CONFIG_FB is not set CONFIG_VIDEO_SELECT=y # # Console display driver support # CONFIG_VGA_CONSOLE=y # CONFIG_MDA_CONSOLE is not set CONFIG_DUMMY_CONSOLE=y # # Sound # # CONFIG_SOUND is not set # # USB support # # CONFIG_USB is not set # # USB Gadget Support # # CONFIG_USB_GADGET is not set # # Firmware Drivers # # CONFIG_EDD is not set # # File systems # CONFIG_EXT2_FS=y # CONFIG_EXT2_FS_XATTR is not set CONFIG_EXT3_FS=y # CONFIG_EXT3_FS_XATTR is not set CONFIG_JBD=y # CONFIG_JBD_DEBUG is not set CONFIG_REISERFS_FS=y # CONFIG_REISERFS_CHECK is not set # CONFIG_REISERFS_PROC_INFO is not set # CONFIG_REISERFS_FS_XATTR is not set CONFIG_JFS_FS=m # CONFIG_JFS_POSIX_ACL is not set # CONFIG_JFS_DEBUG is not set # CONFIG_JFS_STATISTICS is not set CONFIG_XFS_FS=m # CONFIG_XFS_RT is not set # CONFIG_XFS_QUOTA is not set # CONFIG_XFS_SECURITY is not set # CONFIG_XFS_POSIX_ACL is not set CONFIG_MINIX_FS=y CONFIG_ROMFS_FS=y # CONFIG_QUOTA is not set # CONFIG_AUTOFS_FS is not set CONFIG_AUTOFS4_FS=y # # CD-ROM/DVD Filesystems # CONFIG_ISO9660_FS=m CONFIG_JOLIET=y # CONFIG_ZISOFS is not set CONFIG_UDF_FS=m # # DOS/FAT/NT Filesystems # CONFIG_FAT_FS=y CONFIG_MSDOS_FS=y CONFIG_VFAT_FS=m # CONFIG_NTFS_FS is not set # # Pseudo filesystems # CONFIG_PROC_FS=y CONFIG_PROC_KCORE=y CONFIG_SYSFS=y CONFIG_DEVFS_FS=y CONFIG_DEVFS_MOUNT=y # CONFIG_DEVFS_DEBUG is not set # CONFIG_DEVPTS_FS_XATTR is not set CONFIG_TMPFS=y CONFIG_HUGETLBFS=y CONFIG_HUGETLB_PAGE=y CONFIG_RAMFS=y # # Miscellaneous filesystems # # CONFIG_ADFS_FS is not set # CONFIG_AFFS_FS is not set # CONFIG_HFS_FS is not set # CONFIG_HFSPLUS_FS is not set # CONFIG_BEFS_FS is not set # CONFIG_BFS_FS is not set # CONFIG_EFS_FS is not set # CONFIG_JFFS_FS is not set # CONFIG_JFFS2_FS is not set # CONFIG_CRAMFS is not set # CONFIG_VXFS_FS is not set # CONFIG_HPFS_FS is not set # CONFIG_QNX4FS_FS is not set # CONFIG_SYSV_FS is not set # CONFIG_UFS_FS is not set # # Network File Systems # CONFIG_NFS_FS=y CONFIG_NFS_V3=y # CONFIG_NFS_V4 is not set # CONFIG_NFS_DIRECTIO is not set CONFIG_NFSD=y CONFIG_NFSD_V3=y # CONFIG_NFSD_V4 is not set CONFIG_NFSD_TCP=y CONFIG_ROOT_NFS=y CONFIG_LOCKD=y CONFIG_LOCKD_V4=y CONFIG_EXPORTFS=y CONFIG_SUNRPC=y CONFIG_SUNRPC_GSS=y CONFIG_RPCSEC_GSS_KRB5=y CONFIG_SMB_FS=m CONFIG_SMB_NLS_DEFAULT=y CONFIG_SMB_NLS_REMOTE="cp437" CONFIG_CIFS=m # CONFIG_CIFS_STATS is not set # CONFIG_NCP_FS is not set CONFIG_CODA_FS=m # CONFIG_CODA_FS_OLD_API is not set # CONFIG_AFS_FS is not set # # Partition Types # # CONFIG_PARTITION_ADVANCED is not set CONFIG_MSDOS_PARTITION=y # # Native Language Support # CONFIG_NLS=y CONFIG_NLS_DEFAULT="iso8859-1" CONFIG_NLS_CODEPAGE_437=y # CONFIG_NLS_CODEPAGE_737 is not set # CONFIG_NLS_CODEPAGE_775 is not set # CONFIG_NLS_CODEPAGE_850 is not set # CONFIG_NLS_CODEPAGE_852 is not set # CONFIG_NLS_CODEPAGE_855 is not set # CONFIG_NLS_CODEPAGE_857 is not set # CONFIG_NLS_CODEPAGE_860 is not set # CONFIG_NLS_CODEPAGE_861 is not set # CONFIG_NLS_CODEPAGE_862 is not set # CONFIG_NLS_CODEPAGE_863 is not set # CONFIG_NLS_CODEPAGE_864 is not set # CONFIG_NLS_CODEPAGE_865 is not set # CONFIG_NLS_CODEPAGE_866 is not set # CONFIG_NLS_CODEPAGE_869 is not set # CONFIG_NLS_CODEPAGE_936 is not set # CONFIG_NLS_CODEPAGE_950 is not set # CONFIG_NLS_CODEPAGE_932 is not set # CONFIG_NLS_CODEPAGE_949 is not set # CONFIG_NLS_CODEPAGE_874 is not set # CONFIG_NLS_ISO8859_8 is not set # CONFIG_NLS_CODEPAGE_1250 is not set # CONFIG_NLS_CODEPAGE_1251 is not set CONFIG_NLS_ISO8859_1=y # CONFIG_NLS_ISO8859_2 is not set # CONFIG_NLS_ISO8859_3 is not set # CONFIG_NLS_ISO8859_4 is not set # CONFIG_NLS_ISO8859_5 is not set # CONFIG_NLS_ISO8859_6 is not set # CONFIG_NLS_ISO8859_7 is not set # CONFIG_NLS_ISO8859_9 is not set # CONFIG_NLS_ISO8859_13 is not set # CONFIG_NLS_ISO8859_14 is not set # CONFIG_NLS_ISO8859_15 is not set # CONFIG_NLS_KOI8_R is not set # CONFIG_NLS_KOI8_U is not set # CONFIG_NLS_UTF8 is not set # # Profiling support # # CONFIG_PROFILING is not set # # Kernel hacking # # CONFIG_DEBUG_KERNEL is not set CONFIG_MAGIC_SYSRQ=y # CONFIG_FRAME_POINTER is not set # # Security options # # CONFIG_SECURITY is not set # # Cryptographic options # CONFIG_CRYPTO=y CONFIG_CRYPTO_HMAC=y CONFIG_CRYPTO_NULL=m CONFIG_CRYPTO_MD4=m CONFIG_CRYPTO_MD5=y CONFIG_CRYPTO_SHA1=m CONFIG_CRYPTO_SHA256=m CONFIG_CRYPTO_SHA512=m CONFIG_CRYPTO_DES=y CONFIG_CRYPTO_BLOWFISH=m CONFIG_CRYPTO_TWOFISH=m CONFIG_CRYPTO_SERPENT=m CONFIG_CRYPTO_AES=m CONFIG_CRYPTO_CAST5=m CONFIG_CRYPTO_CAST6=m CONFIG_CRYPTO_ARC4=m CONFIG_CRYPTO_DEFLATE=m # CONFIG_CRYPTO_MICHAEL_MIC is not set CONFIG_CRYPTO_CRC32C=m # CONFIG_CRYPTO_TEST is not set # # Library routines # CONFIG_CRC32=m CONFIG_LIBCRC32C=m CONFIG_ZLIB_INFLATE=m CONFIG_ZLIB_DEFLATE=m
Ok, I just saw this bug as well - I was a little surprised that the simple patch which seems to work around it hasn't been submitted for 2.6.8.1 (which is the kernel I'm using on this machine). xfs_iget_core: ambiguous vns: vp/0xf472e360, invp/0xf4933340 ------------[ cut here ]------------ kernel BUG at fs/xfs/support/debug.c:106! invalid operand: 0000 [#1] SMP CPU: 1 EIP: 0060:[<c0223f07>] Not tainted EFLAGS: 00010246 (2.6.8.1) EIP is at cmn_err+0x97/0xb0 eax: 00000040 ebx: 00000293 ecx: c036fa24 edx: c036fa24 esi: c033c287 edi: c0437c1e ebp: 00000000 esp: f5eb3a94 ds: 007b es: 007b ss: 0068 Process nfsd (pid: 335, threadinfo=f5eb2000 task=f5e8a7b0) Stack: c04208e0 f6294194 f5eb2000 f6f18528 f4933360 c01f7ff2 00000000 c0337120 f472e360 f4933340 f4933360 f4933340 f5eb2000 00000008 f6294198 f4019760 c01f840c f4933340 f6f18400 00000000 1c21c2db 00000000 00000008 f5eb3b44 Call Trace: [<c01f7ff2>] xfs_iget_core+0x182/0x510 [<c01f840c>] xfs_iget+0x8c/0x160 [<c0213244>] xfs_vget+0x44/0xc0 [<c0223425>] vfs_vget+0x25/0x30 [<c0222e78>] linvfs_get_dentry+0x48/0x90 [<c01a57bd>] find_exported_dentry+0x3d/0x660 [<c0202cc4>] xlog_write+0x124/0x490 [<c0139f1c>] __kmalloc+0x4c/0xa0 [<c02b517c>] alloc_skb+0x3c/0xe0 [<c02b43e7>] sock_alloc_send_pskb+0x77/0x210 [<c0210f5a>] xfs_trans_unlock_chunk+0x6a/0xb0 [<c02b459c>] sock_alloc_send_skb+0x1c/0x30 ... Machine is a dual athlon-mp, with a 147G XFS on LVM on Software RAID-1 on IDE disks. It seems that a lot of people are reporting this... Just thought I'd add to the "me too" choir ;)
I notice there's a common thread of NFS in these bug reports. Has anyone who's encountering the problem tried running with this NFS patch, which fixes an SMP race in knfsd? http://marc.theaimsgroup.com/?l=linux-kernel&m=108330112505555&w=2
*** Bug 359 has been marked as a duplicate of this bug. ***
Bug moved to . If the move succeeded, cattelan@thebarn.com will receive a mail containing the number of the new bug in the other database. If all went well, please mark this bug verified, and paste in a link to the new bug. Otherwise, reopen this bug.
This has finally been fixed a few weeks ago
In which rev. of the code was it fixed? Reference to a changelog? Version of the (linux) kernel source this will be included in? Something so I can see it's fixed and test it :)