[2.] Full Description
I am using rsync to mirror a hard drive in its entirety as part of a daily
backup schedule. Both drives are on the same machine. Rsync has failed for
the last 3 nights and the system logs are reporting a kernel bug.
I have been experiencing crashes on the machine while running the daily and
weekly cron jobs which I believe may be due to it running out of memory. The
crashes were aleviated somewhat by deferring the backup till later and
temporarily disabling the Htdig indexer.
Aside from the rsync failure, the system appears to be running OK.
It would be nice to know if this can be safely attributed to a lack of memory
or is it likely to be something more sinister and a whole lot more painful?
System
Dual Athlon MP 1800
512 RAM
256 Swap
Asus a7m266-d mb with AMD-768 South bridge and AMD-762 North Bridge
2xIDE drives
3COM 3c905 nic
AGP video card
rsync version: 2.5.6cvs protocol version 26
[3.] Keywords
kernel bug rsync 2.4.19 memory
[4.] Kernel version from /proc/version
Linux version 2.4.19 (root@wing.wire.org.au) (gcc version 2.95.4 20011002
(Debian prerelease)) #2 SMP Wed Nov 13 13:44:22 EST 2002
[5.] Output in /var/log/messages
Apr 1 06:51:51 wing kernel: kernel BUG at page_alloc.c:91!
Apr 1 06:51:51 wing kernel: invalid operand: 0000
Apr 1 06:51:51 wing kernel: CPU: 0
Apr 1 06:51:51 wing kernel: EIP: 0010:[__free_pages_ok+45/624] Not
tainted
Apr 1 06:51:51 wing kernel: EFLAGS: 00010286
Apr 1 06:51:51 wing kernel: eax: 0100000d ebx: c10c00b8 ecx: c10c00b8
edx: 00000000
Apr 1 06:51:51 wing kernel: esi: 00000000 edi: cea7fb30 ebp: 00000179
esp: c8be7ef8
Apr 1 06:51:51 wing kernel: ds: 0018 es: 0018 ss: 0018
Apr 1 06:51:51 wing kernel: Process rsync (pid: 30576, stackpage=c8be7000)
Apr 1 06:51:51 wing kernel: Stack: c10c00b8 00001000 cea7fb30 00000179
0000017f
00000020 dfe52640 c012b555
Apr 1 06:51:51 wing kernel: c10c00b8 c10c00b8 dfea1e80 cea7fb30
00000178
c013310c c012b7fd c8be7f8c
Apr 1 06:51:51 wing kernel: c10c00b8 00000000 00001000 00000000
dfe52640
ffffffea 00030000 00001000
Apr 1 06:51:51 wing kernel: Call Trace: [generic_file_readahead+261/320]
[__free_pages+28/32] [do_generic_file_read+573/1120]
[generic_file_read+133/320] [file_read_actor+0/144]
Apr 1 06:51:51 wing kernel: [sys_read+150/272] [system_call+51/56]
Apr 1 06:51:51 wing kernel:
Apr 1 06:51:51 wing kernel: Code: 0f 0b 5b 00 13 9a 21 c0 89 d8 2b 05 30 b8
2c
c0 69 c0 a3 8b
[6.] Script
Here are the commands that are run during a successful backup. I have marked
the recent failure point.
/sbin/hdparm -q -R 0x170 0 0 /dev/hda > /dev/null
/sbin/e2fsck -f -y /dev/hdc5 > /dev/null 2>&1
/sbin/e2fsck -f -y /dev/hdc6 > /dev/null 2>&1
/sbin/e2fsck -f -y /dev/hdc7 > /dev/null 2>&1
/sbin/e2fsck -f -y /dev/hdc9 > /dev/null 2>&1
/sbin/e2fsck -f -y /dev/hdc10 > /dev/null 2>&1
/sbin/e2fsck -f -y /dev/hdc11 > /dev/null 2>&1
/sbin/e2fsck -f -y /dev/hdc12 > /dev/null 2>&1
/bin/mount -t ext2 /dev/hdc6 /mnt/backup/
/bin/mount -t ext2 /dev/hdc5 /mnt/backup/boot
/bin/mount -t ext2 /dev/hdc7 /mnt/backup/tmp
/bin/mount -t ext2 /dev/hdc9 /mnt/backup/usr
/bin/mount -t ext2 /dev/hdc10 /mnt/backup/var
/bin/mount -t ext2 /dev/hdc11 /mnt/backup/home
/bin/mount -t ext2 /dev/hdc12 /mnt/backup/clients
/usr/bin/rsync -aH --delete --timeout=180 /bin/ /mnt/backup/bin
/usr/bin/rsync -aH --delete --timeout=180 /boot/ /mnt/backup/boot
/usr/bin/rsync -aH --delete --timeout=180 /clients/ /mnt/backup/clients
/usr/bin/rsync -aH --delete --timeout=180 /dev/ /mnt/backup/dev
/usr/bin/rsync -aH --delete --timeout=180 /etc/ /mnt/backup/etc
/usr/bin/rsync -aH --delete --timeout=180 /home/ /mnt/backup/home
***FAILED HERE***
/usr/bin/rsync -aH --delete --timeout=180 /initrd/ /mnt/backup/initrd
/usr/bin/rsync -aH --delete --timeout=180 /lib/ /mnt/backup/lib
/usr/bin/rsync -aH --delete --timeout=180 /opt/ /mnt/backup/opt
/usr/bin/rsync -aH --delete --timeout=180 /root/ /mnt/backup/root
/usr/bin/rsync -aH --delete --timeout=180 /sbin/ /mnt/backup/sbin
/usr/bin/rsync -aH --delete --timeout=180 /usr/ /mnt/backup/usr
/usr/bin/rsync -aH --delete --timeout=180 /var/ /mnt/backup/var
/usr/sbin/chroot /mnt/backup sbin/lilo -C /etc/lilo.conf.backup > /dev/null
/bin/sync
/bin/umount /mnt/backup/boot
/bin/umount /mnt/backup/tmp
/bin/umount /mnt/backup/usr
/bin/umount /mnt/backup/var
/bin/umount /mnt/backup/home
/bin/umount /mnt/backup/clients
/bin/umount /mnt/backup/
/sbin/hdparm -Y /dev/hdc > /dev/null
[7.] Environment
[7.1.] output of ver_linux
If some fields are empty or look unusual you may have an old version.
Compare to the current minimal requirements in Documentation/Changes.
Linux wing.wire.org.au 2.4.19 #2 SMP Wed Nov 13 13:44:22 EST 2002 i686
unknown
Gnu C 2.95.4
Gnu make 3.79.1
util-linux 2.11n
mount 2.11n
modutils 2.4.15
e2fsprogs 1.27
PPP 2.4.1
Linux C Library 2.2.5
Dynamic linker (ldd) 2.2.5
Procps 2.0.7
Net-tools 1.60
Console-tools 0.2.3
Sh-utils 2.0.11
Modules Loaded vfat fat smbfs
[7.2] Processor Information
processor : 0
vendor_id : AuthenticAMD
cpu family : 6
model : 6
model name : AMD Athlon(TM) MP 1800+
stepping : 2
cpu MHz : 1533.402
cache size : 256 KB
fdiv_bug : no
hlt_bug : no
f00f_bug : no
coma_bug : no
fpu : yes
fpu_exception : yes
cpuid level : 1
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat
pse36
mmx fxsr sse syscall mmxext 3dnowext 3dnow
bogomips : 3060.53
processor : 1
vendor_id : AuthenticAMD
cpu family : 6
model : 6
model name : AMD Athlon(TM) MP 1800+
stepping : 2
cpu MHz : 1533.402
cache size : 256 KB
fdiv_bug : no
hlt_bug : no
f00f_bug : no
coma_bug : no
fpu : yes
fpu_exception : yes
cpuid level : 1
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat
pse36
mmx fxsr sse syscall mmxext 3dnowext 3dnow
bogomips : 3060.53
[7.3.] Modules Info
vfat 9596 0 (unused)
fat 30648 0 [vfat]
smbfs 33504 0 (unused)
[7.4.] Loaded Driver and hardware information
/proc/ioports
0000-001f : dma1
0020-003f : pic1
0040-005f : timer
0060-006f : keyboard
0070-007f : rtc
0080-008f : dma page reg
00a0-00bf : pic2
00c0-00df : dma2
00f0-00ff : fpu
0170-0177 : ide1
01f0-01f7 : ide0
02f8-02ff : serial(auto)
0376-0376 : ide1
03c0-03df : vga+
03f6-03f6 : ide0
03f8-03ff : serial(set)
0cf8-0cff : PCI conf1
c000-cfff : PCI Bus #02
c800-c87f : 3Com Corporation 3c905C-TX/TX-M [Tornado]
c800-c87f : 02:08.0
d800-d80f : Advanced Micro Devices [AMD] AMD-768 [Opus] IDE
d800-d807 : ide0
e800-e803 : Advanced Micro Devices [AMD] AMD-760 MP [IGD4-2P] System
Controller
/proc/iomem
00000000-0009f7ff : System RAM
0009f800-0009ffff : reserved
000a0000-000bffff : Video RAM area
000c0000-000c7fff : Video ROM
000c8000-000c87ff : Extension ROM
000f0000-000fffff : System ROM
00100000-1ffebfff : System RAM
00100000-002101f2 : Kernel code
002101f3-0025b9df : Kernel data
1ffec000-1ffeefff : ACPI Tables
1ffef000-1fffefff : reserved
1ffff000-1fffffff : ACPI Non-volatile Storage
f5800000-f67fffff : PCI Bus #02
f5800000-f580007f : 3Com Corporation 3c905C-TX/TX-M [Tornado]
f6800000-f68000ff : NEC Corporation USB 2.0
f7000000-f7000fff : NEC Corporation USB (#2)
f7800000-f7800fff : NEC Corporation USB
f8000000-f9afffff : PCI Bus #01
f8000000-f8ffffff : NVidia / SGS Thomson (Joint Venture) Riva128
f9b00000-f9bfffff : PCI Bus #02
f9c00000-fb7fffff : PCI Bus #01
fa000000-faffffff : NVidia / SGS Thomson (Joint Venture) Riva128
fb800000-fb800fff : Advanced Micro Devices [AMD] AMD-760 MP [IGD4-2P] System
Controller
fc000000-fdffffff : Advanced Micro Devices [AMD] AMD-760 MP [IGD4-2P] System
Controller
fec00000-fec00fff : reserved
fee00000-fee00fff : reserved
ffff0000-ffffffff : reserved
[7.5] PCI Info
00:00.0 Host bridge: Advanced Micro Devices [AMD]: Unknown device 700c (rev
11)
Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping-
SERR- FastB2B-
Status: Cap+ 66Mhz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort-
<MAbort+ >SERR- <PERR-
Latency: 32
Region 0: Memory at fc000000 (32-bit, prefetchable) [size=32M]
Region 1: Memory at fb800000 (32-bit, prefetchable) [size=4K]
Region 2: I/O ports at e800 [disabled] [size=4]
Capabilities: [a0] AGP version 2.0
Status: RQ=15 SBA+ 64bit- FW- Rate=x1,x2
Command: RQ=0 SBA- AGP- 64bit- FW- Rate=<none>
00:01.0 PCI bridge: Advanced Micro Devices [AMD]: Unknown device 700d (prog-if
00 [Normal decode])
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping-
SERR- FastB2B-
Status: Cap- 66Mhz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort-
<MAbort- >SERR- <PERR-
Latency: 0
Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
I/O behind bridge: 0000e000-0000dfff
Memory behind bridge: f8000000-f9afffff
Prefetchable memory behind bridge: f9c00000-fb7fffff
BridgeCtl: Parity- SERR- NoISA- VGA+ MAbort- >Reset- FastB2B-
00:07.0 ISA bridge: Advanced Micro Devices [AMD]: Unknown device 7440 (rev 05)
Subsystem: Asustek Computer, Inc.: Unknown device 8044
Control: I/O+ Mem+ BusMaster+ SpecCycle+ MemWINV- VGASnoop- ParErr- Stepping-
SERR- FastB2B-
Status: Cap- 66Mhz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort-
<MAbort- >SERR- <PERR-
Latency: 0
00:07.1 IDE interface: Advanced Micro Devices [AMD]: Unknown device 7441 (rev
04) (prog-if 8a [Master SecP PriP])
Subsystem: Advanced Micro Devices [AMD]: Unknown device 7441
Control: I/O+ Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping-
SERR- FastB2B-
Status: Cap- 66Mhz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort-
<MAbort- >SERR- <PERR-
Latency: 32
Region 4: I/O ports at d800 [size=16]
00:07.3 Bridge: Advanced Micro Devices [AMD]: Unknown device 7443 (rev 03)
Subsystem: Asustek Computer, Inc.: Unknown device 8044
Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping-
SERR- FastB2B-
Status: Cap- 66Mhz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort-
<MAbort- >SERR- <PERR-
00:09.0 USB Controller: NEC Corporation USB (rev 41) (prog-if 10 [OHCI])
Subsystem: Unknown device 807d:0035
Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping-
SERR- FastB2B-
Status: Cap+ 66Mhz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort-
<MAbort- >SERR- <PERR-
Latency: 32 (250ns min, 10500ns max), cache line size 08
Interrupt: pin A routed to IRQ 10
Region 0: Memory at f7800000 (32-bit, non-prefetchable) [size=4K]
Capabilities: [40] Power Management version 2
Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0+,D1+,D2+,D3hot+,D3cold-)
Status: D0 PME-Enable- DSel=0 DScale=0 PME-
00:09.1 USB Controller: NEC Corporation USB (rev 41) (prog-if 10 [OHCI])
Subsystem: Unknown device 807d:0035
Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping-
SERR- FastB2B-
Status: Cap+ 66Mhz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort-
<MAbort- >SERR- <PERR-
Latency: 32 (250ns min, 10500ns max), cache line size 08
Interrupt: pin B routed to IRQ 12
Region 0: Memory at f7000000 (32-bit, non-prefetchable) [size=4K]
Capabilities: [40] Power Management version 2
Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0+,D1+,D2+,D3hot+,D3cold-)
Status: D0 PME-Enable- DSel=0 DScale=0 PME-
00:09.2 USB Controller: NEC Corporation: Unknown device 00e0 (rev 02) (prog-if
20)
Subsystem: Unknown device 807d:1043
Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping-
SERR- FastB2B-
Status: Cap+ 66Mhz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort-
<MAbort- >SERR- <PERR-
Latency: 32 (4000ns min, 8500ns max), cache line size 08
Interrupt: pin C routed to IRQ 5
Region 0: Memory at f6800000 (32-bit, non-prefetchable) [size=256]
Capabilities: [40] Power Management version 2
Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0+,D1+,D2+,D3hot+,D3cold-)
Status: D0 PME-Enable- DSel=0 DScale=0 PME-
00:10.0 PCI bridge: Advanced Micro Devices [AMD]: Unknown device 7448 (rev 05)
(prog-if 00 [Normal decode])
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping-
SERR- FastB2B-
Status: Cap- 66Mhz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort-
<MAbort+ >SERR- <PERR-
Latency: 32
Bus: primary=00, secondary=02, subordinate=02, sec-latency=32
I/O behind bridge: 0000c000-0000cfff
Memory behind bridge: f5800000-f67fffff
Prefetchable memory behind bridge: f9b00000-f9bfffff
BridgeCtl: Parity- SERR- NoISA+ VGA- MAbort- >Reset- FastB2B-
01:05.0 VGA compatible controller: NVidia / SGS Thomson (Joint Venture)
Riva128
(rev 22) (prog-if 00 [VGA])
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping-
SERR- FastB2B-
Status: Cap+ 66Mhz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort-
<MAbort- >SERR- <PERR-
Latency: 64 (750ns min, 250ns max)
Interrupt: pin A routed to IRQ 11
Region 0: Memory at f8000000 (32-bit, non-prefetchable) [size=16M]
Region 1: Memory at fa000000 (32-bit, prefetchable) [size=16M]
Expansion ROM at f9c00000 [disabled] [size=4M]
Capabilities: [44] AGP version 1.0
Status: RQ=4 SBA- 64bit- FW- Rate=x1,x2
Command: RQ=0 SBA- AGP- 64bit- FW- Rate=<none>
02:08.0 Ethernet controller: 3Com Corporation 3c905C-TX [Fast Etherlink] (rev
78)
Subsystem: 3Com Corporation 3C905C-TX Fast Etherlink for PC Management NIC
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping-
SERR- FastB2B-
Status: Cap+ 66Mhz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort-
<MAbort- >SERR- <PERR-
Latency: 32 (2500ns min, 2500ns max), cache line size 08
Interrupt: pin A routed to IRQ 5
Region 0: I/O ports at c800 [size=128]
Region 1: Memory at f5800000 (32-bit, non-prefetchable) [size=128]
Expansion ROM at <unassigned> [disabled] [size=128K]
Capabilities: [dc] Power Management version 2
Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0+,D1+,D2+,D3hot+,D3cold+)
Status: D0 PME-Enable- DSel=0 DScale=2 PME-
[7.6.] SCSI
None
[7.7] Any other information
-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/