August 16, 201411 yr Im replacing one of my drives and the average rebuild speed is around 7 MB/s, parity checks are around the same speed. A fellow forum user told me to check the log, but honestly i have no idea what im looking for. Any experts out there wanna help me figure this out. syslog: http://pastebin.com/i4nPH32C
August 16, 201411 yr Author CPU: Intel® Core2 Duo CPU E6550 @ 2.33GHz Mem: 2gb. PCI devices: 00:00.0 Host bridge: Intel Corporation 82G33/G31/P35/P31 Express DRAM Controller (rev 02) Subsystem: Giga-byte Technology Unknown device 5000 Flags: bus master, fast devsel, latency 0 Capabilities: [e0] Vendor Specific Information 00:1a.0 USB Controller: Intel Corporation 82801I (ICH9 Family) USB UHCI Controller #4 (rev 02) (prog-if 00 [uHCI]) Subsystem: Giga-byte Technology Unknown device 5004 Flags: bus master, medium devsel, latency 0, IRQ 16 I/O ports at e000 [size=32] Capabilities: [50] PCIe advanced features Kernel driver in use: uhci_hcd 00:1a.1 USB Controller: Intel Corporation 82801I (ICH9 Family) USB UHCI Controller #5 (rev 02) (prog-if 00 [uHCI]) Subsystem: Giga-byte Technology Unknown device 5004 Flags: bus master, medium devsel, latency 0, IRQ 21 I/O ports at e100 [size=32] Capabilities: [50] PCIe advanced features Kernel driver in use: uhci_hcd 00:1a.2 USB Controller: Intel Corporation 82801I (ICH9 Family) USB UHCI Controller #6 (rev 02) (prog-if 00 [uHCI]) Subsystem: Giga-byte Technology Unknown device 5004 Flags: bus master, medium devsel, latency 0, IRQ 18 I/O ports at e500 [size=32] Capabilities: [50] PCIe advanced features Kernel driver in use: uhci_hcd 00:1a.7 USB Controller: Intel Corporation 82801I (ICH9 Family) USB2 EHCI Controller #2 (rev 02) (prog-if 20 [EHCI]) Subsystem: Giga-byte Technology Unknown device 5006 Flags: bus master, medium devsel, latency 0, IRQ 18 Memory at f7001000 (32-bit, non-prefetchable) [size=1K] Capabilities: [50] Power Management version 2 Kernel driver in use: ehci-pci 00:1c.0 PCI bridge: Intel Corporation 82801I (ICH9 Family) PCI Express Port 1 (rev 02) (prog-if 00 [Normal decode]) Flags: bus master, fast devsel, latency 0 Bus: primary=00, secondary=01, subordinate=01, sec-latency=0 I/O behind bridge: 0000a000-0000afff Memory behind bridge: 80000000-801fffff Prefetchable memory behind bridge: 0000000080200000-00000000803fffff Capabilities: [40] Express Root Port (Slot+), MSI 00 Capabilities: [80] Message Signalled Interrupts: Mask- 64bit- Queue=0/0 Enable+ Capabilities: [90] Subsystem: Giga-byte Technology Unknown device 5001 Capabilities: [a0] Power Management version 2 Capabilities: [100] Virtual Channel Capabilities: [180] Root Complex Link Kernel driver in use: pcieport 00:1c.4 PCI bridge: Intel Corporation 82801I (ICH9 Family) PCI Express Port 5 (rev 02) (prog-if 00 [Normal decode]) Flags: bus master, fast devsel, latency 0 Bus: primary=00, secondary=02, subordinate=02, sec-latency=0 I/O behind bridge: 0000b000-0000bfff Memory behind bridge: f6000000-f6ffffff Prefetchable memory behind bridge: 0000000080400000-00000000805fffff Capabilities: [40] Express Root Port (Slot+), MSI 00 Capabilities: [80] Message Signalled Interrupts: Mask- 64bit- Queue=0/0 Enable+ Capabilities: [90] Subsystem: Giga-byte Technology Unknown device 5001 Capabilities: [a0] Power Management version 2 Capabilities: [100] Virtual Channel Capabilities: [180] Root Complex Link Kernel driver in use: pcieport 00:1c.5 PCI bridge: Intel Corporation 82801I (ICH9 Family) PCI Express Port 6 (rev 02) (prog-if 00 [Normal decode]) Flags: bus master, fast devsel, latency 0 Bus: primary=00, secondary=03, subordinate=03, sec-latency=0 I/O behind bridge: 0000c000-0000cfff Memory behind bridge: f4000000-f5ffffff Prefetchable memory behind bridge: 0000000080600000-00000000808fffff Capabilities: [40] Express Root Port (Slot+), MSI 00 Capabilities: [80] Message Signalled Interrupts: Mask- 64bit- Queue=0/0 Enable+ Capabilities: [90] Subsystem: Giga-byte Technology Unknown device 5001 Capabilities: [a0] Power Management version 2 Capabilities: [100] Virtual Channel Capabilities: [180] Root Complex Link Kernel driver in use: pcieport 00:1d.0 USB Controller: Intel Corporation 82801I (ICH9 Family) USB UHCI Controller #1 (rev 02) (prog-if 00 [uHCI]) Subsystem: Giga-byte Technology Unknown device 5004 Flags: bus master, medium devsel, latency 0, IRQ 23 I/O ports at e200 [size=32] Capabilities: [50] PCIe advanced features Kernel driver in use: uhci_hcd 00:1d.1 USB Controller: Intel Corporation 82801I (ICH9 Family) USB UHCI Controller #2 (rev 02) (prog-if 00 [uHCI]) Subsystem: Giga-byte Technology Unknown device 5004 Flags: bus master, medium devsel, latency 0, IRQ 19 I/O ports at e300 [size=32] Capabilities: [50] PCIe advanced features Kernel driver in use: uhci_hcd 00:1d.2 USB Controller: Intel Corporation 82801I (ICH9 Family) USB UHCI Controller #3 (rev 02) (prog-if 00 [uHCI]) Subsystem: Giga-byte Technology Unknown device 5004 Flags: bus master, medium devsel, latency 0, IRQ 18 I/O ports at e400 [size=32] Capabilities: [50] PCIe advanced features Kernel driver in use: uhci_hcd 00:1d.7 USB Controller: Intel Corporation 82801I (ICH9 Family) USB2 EHCI Controller #1 (rev 02) (prog-if 20 [EHCI]) Subsystem: Giga-byte Technology Unknown device 5006 Flags: bus master, medium devsel, latency 0, IRQ 23 Memory at f7000000 (32-bit, non-prefetchable) [size=1K] Capabilities: [50] Power Management version 2 Kernel driver in use: ehci-pci 00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev 92) (prog-if 01 [subtractive decode]) Flags: bus master, fast devsel, latency 0 Bus: primary=00, secondary=04, subordinate=04, sec-latency=32 I/O behind bridge: 0000d000-0000dfff Memory behind bridge: e0000000-efffffff Prefetchable memory behind bridge: 0000000080900000-0000000080bfffff Capabilities: [50] Subsystem: Giga-byte Technology GA-EP45-DS5 Motherboard 00:1f.0 ISA bridge: Intel Corporation 82801IB (ICH9) LPC Interface Controller (rev 02) Subsystem: Giga-byte Technology Unknown device 5001 Flags: bus master, medium devsel, latency 0 Capabilities: [e0] Vendor Specific Information 00:1f.2 SATA controller: Intel Corporation 82801IB (ICH9) 4 port SATA AHCI Controller (rev 02) (prog-if 01 [AHCI 1.0]) Subsystem: Giga-byte Technology Unknown device b005 Flags: bus master, 66MHz, medium devsel, latency 0, IRQ 43 I/O ports at e600 [size=8] I/O ports at e700 [size=4] I/O ports at e800 [size=8] I/O ports at e900 [size=4] I/O ports at ea00 [size=32] Memory at f7002000 (32-bit, non-prefetchable) [size=2K] Capabilities: [80] Message Signalled Interrupts: Mask- 64bit- Queue=0/4 Enable+ Capabilities: [70] Power Management version 3 Capabilities: [a8] SATA HBA Capabilities: [b0] PCIe advanced features Kernel driver in use: ahci Kernel modules: ahci 00:1f.3 SMBus: Intel Corporation 82801I (ICH9 Family) SMBus Controller (rev 02) Subsystem: Giga-byte Technology Unknown device 5001 Flags: medium devsel, IRQ 18 Memory at f7003000 (64-bit, non-prefetchable) [size=256] I/O ports at 0500 [size=32] Kernel driver in use: i801_smbus Kernel modules: i2c-i801 02:00.0 IDE interface: JMicron Technologies, Inc. JMB368 IDE controller (prog-if 85 [Master SecO PriO]) Subsystem: Giga-byte Technology Unknown device b000 Flags: bus master, fast devsel, latency 0, IRQ 16 I/O ports at b000 [size=8] I/O ports at b100 [size=4] I/O ports at b200 [size=8] I/O ports at b300 [size=4] I/O ports at b400 [size=16] Capabilities: [68] Power Management version 2 Capabilities: [50] Express Legacy Endpoint, MSI 01 Kernel driver in use: JMicron IDE Kernel modules: pata_jmicron, jmicron 03:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168B PCI Express Gigabit Ethernet controller (rev 01) Subsystem: Giga-byte Technology GA-EP45-DS5 Motherboard Flags: bus master, fast devsel, latency 0, IRQ 44 I/O ports at c000 [size=256] Memory at f5000000 (64-bit, non-prefetchable) [size=4K] [virtual] Expansion ROM at 80600000 [disabled] [size=128K] Capabilities: [40] Power Management version 2 Capabilities: [48] Vital Product Data Capabilities: [50] Message Signalled Interrupts: Mask- 64bit+ Queue=0/1 Enable+ Capabilities: [60] Express Endpoint, MSI 00 Capabilities: [84] Vendor Specific Information Capabilities: [100] Advanced Error Reporting Capabilities: [12c] Virtual Channel Capabilities: [148] Device Serial Number 00-e0-4c-68-00-00-00-01 Capabilities: [154] Power Budgeting Kernel driver in use: r8168 Kernel modules: r8168 04:00.0 VGA compatible controller: S3 Inc. 86C270-294 Savage/MX-MV (rev 11) (prog-if 00 [VGA controller]) Subsystem: Appian Technology Unknown device 3871 Flags: bus master, medium devsel, latency 32, IRQ 14 Memory at e0000000 (32-bit, non-prefetchable) [size=128M] [virtual] Expansion ROM at 80b00000 [disabled] [size=64K] Capabilities: [dc] Power Management version 1 04:01.0 RAID bus controller: Silicon Image, Inc. SiI 3114 [sATALink/SATARaid] Serial ATA Controller (rev 02) Subsystem: Silicon Image, Inc. Unknown device 7114 Flags: bus master, 66MHz, medium devsel, latency 32, IRQ 19 I/O ports at d000 [size=8] I/O ports at d100 [size=4] I/O ports at d200 [size=8] I/O ports at d300 [size=4] I/O ports at d400 [size=16] Memory at e901b000 (32-bit, non-prefetchable) [size=1K] [virtual] Expansion ROM at 80900000 [disabled] [size=512K] Capabilities: [60] Power Management version 2 Kernel driver in use: sata_sil Kernel modules: sata_sil 04:02.0 RAID bus controller: Silicon Image, Inc. SiI 3124 PCI-X Serial ATA Controller (rev 02) Subsystem: Silicon Image, Inc. Unknown device 7124 Flags: bus master, stepping, 66MHz, medium devsel, latency 32, IRQ 18 Memory at e9019000 (64-bit, non-prefetchable) [size=128] Memory at e9000000 (64-bit, non-prefetchable) [size=32K] I/O ports at d500 [size=16] [virtual] Expansion ROM at 80980000 [disabled] [size=512K] Capabilities: [64] Power Management version 2 Capabilities: [40] PCI-X non-bridge device Capabilities: [54] Message Signalled Interrupts: Mask- 64bit+ Queue=0/0 Enable- Kernel driver in use: sata_sil24 Kernel modules: sata_sil24 04:03.0 RAID bus controller: Silicon Image, Inc. SiI 3124 PCI-X Serial ATA Controller (rev 02) Subsystem: Silicon Image, Inc. Unknown device 7124 Flags: bus master, stepping, 66MHz, medium devsel, latency 32, IRQ 16 Memory at e9018000 (64-bit, non-prefetchable) [size=128] Memory at e9008000 (64-bit, non-prefetchable) [size=32K] I/O ports at d600 [size=16] [virtual] Expansion ROM at 80a00000 [disabled] [size=512K] Capabilities: [64] Power Management version 2 Capabilities: [40] PCI-X non-bridge device Capabilities: [54] Message Signalled Interrupts: Mask- 64bit+ Queue=0/0 Enable- Kernel driver in use: sata_sil24 Kernel modules: sata_sil24 04:04.0 RAID bus controller: Silicon Image, Inc. SiI 3124 PCI-X Serial ATA Controller (rev 02) Subsystem: Silicon Image, Inc. Unknown device 7124 Flags: bus master, stepping, 66MHz, medium devsel, latency 32, IRQ 20 Memory at e901a000 (64-bit, non-prefetchable) [size=128] Memory at e9010000 (64-bit, non-prefetchable) [size=32K] I/O ports at d700 [size=16] [virtual] Expansion ROM at 80a80000 [disabled] [size=512K] Capabilities: [64] Power Management version 2 Capabilities: [40] PCI-X non-bridge device Capabilities: [54] Message Signalled Interrupts: Mask- 64bit+ Queue=0/0 Enable- Kernel driver in use: sata_sil24 Kernel modules: sata_sil24 Picture of unmenu main window:
August 17, 201411 yr Are you using the server while the rebuild is going on? i.e. streaming video; running a plugin or addon that actively writes to the server; etc. Any of those activities can VERY significantly slow down the rebuilds. Also, how are your drives connected? With 19 drives obviously only a few are connected to the motherboard SATA ports. If you're using an old PCI SATA controller with a significant number of drives connected to the PCI bus, THAT would easily explain why you have such slow parity check and rebuild speeds. Especially if you've got a PCI-X controller that's plugged into a PCI slot !! (which looks like it might be the case). I'd just be patient and let the rebuild continue. The speed should pick up notably when it passes the 1TB mark of the rebuild, since at that point only 7 drives will be involved (instead of the 19 involved now); then only 3 drives after it passes the 2TB mark; and finally only two drives for the final TB. By the time it passes the 2TB mark it should be going MUCH faster, as there won't be any bus speed restrictions at that point. It may be just as good after the 1TB point, depending on just how the remaining 7 drives are connected.
August 17, 201411 yr Author Yes its in use while rebuilding. (1 stream) I have tried to shutdown the stream but I didn't see a speed increase. I don't know about the hardware as someone gave me the server but if memory serves me right there are 3 cards with 4 disks each. The rest is connected to the motherboard. It's strange getting 20 mbish writes but 7mb rebuilds. Not so strange if the bus is maxed
August 17, 201411 yr I suspect you have multiple drives on the PCI bus, so that easily explains how slow it is. Depending on the mix of connections for the 7 drives that will be connected when it hits the 1TB point in the rebuild, you may notice a big jump there. If, however, several of those are on the same controller, then that increase won't happen until it passes 2TB in the rebuild. After that it should be running MUCH faster.
August 18, 201411 yr You're welcome. Has it passed the 1TB point yet? .... if so, what is the speed now?
September 5, 201411 yr Author I dont remember, but it its was a Nice append improvement. Was even better after it passed the 2tb mark
Archived
This topic is now archived and is closed to further replies.