Hello all,
A system question, not so VDR related, but I hope someone in the list use the same configuration.
From time to time my system won't boot since ext3 file system got corrupted
and asks me to log in as root and run fsck manually. No bad blocks are found, just incorrectly stored nodes that are always fixed.
I have 3 320GByte SATA disks partitioned to several large partitions, those partitions are configured to software RAID-5 between disks and on those RAID-5 partitions there are 2 LVM volumes, one for system and another for storage. There are also 250 MByte partition on every disk, while 2 of them are configured to software RAID-1 and mapped to /boot.
System LVM gets corrupted more often since its used more intensively.
Does anybody here have the same configuration? Or any other software RAID-5 configuration? Did anyone faced such problems? Maybe someone facing the same problem without RAIDs? Any help will be appreciated.
I'm running on Fedora 10 with 2.6.27 kernel. I had the same problem with Fedora 8 as well.
Thanks. Alex.
I started switching to raid but ran into problems with lack of info. 3 500gb sata drives with 3 partitions each. The first 2 are mirrored with 1 spare. That was to be for all the boot abd program files. The second was to be swap and the third which is raid 5 is storage for recordings. I have the recordings in use, but ran into some confusion about setting up the boot stuff. I don't recall the exact problem, but when installing the stuff for raid it did some kind of update, but only to the original kernal which is still there, not to the custom built which is being used. Some the messages pointed to things relating to using a ram disk during boot which is not suposed to be needed when just mirroring the boot area.
I was going to also use LVM on the raid 5 part but ext3 wasn't well supported and the other file systems didn't have the full jernaling or something and I also want to set up samba and use some of that space for backing up my windows computer.
----- Original Message ----- From: Alex Betis To: vdr@linuxtv.org Sent: Thursday, December 18, 2008 12:51 PM Subject: [vdr] Soft RAID-5 + LVM file system corruption
Hello all,
A system question, not so VDR related, but I hope someone in the list use the same configuration.
From time to time my system won't boot since ext3 file system got corrupted and asks me to log in as root and run fsck manually. No bad blocks are found, just incorrectly stored nodes that are always fixed.
I have 3 320GByte SATA disks partitioned to several large partitions, those partitions are configured to software RAID-5 between disks and on those RAID-5 partitions there are 2 LVM volumes, one for system and another for storage. There are also 250 MByte partition on every disk, while 2 of them are configured to software RAID-1 and mapped to /boot.
System LVM gets corrupted more often since its used more intensively.
Does anybody here have the same configuration? Or any other software RAID-5 configuration? Did anyone faced such problems? Maybe someone facing the same problem without RAIDs? Any help will be appreciated.
I'm running on Fedora 10 with 2.6.27 kernel. I had the same problem with Fedora 8 as well.
Thanks. Alex.
------------------------------------------------------------------------------
_______________________________________________ vdr mailing list vdr@linuxtv.org http://www.linuxtv.org/cgi-bin/mailman/listinfo/vdr
On Thu, Dec 18, 2008 at 11:20 PM, Timothy D. Lenz tlenz@vorgon.com wrote:
I started switching to raid but ran into problems with lack of info. 3 500gb sata drives with 3 partitions each. The first 2 are mirrored with 1 spare. That was to be for all the boot abd program files. The second was to be swap and the third which is raid 5 is storage for recordings. I have the recordings in use, but ran into some confusion about setting up the boot stuff. I don't recall the exact problem, but when installing the stuff for raid it did some kind of update, but only to the original kernal which is still there, not to the custom built which is being used. Some the messages pointed to things relating to using a ram disk during boot which is not suposed to be needed when just mirroring the boot area.
I was going to also use LVM on the raid 5 part but ext3 wasn't well supported and the other file systems didn't have the full jernaling or something and I also want to set up samba and use some of that space for backing up my windows computer.
What distro did you tried to use? I've tried Ubuntu about a year ago, but it didn't support any RAID nor LVM configurations in installation stage, so I went back to Fedora, which has all those options.
Configuration is very easily done. The only tricky part is that you have to type some commands manually in fdisk to install MBR on both disks if you want to boot from RAID-1 setup. All the info is available on the net.
By the way, my swap is also on LVM/RAID-5.
I just don't know how to get rid from the node corruptions. I start suspecting my hardware. Run memory tests many times, but no conclusion so far.
----- Original Message ----- *From:* Alex Betis alex.betis@gmail.com *To:* vdr@linuxtv.org *Sent:* Thursday, December 18, 2008 12:51 PM *Subject:* [vdr] Soft RAID-5 + LVM file system corruption
Hello all,
A system question, not so VDR related, but I hope someone in the list use the same configuration.
From time to time my system won't boot since ext3 file system got corrupted and asks me to log in as root and run fsck manually. No bad blocks are found, just incorrectly stored nodes that are always fixed.
I have 3 320GByte SATA disks partitioned to several large partitions, those partitions are configured to software RAID-5 between disks and on those RAID-5 partitions there are 2 LVM volumes, one for system and another for storage. There are also 250 MByte partition on every disk, while 2 of them are configured to software RAID-1 and mapped to /boot.
System LVM gets corrupted more often since its used more intensively.
Does anybody here have the same configuration? Or any other software RAID-5 configuration? Did anyone faced such problems? Maybe someone facing the same problem without RAIDs? Any help will be appreciated.
I'm running on Fedora 10 with 2.6.27 kernel. I had the same problem with Fedora 8 as well.
Thanks. Alex.
vdr mailing list vdr@linuxtv.org http://www.linuxtv.org/cgi-bin/mailman/listinfo/vdr
vdr mailing list vdr@linuxtv.org http://www.linuxtv.org/cgi-bin/mailman/listinfo/vdr
On Thu, 18 Dec 2008 23:32:31 +0200 "Alex Betis" alex.betis@gmail.com wrote:
I've tried Ubuntu about a year ago, but it didn't support any RAID nor LVM configurations in installation stage, so I went back to Fedora, which has all those options.
I can't find much about this on ubuntu.com, but its "alternate" (text mode installer) download definitley used to support LVM and no doubt still does. I'm pretty sure it's based on Debian's installer, which apparently does also support RAID.
Tony Houghton a écrit :
On Thu, 18 Dec 2008 23:32:31 +0200 "Alex Betis" alex.betis@gmail.com wrote:
I've tried Ubuntu about a year ago, but it didn't support any RAID nor LVM configurations in installation stage, so I went back to Fedora, which has all those options.
I can't find much about this on ubuntu.com, but its "alternate" (text mode installer) download definitley used to support LVM and no doubt still does. I'm pretty sure it's based on Debian's installer, which apparently does also support RAID.
I installed Debian with RAID + LVM at the text installer stage many times. One can install almost any RAID + LVM mix directly with the installer. No problem since many years, but I always use ReiserFS, even for /boot. I also use RAID1 instead fo RAID5.
My home server : * hda1, hdc1 : /boot, selected by the BIOS * hda2 + hdc2 : RAID1 + LVM, for system FS (/, /var, /usr, etc) * hda3, hdc3 : bare swap * hda4 + hdc4 : LVM (/home, /backup) * hdb1 + hdd1 : LVM in stripped mode (/video)
My hosting servers have similar setups, with DRBD in the game (network RAID1).
On Fri, Dec 19, 2008 at 11:21 AM, Nicolas Huillard nicolas@huillard.netwrote:
Tony Houghton a écrit :
On Thu, 18 Dec 2008 23:32:31 +0200 "Alex Betis" alex.betis@gmail.com wrote:
I've tried Ubuntu about a year ago, but it didn't support any RAID nor
LVM
configurations in installation stage, so I went back to Fedora, which
has
all those options.
I can't find much about this on ubuntu.com, but its "alternate" (text mode installer) download definitley used to support LVM and no doubt still does. I'm pretty sure it's based on Debian's installer, which apparently does also support RAID.
I installed Debian with RAID + LVM at the text installer stage many times. One can install almost any RAID + LVM mix directly with the installer. No problem since many years, but I always use ReiserFS, even for /boot. I also use RAID1 instead fo RAID5.
I've spent half a day googling around to see if someone had the same problem as I have. People reported even worse problems than mine, all reported that it happened only with ext3, but did not happen with reiser. Looks like big caches on hard drives cause some problems so the journal info is not properly written. Since ext3 doesn't have CRC on journal blocks, it can't detect the problem. The issue is supposed to be solved in ext4. Although other file systems didn't report any problem, everyone said it still doesn't mean there is no problem, maybe other FSs didn't detect it yet.
Also, many sysadmins that manage large systems write against LVM when not needed (like in our case), according to them its just adds non-needed complexity and cause some problems. I kinda agree with them. So I'm in process now of removing the LVM and stay with RAID1 for boot, RAID5 for system, swap and storage. I'll probably stay with ext3 for now.
My home server :
- hda1, hdc1 : /boot, selected by the BIOS
- hda2 + hdc2 : RAID1 + LVM, for system FS (/, /var, /usr, etc)
- hda3, hdc3 : bare swap
- hda4 + hdc4 : LVM (/home, /backup)
- hdb1 + hdd1 : LVM in stripped mode (/video)
My hosting servers have similar setups, with DRBD in the game (network RAID1).
How do you setup this thing? Can't you just use rsync or something similar?
-- NH
vdr mailing list vdr@linuxtv.org http://www.linuxtv.org/cgi-bin/mailman/listinfo/vdr
Debian ----- Original Message ----- From: Alex Betis To: VDR Mailing List Sent: Thursday, December 18, 2008 2:32 PM Subject: Re: [vdr] Soft RAID-5 + LVM file system corruption
On Thu, Dec 18, 2008 at 11:20 PM, Timothy D. Lenz tlenz@vorgon.com wrote:
I started switching to raid but ran into problems with lack of info. 3 500gb sata drives with 3 partitions each. The first 2 are mirrored with 1 spare. That was to be for all the boot abd program files. The second was to be swap and the third which is raid 5 is storage for recordings. I have the recordings in use, but ran into some confusion about setting up the boot stuff. I don't recall the exact problem, but when installing the stuff for raid it did some kind of update, but only to the original kernal which is still there, not to the custom built which is being used. Some the messages pointed to things relating to using a ram disk during boot which is not suposed to be needed when just mirroring the boot area.
I was going to also use LVM on the raid 5 part but ext3 wasn't well supported and the other file systems didn't have the full jernaling or something and I also want to set up samba and use some of that space for backing up my windows computer. What distro did you tried to use? I've tried Ubuntu about a year ago, but it didn't support any RAID nor LVM configurations in installation stage, so I went back to Fedora, which has all those options.
Configuration is very easily done. The only tricky part is that you have to type some commands manually in fdisk to install MBR on both disks if you want to boot from RAID-1 setup. All the info is available on the net.
By the way, my swap is also on LVM/RAID-5.
I just don't know how to get rid from the node corruptions. I start suspecting my hardware. Run memory tests many times, but no conclusion so far.
----- Original Message ----- From: Alex Betis To: vdr@linuxtv.org Sent: Thursday, December 18, 2008 12:51 PM Subject: [vdr] Soft RAID-5 + LVM file system corruption
Hello all,
A system question, not so VDR related, but I hope someone in the list use the same configuration.
From time to time my system won't boot since ext3 file system got corrupted and asks me to log in as root and run fsck manually. No bad blocks are found, just incorrectly stored nodes that are always fixed.
I have 3 320GByte SATA disks partitioned to several large partitions, those partitions are configured to software RAID-5 between disks and on those RAID-5 partitions there are 2 LVM volumes, one for system and another for storage. There are also 250 MByte partition on every disk, while 2 of them are configured to software RAID-1 and mapped to /boot.
System LVM gets corrupted more often since its used more intensively.
Does anybody here have the same configuration? Or any other software RAID-5 configuration? Did anyone faced such problems? Maybe someone facing the same problem without RAIDs? Any help will be appreciated.
I'm running on Fedora 10 with 2.6.27 kernel. I had the same problem with Fedora 8 as well.
Thanks. Alex.
--------------------------------------------------------------------------
_______________________________________________ vdr mailing list vdr@linuxtv.org http://www.linuxtv.org/cgi-bin/mailman/listinfo/vdr
_______________________________________________ vdr mailing list vdr@linuxtv.org http://www.linuxtv.org/cgi-bin/mailman/listinfo/vdr
------------------------------------------------------------------------------
_______________________________________________ vdr mailing list vdr@linuxtv.org http://www.linuxtv.org/cgi-bin/mailman/listinfo/vdr
Some updated, to close that issue for those who will find it in the list later.
File system corruption was not the only anomaly in my system, for example WiFi card had different MAC address every boot and few more interesting things...
I've replaced memory modules although memtest didn't find any problem with all its tests. It's too early to be sure, but so far everything looks fine, so I'm staying with LVM over RAID5 for now since its the most flexible way to manage hard disk space.
On Thu, Dec 18, 2008 at 9:51 PM, Alex Betis alex.betis@gmail.com wrote:
Hello all,
A system question, not so VDR related, but I hope someone in the list use the same configuration.
From time to time my system won't boot since ext3 file system got corrupted and asks me to log in as root and run fsck manually. No bad blocks are found, just incorrectly stored nodes that are always fixed.
I have 3 320GByte SATA disks partitioned to several large partitions, those partitions are configured to software RAID-5 between disks and on those RAID-5 partitions there are 2 LVM volumes, one for system and another for storage. There are also 250 MByte partition on every disk, while 2 of them are configured to software RAID-1 and mapped to /boot.
System LVM gets corrupted more often since its used more intensively.
Does anybody here have the same configuration? Or any other software RAID-5 configuration? Did anyone faced such problems? Maybe someone facing the same problem without RAIDs? Any help will be appreciated.
I'm running on Fedora 10 with 2.6.27 kernel. I had the same problem with Fedora 8 as well.
Thanks. Alex.
-
Alex Betis -
Nicolas Huillard -
Timothy D. Lenz -
Tony Houghton