| Andrew Cooke | Contents | Latest | RSS | Twitter | Previous | Next

C[omp]ute

Welcome to my blog, which was once a mailing list of the same name and is still generated by mail. Please reply via the "comment" links.

Always interested in offers/projects/new ideas. Eclectic experience in fields like: numerical computing; Python web; Java enterprise; functional languages; GPGPU; SQL databases; etc. Based in Santiago, Chile; telecommute worldwide. CV; email.

Personal Projects

Lepl parser for Python.

Colorless Green.

Photography around Santiago.

SVG experiment.

Professional Portfolio

Calibration of seismometers.

Data access via web services.

Cache rewrite.

Extending OpenSSH.

Last 100 entries

Re: Python's sad, unimaginative Enum; Re: Some explanation; Some explanation; Printing binary trees sideways; Atoms in python; About "Python's sad, unimaginative Enum"; Frustration Understood; Some good feedback here; this is fucking useless; I agree with you #nt; What would be imaginative?; Re: Enum; Enum; Python's sad, unimaginative Enum; Possible Fix; Work, Exhaustion, Vacation; VirtualBox with Centos 6.3 to 6.4, client; Matasano - Programming Lessons Learned; PDF to HTML; Alternate Substitution; Why RSA Works; Trigger; Dreaming of Death; Example: Tracing; Using Coroutines In Protocol Simulations; Python 3.3 Only; Pure Python SHA1 and MD4 Implementations; Ubuntu on VirtualBox; Starting TOR as a service on OpenSuse 12.3; 1001 Albums; Using fail2ban on OpenSuse 12.3; PPPoE on OpenSuse 12.3; Good Article on Unified Physics; It's Police (Carabineros); Linux Software for Listening to and Exploring Music; Android is Pretty Bad; Lucky Number; 3D Printing for Casting; Cover Art for MPDroid; Who'd a thought the French were so bigoted?; PS Input Signal; Small Problem with Roksan K2 Amp; Roksan K2 Amp + ATC SCM7 Speakers; Do What Makes Sense; Re: Arguing About Tests, Still; Arguing About Tests, Still; Images; Good Article on NY Drummers; Related Bug Report; Getting Python 3.3 and Virtualenv Working in OpenSuse 12.3; How I Am; Awesome video about digital audio; The Difference Between Dimensional and Normalized Databases; The rise of the new Chinese bogeyman; Updated Syntax; Very First Steps to C-ORM; The Ideal User Interface For Music Exploration; Can The Republicans Be Saved?; Rate Limiting Calls to EchoNest; Mods to Cache; Comparing UYKFG and UYKFD/E/F; Someone Else is Concerned; EchoNest-based Playlist Generator for MPD; Example Voting Results; A Heavyweight Python Cache; Identifying Artists with EchoNest; Notes on Pregalex / Pregabalina / Lyrica; The Neil Cowley Trio; Drake - Make for Data; A Reliable Python Web Service; Useful Python Date/Time Library?; Need to Sleep, But this is Good; Command Line Set Difference; Little Details...; Linux Command Line Tricks; AutoTools Tutorial; Hangman Tactics; A Tor Proxy Embedded In A Web Page; Tree (Nested Dicts) in Python; Sleeping at Parties; I Know Someone Who Hurts Other People; Light and Tea; Description of the LCS35 Time Capsule Crypto-Puzzle; Re: I can relate to that ...; I can relate to that ...; Re: It's 2012 Why Does My IDE Suck?; My Own Alternative Medicine; Nice explanation of SVM; Why and How Writing Crypto is Hard; Re: It's 2012 Why Does My IDE Suck?; Incremental Regular Expressions; BBC Map Confused at Pole; Social Media: Ground Zero in the Culture War; My Visit to the Psycho Doc; Learning Modern 3D Graphics Programming; Hope you got some crackers to go with the cheese; Re: But how easy would it be ...; But how easy would it be ...; Powerline Freq Fingerprinting of Audio; The Folly of Scientism; Cheese - Because You're Going to Die Anyway

© 2006-2013 Andrew Cooke (site) / post authors (content).

RAID on SuSE Linux 10.2

From: "andrew cooke" <andrew@...>

Date: Sun, 4 Mar 2007 21:12:44 -0300 (CLST)

In retrospect, software RAID in Linux is easy.  If you're doing a clean
install there's nothing to it.  However, I couldn't (for a long time) find
anything that said this.  So I read explanations about RAID technology and
wondered how on earth I could boot from a software RAID - it seemed like a
chicken and egg situation unless you went with simple mirroring, which was
inefficient.

So I started by trying to install the OS on a separate PATA disk (the
P5LD2 has a single parallel IDE controller that is intended for CD/DVD). 
Luckily this failed (Grub crashed) and when I went to the SuSE IRC channel
some jerk knew enough to imply I was an idiot, but not enough to answer
any questions.

Still, it was useful to know I was wrong.  Searching some more I found
this page -
http://en.opensuse.org/How_to_install_SUSE_Linux_on_software_RAID -
(obvious in retrospect, but I turned it up only when I switched googling
from "suse" to "opensuse").  That was enough to make me realise I had
missed a "RAID button" on the installer interface.

In fact, I hadn't missed it - I just didn't realise how powerful it was.

So here's what I did - it uses just the 4 identical SATA disks I bought
and it gives you a system completely on RAID that makes efficient use of
disk space.  All the below is via the "expert" partitioning section of the
install (from scratch).

1 - Partition each disk the same.  I used the following scheme for all:
  sd?1:  100MB  (destined to be /boot)
  sd?2:    4GB  (destined to be swap)
  sd?3   290GB  (destined to be root)
(Incidentally, I don't quite see how 320GB drives end up being 290GB in
size).

2 - Instead of formatting these partitions, mark them to be used as RAID
(in the create or edit dialogue, select "do not format" and then "RAID").

3 - Use the drop-down RAID button/menu to join these into three different
RAID devides:
  md0:   100MB RAID 1  /boot  (ext3, mirrored across all disks)
  md1:   3x4GB RAID 5  swap
  md2: 3x290GB RAID 5  /      (ext3)
Note that /boot is RAID 1, which means each disk is the same.  That lets
you bootstrap the system (RAID5 would be unreadable because it's striped).
 This is a waste of space, but it's very small so doesn't matter.  Next,
swap is RAID just so that the system doesn't crash if a disk dies (it
would be faster to have swap without RAID, distributed across all disks). 
Finally, I use a single partition for everything else.  You can, of
course, do something more complex.

Once you do this "everything just works".  The md0... devices "replace"
sda1..., sdb1.. and SuSE does all the right things.  The only difference
from normal is that when it boots you see lots of exciting messages as the
kernel puts everything together.

One final note - it seems that it's best to use SMART for disk monitoring
(or you may not realise when a disk dies).

For the record this was with SuSE 10.2, x86 64bit, and I finally
downloaded the CDs since it was faster overall than repeated experiments
with network install.

Summary: once you work up the courage (and use the RAID button/menu) this
is easy.

Andrew

How about post-install

From: "andrew cooke" <andrew@...>

Date: Thu, 31 Jul 2008 21:20:48 -0400 (CLT)

---------------------------- Original Message ----------------------------
From:    "Fabian Wein" <fwein@...>
Date:    Thu, July 31, 2008 12:38 pm
--------------------------------------------------------------------------

How to convert an existing system to a RAID system when the
I get a new (identical) drive?

Thanks,

Fabian

Re: How about post-install

From: "andrew cooke" <andrew@...>

Date: Thu, 31 Jul 2008 21:23:36 -0400 (CLT)

gah!  i just messed up forwarding this to my blog - i will delete what is
there and the reply, but the simple answer is that i don't know.

i *guess* you might be able to make a system with one disk (ie create a
two disk raid in a broken state) and then copy your data to that.  after
that you could delete the existing data and use that old disk to extend
the array on the new disk.

but this sounds very risky to me.  given the price of disks, i would
suggest buying two, and then once you are sure they are working together,
copy across the data, delete and add the old disk in ("grow").

i am not sure i gave all details on the blog, but at one point i did lose
a system playing around.  i am not 100% confident in the dynamic
modification of the raid, and i am not an expert...

good luck,
andrew

Comment on this post