| Andrew Cooke | Contents | Latest | RSS | Twitter | Previous | Next

C[omp]ute

Welcome to my blog, which was once a mailing list of the same name and is still generated by mail. Please reply via the "comment" links.

Always interested in offers/projects/new ideas. Eclectic experience in fields like: numerical computing; Python web; Java enterprise; functional languages; GPGPU; SQL databases; etc. Based in Santiago, Chile; telecommute worldwide. CV; email.

Personal Projects

Lepl parser for Python.

Colorless Green.

Photography around Santiago.

SVG experiment.

Professional Portfolio

Calibration of seismometers.

Data access via web services.

Cache rewrite.

Extending OpenSSH.

C-ORM: docs, API.

Last 100 entries

Some Victoriagate Links; This Is Why I Left StackOverflow; New TLS Implementation; Maths for Physicists; How I Am 8; 1000 Word Philosophy; Cyberpunk Reading List; Detailed Discussion of Message Dispatch in ParserCombinator Library for Julia; FizzBuzz in Julia w Dependent Types; kokko - Design Shop in Osaka; Summary of Greece, Currently; LLVM and GPUs; See Also; Schoolgirl Groyps (Maths); Japanese Lit; Another Example - Modular Arithmetic; Music from United; Read Agatha Christie for the Plot; A Constructive Look at TempleOS; Music Thread w Many Recommendations; Fixed Version; A Useful Julia Macro To Define Equality And Hash; k3b cdrom access, OpenSuse 13.1; Week 2; From outside, the UK looks less than stellar; Huge Fonts in VirtualBox; Keen - Complex Emergencies; The Fallen of World War II; Some Spanish Fiction; Calling C From Fortran 95; Bjork DJ Set; Z3 Example With Python; Week 1; Useful Guide To Starting With IJulia; UK Election + Media; Review: Reinventing Organizations; Inline Assembly With Julia / LLVM; Against the definition of types; Dumb Crypto Paper; The Search For Quasi-Periodicity...; Is There An Alternative To Processing?; CARDIAC (CARDboard Illustrative Aid to Computation); The Bolivian Case Against Chile At The Hague; Clear, Cogent Economic Arguments For Immigration; A Program To Say If I Am Working; Decent Cards For Ill People; New Photo; Luksic And Barrick Gold; President Bachelet's Speech; Baltimore Primer; libxml2 Parsing Stream; configure.ac Recipe For Library Path; The Davalos Affair For Idiots; Not The Onion: Google Fireside Chat w Kissinger; Bicycle Wheels, Inertia, and Energy; Another Tax Fraud; Google's Borg; A Verion That Redirects To Local HTTP Server; Spanish Accents For Idiots; Aluminium Cans; Advice on Spray Painting; Female View of Online Chat From a Male; UX Reading List; S4 Subgroups - Geometric Interpretation; Fucking Email; The SQM Affair For Idiots; Using Kolmogorov Complexity; Oblique Strategies in bash; Curses Tools; Markov Chain Monte Carlo Without all the Bullshit; Email Para Matias Godoy Mercado; The Penta Affair For Idiots; Example Code To Create numpy Array in C; Good Article on Bias in Graphic Design (NYTimes); Do You Backup github?; Data Mining Books; SimpleDateFormat should be synchronized; British Words; Chinese Govt Intercepts External Web To DDOS github; Numbering Permutations; Teenage Engineering - Low Price Synths; GCHQ Can Do Whatever It Wants; Dublinesque; A Cryptographic SAT Solver; Security Challenges; Word Lists for Crosswords; 3D Printing and Speaker Design; Searchable Snowden Archive; XCode Backdoored; Derived Apps Have Malware (CIA); Rowhammer - Hacking Software Via Hardware (DRAM) Bugs; Immutable SQL Database (Kinda); Tor GPS Tracker; That PyCon Dongle Mess...; ASCII Fluid Dynamics; Brandalism; Table of Shifter, Cassette and Derailleur Compatability; Lenovo Demonstrates How Bad HTTPS Is; Telegraph Owned by HSBC; Smaptop - Sunrise (Music); Equation Group (NSA); UK Torture in NI

© 2006-2015 Andrew Cooke (site) / post authors (content).

RAID on SuSE Linux 10.2

From: "andrew cooke" <andrew@...>

Date: Sun, 4 Mar 2007 21:12:44 -0300 (CLST)

In retrospect, software RAID in Linux is easy.  If you're doing a clean
install there's nothing to it.  However, I couldn't (for a long time) find
anything that said this.  So I read explanations about RAID technology and
wondered how on earth I could boot from a software RAID - it seemed like a
chicken and egg situation unless you went with simple mirroring, which was
inefficient.

So I started by trying to install the OS on a separate PATA disk (the
P5LD2 has a single parallel IDE controller that is intended for CD/DVD). 
Luckily this failed (Grub crashed) and when I went to the SuSE IRC channel
some jerk knew enough to imply I was an idiot, but not enough to answer
any questions.

Still, it was useful to know I was wrong.  Searching some more I found
this page -
http://en.opensuse.org/How_to_install_SUSE_Linux_on_software_RAID -
(obvious in retrospect, but I turned it up only when I switched googling
from "suse" to "opensuse").  That was enough to make me realise I had
missed a "RAID button" on the installer interface.

In fact, I hadn't missed it - I just didn't realise how powerful it was.

So here's what I did - it uses just the 4 identical SATA disks I bought
and it gives you a system completely on RAID that makes efficient use of
disk space.  All the below is via the "expert" partitioning section of the
install (from scratch).

1 - Partition each disk the same.  I used the following scheme for all:
  sd?1:  100MB  (destined to be /boot)
  sd?2:    4GB  (destined to be swap)
  sd?3   290GB  (destined to be root)
(Incidentally, I don't quite see how 320GB drives end up being 290GB in
size).

2 - Instead of formatting these partitions, mark them to be used as RAID
(in the create or edit dialogue, select "do not format" and then "RAID").

3 - Use the drop-down RAID button/menu to join these into three different
RAID devides:
  md0:   100MB RAID 1  /boot  (ext3, mirrored across all disks)
  md1:   3x4GB RAID 5  swap
  md2: 3x290GB RAID 5  /      (ext3)
Note that /boot is RAID 1, which means each disk is the same.  That lets
you bootstrap the system (RAID5 would be unreadable because it's striped).
 This is a waste of space, but it's very small so doesn't matter.  Next,
swap is RAID just so that the system doesn't crash if a disk dies (it
would be faster to have swap without RAID, distributed across all disks). 
Finally, I use a single partition for everything else.  You can, of
course, do something more complex.

Once you do this "everything just works".  The md0... devices "replace"
sda1..., sdb1.. and SuSE does all the right things.  The only difference
from normal is that when it boots you see lots of exciting messages as the
kernel puts everything together.

One final note - it seems that it's best to use SMART for disk monitoring
(or you may not realise when a disk dies).

For the record this was with SuSE 10.2, x86 64bit, and I finally
downloaded the CDs since it was faster overall than repeated experiments
with network install.

Summary: once you work up the courage (and use the RAID button/menu) this
is easy.

Andrew

How about post-install

From: "andrew cooke" <andrew@...>

Date: Thu, 31 Jul 2008 21:20:48 -0400 (CLT)

---------------------------- Original Message ----------------------------
From:    "Fabian Wein" <fwein@...>
Date:    Thu, July 31, 2008 12:38 pm
--------------------------------------------------------------------------

How to convert an existing system to a RAID system when the
I get a new (identical) drive?

Thanks,

Fabian

Re: How about post-install

From: "andrew cooke" <andrew@...>

Date: Thu, 31 Jul 2008 21:23:36 -0400 (CLT)

gah!  i just messed up forwarding this to my blog - i will delete what is
there and the reply, but the simple answer is that i don't know.

i *guess* you might be able to make a system with one disk (ie create a
two disk raid in a broken state) and then copy your data to that.  after
that you could delete the existing data and use that old disk to extend
the array on the new disk.

but this sounds very risky to me.  given the price of disks, i would
suggest buying two, and then once you are sure they are working together,
copy across the data, delete and add the old disk in ("grow").

i am not sure i gave all details on the blog, but at one point i did lose
a system playing around.  i am not 100% confident in the dynamic
modification of the raid, and i am not an expert...

good luck,
andrew

Comment on this post