Andrew Cooke | Contents | Latest | RSS | Previous | Next

C[omp]ute

Welcome to my blog, which was once a mailing list of the same name and is still generated by mail. Please reply via the "comment" links.

Always interested in offers/projects/new ideas. Eclectic experience in fields like: numerical computing; Python web; Java enterprise; functional languages; GPGPU; SQL databases; etc. Based in Santiago, Chile; telecommute worldwide. CV; email.

Personal Projects

Choochoo Training Diary

Last 100 entries

Surprise Paradox; [Books] Good Author List; [Computing] Efficient queries with grouping in Postgres; [Computing] Automatic Wake (Linux); [Computing] AWS CDK Aspects in Go; [Bike] Adidas Gravel Shoes; [Computing, Horror] Biological Chips; [Books] Weird Lit Recs; [Covid] Extended SIR Models; [Art] York-based Printmaker; [Physics] Quantum Transitions are not Instantaneous; [Computing] AI and Drum Machines; [Computing] Probabilities, Stopping Times, Martingales; bpftrace Intro Article; [Computing] Starlab Systems - Linux Laptops; [Computing] Extended Berkeley Packet Filter; [Green] Mainspring Linear Generator; Better Approach; Rummikub Solver; Chilean Poetry; Felicitations - Empowerment Grant; [Bike] Fixing Spyre Brakes (That Need Constant Adjustment); [Computing, Music] Raspberry Pi Media (Audio) Streamer; [Computing] Amazing Hack To Embed DSL In Python; [Bike] Ruta Del Condor (El Alfalfal); [Bike] Estimating Power On Climbs; [Computing] Applying Azure B2C Authentication To Function Apps; [Bike] Gearing On The Back Of An Envelope; [Computing] Okular and Postscript in OpenSuse; There's a fix!; [Computing] Fail2Ban on OpenSuse Leap 15.3 (NFTables); [Cycling, Computing] Power Calculation and Brakes; [Hardware, Computing] Amazing Pockit Computer; Bullying; How I Am - 3 Years Post Accident, 8+ Years With MS; [USA Politics] In America's Uncivil War Republicans Are The Aggressors; [Programming] Selenium and Python; Better Walking Data; [Bike] How Fast Before Walking More Efficient Than Cycling?; [COVID] Coronavirus And Cycling; [Programming] Docker on OpenSuse; Cadence v Speed; [Bike] Gearing For Real Cyclists; [Programming] React plotting - visx; [Programming] React Leaflet; AliExpress Independent Sellers; Applebaum - Twilight of Democracy; [Politics] Back + US Elections; [Programming,Exercise] Simple Timer Script; [News] 2019: The year revolt went global; [Politics] The world's most-surveilled cities; [Bike] Hope Freehub; [Restaurant] Mama Chau's (Chinese, Providencia); [Politics] Brexit Podcast; [Diary] Pneumonia; [Politics] Britain's Reichstag Fire moment; install cairo; [Programming] GCC Sanitizer Flags; [GPU, Programming] Per-Thread Program Counters; My Bike Accident - Looking Back One Year; [Python] Geographic heights are incredibly easy!; [Cooking] Cookie Recipe; Efficient, Simple, Directed Maximisation of Noisy Function; And for argparse; Bash Completion in Python; [Computing] Configuring Github Jekyll Locally; [Maths, Link] The Napkin Project; You can Masquerade in Firewalld; [Bike] Servicing Budget (Spring) Forks; [Crypto] CIA Internet Comms Failure; [Python] Cute Rate Limiting API; [Causality] Judea Pearl Lecture; [Security, Computing] Chinese Hardware Hack Of Supermicro Boards; SQLAlchemy Joined Table Inheritance and Delete Cascade; [Translation] The Club; [Computing] Super Potato Bruh; [Computing] Extending Jupyter; Further HRM Details; [Computing, Bike] Activities in ch2; [Books, Link] Modern Japanese Lit; What ended up there; [Link, Book] Logic Book; Update - Garmin Express / Connect; Garmin Forerunner 35 v 230; [Link, Politics, Internet] Government Trolls; [Link, Politics] Why identity politics benefits the right more than the left; SSH Forwarding; A Specification For Repeating Events; A Fight for the Soul of Science; [Science, Book, Link] Lost In Math; OpenSuse Leap 15 Network Fixes; Update; [Book] Galileo's Middle Finger; [Bike] Chinese Carbon Rims; [Bike] Servicing Shimano XT Front Hub HB-M8010; [Bike] Aliexpress Cycling Tops; [Computing] Change to ssh handling of multiple identities?; [Bike] Endura Hummvee Lite II; [Computing] Marble Based Logic; [Link, Politics] Sanity Check For Nuclear Launch; [Link, Science] Entropy and Life

© 2006-2017 Andrew Cooke (site) / post authors (content).

Using iPod on Linux

From: andrew cooke <andrew@...>

Date: Sat, 11 Aug 2012 13:06:49 -0400

I foolishly thought this would be easier than it was...  The iPod in question
is a new 160GB classic.

First, I read about Linux support for HFS (the Mac file system).  It seems now
to be working, as long as journalling is disabled, so I initialised the iPod
using Paulina's Mac (that formats the internal drive to HFS).  My theory was
that HFS would give better performance and perhaps longer battery life than
FAT.

Note that you need to explicitly disable journaing from a Mac, otherwise Linux
will mount the disk in read-only mode.

I then wrote some code that generated a database from my music and used the
Python wrappers to libgpod to load a random selection to the iPod.

This code failed to work.  I never understood why.
http://stackoverflow.com/questions/11777914

The gtkpod program (which is also based on libgpod) does work, however.  So I
adopted my code to generate a directory of links to random tracks.  I then
used gtkpod to load those tracks to the iPod.

The interface to gtkpod is less than intuitive.  Somehow I managed to lose an
important window and spent 30 minutes desperately clicking around.  But
eventually you can get it to work.

That worked once.

The second time I tried it there were errors and my computer crashed.

The third time I watched more closely and the HFS driver is throwing errors.
Again the computer (my desktop, which has the music) eventually crashed.  It
seems that the HFS support in Linux is still unreliable.

So I decided to try using iTunes from within a virtual machine (VirtualBox).
I already had a VM running Windows on the desktop for development work.

I exported my music using Samba, which I could see from Windows.  I then
installed iTunes.  But then I found that Windows could not see the USB hub
(even when the Oracle extension is installed).  I believe this is either
because my hardware is USB3, or because I was using the "open source" version
of VirtualBox (which comes with OpenSuse).

So I then installed the Oracle version of VierualBox on my laptop.  This did
work with USB (using WINdows 7 32 bit).  So I installed iTunes and reformatted
the iPod to FAT (windows disk format).

With that, gtkpod on my desktop (which is where the music is) appears to be
working.  If it fails the next step is to mount the music over samba on the
network to my laptop and use iTunes to load the music from Windows.

I guess at some point I should just check that the issue with libgpod and
Python was not FS-related (ie check that the code still fails with FAT).  I am
pretty sure that is the case, since gtkpod worked (until the kernel/FS
failed), but I should check.

For now, however, I really can't be bothered.  What a frustrating pile of crap
(even when it works, loading 100GB of music over USB2 takes hours...)

Andrew

It Gets Worse

From: andrew cooke <andrew@...>

Date: Sat, 11 Aug 2012 13:34:18 -0400

gtkpod is pretty much unusable once the iPod is full.  It is glacially slow
and sometimes hangs completely (no CPU use and a dead GUI).

Andrew

Switched to RockBox

From: andrew cooke <andrew@...>

Date: Wed, 15 Aug 2012 10:09:25 -0400

I gave up and switched to RockBox (think "installing Linux on iPod" for the
general idea).

At first it looked *awful*.  But fiddling with the settings you can get a very
minimal white-on-black character-only display, that basically looks like
you've got a command line interface.  "Now playing" shows some dynamic level
bars, but no album cover.  It actually look spretty cool in an old-school way.

And you can load files directly to the file system.  It just works.

Assuming I don't find any deal-breakers I will update the ypod code to work
with this.

Andrew

To Install Latest RockBox on iPod Classic

From: andrew cooke <andrew@...>

Date: Fri, 17 Aug 2012 09:10:56 -0400

Follow the emcore instructions at
http://www.freemyipod.org/wiki/EmCORE_Installation/iPodClassic but for the
final step unzip the "development builds" from
http://www.rockbox.org/wiki/IpodClassicPort

You can also update from the original (emcore) to development by simply
unpacking over the existing files (I was told this on IRC and just tried it
and it appears to work).

One reason to do this is that this bug may have been fixed -
http://www.rockbox.org/tracker/task/12729

Andrew

Copying to FAT32

From: andrew cooke <andrew@...>

Date: Wed, 19 Sep 2012 18:32:21 -0300

Copying files from Linux to FAT32 is non-trivial if you've named the files
according to ID3 tags.  The following command renames characters correctly:

  pax -vrwL -s '/[?<>\\:*|\"]/_/gp' source dest

Credit:
http://superuser.com/questions/178025/linux-copy-to-fat32-filesystem-invalid-argument

(with -L to copy across soft links)

Andrew

Alternate Substitution

From: andrew cooke <andrew@...>

Date: Sun, 5 May 2013 01:37:47 -0400

pax -vrwL -s '/[^A-Za-z0-9 \/\.\-]\+//gp' source dest

Is better for files with "foreign" characters.

Andrew

Comment on this post