Andrew Cooke | Contents | Latest | RSS | Previous | Next

C[omp]ute

Welcome to my blog, which was once a mailing list of the same name and is still generated by mail. Please reply via the "comment" links.

Always interested in offers/projects/new ideas. Eclectic experience in fields like: numerical computing; Python web; Java enterprise; functional languages; GPGPU; SQL databases; etc. Based in Santiago, Chile; telecommute worldwide. CV; email.

Personal Projects

Choochoo Training Diary

Last 100 entries

Surprise Paradox; [Books] Good Author List; [Computing] Efficient queries with grouping in Postgres; [Computing] Automatic Wake (Linux); [Computing] AWS CDK Aspects in Go; [Bike] Adidas Gravel Shoes; [Computing, Horror] Biological Chips; [Books] Weird Lit Recs; [Covid] Extended SIR Models; [Art] York-based Printmaker; [Physics] Quantum Transitions are not Instantaneous; [Computing] AI and Drum Machines; [Computing] Probabilities, Stopping Times, Martingales; bpftrace Intro Article; [Computing] Starlab Systems - Linux Laptops; [Computing] Extended Berkeley Packet Filter; [Green] Mainspring Linear Generator; Better Approach; Rummikub Solver; Chilean Poetry; Felicitations - Empowerment Grant; [Bike] Fixing Spyre Brakes (That Need Constant Adjustment); [Computing, Music] Raspberry Pi Media (Audio) Streamer; [Computing] Amazing Hack To Embed DSL In Python; [Bike] Ruta Del Condor (El Alfalfal); [Bike] Estimating Power On Climbs; [Computing] Applying Azure B2C Authentication To Function Apps; [Bike] Gearing On The Back Of An Envelope; [Computing] Okular and Postscript in OpenSuse; There's a fix!; [Computing] Fail2Ban on OpenSuse Leap 15.3 (NFTables); [Cycling, Computing] Power Calculation and Brakes; [Hardware, Computing] Amazing Pockit Computer; Bullying; How I Am - 3 Years Post Accident, 8+ Years With MS; [USA Politics] In America's Uncivil War Republicans Are The Aggressors; [Programming] Selenium and Python; Better Walking Data; [Bike] How Fast Before Walking More Efficient Than Cycling?; [COVID] Coronavirus And Cycling; [Programming] Docker on OpenSuse; Cadence v Speed; [Bike] Gearing For Real Cyclists; [Programming] React plotting - visx; [Programming] React Leaflet; AliExpress Independent Sellers; Applebaum - Twilight of Democracy; [Politics] Back + US Elections; [Programming,Exercise] Simple Timer Script; [News] 2019: The year revolt went global; [Politics] The world's most-surveilled cities; [Bike] Hope Freehub; [Restaurant] Mama Chau's (Chinese, Providencia); [Politics] Brexit Podcast; [Diary] Pneumonia; [Politics] Britain's Reichstag Fire moment; install cairo; [Programming] GCC Sanitizer Flags; [GPU, Programming] Per-Thread Program Counters; My Bike Accident - Looking Back One Year; [Python] Geographic heights are incredibly easy!; [Cooking] Cookie Recipe; Efficient, Simple, Directed Maximisation of Noisy Function; And for argparse; Bash Completion in Python; [Computing] Configuring Github Jekyll Locally; [Maths, Link] The Napkin Project; You can Masquerade in Firewalld; [Bike] Servicing Budget (Spring) Forks; [Crypto] CIA Internet Comms Failure; [Python] Cute Rate Limiting API; [Causality] Judea Pearl Lecture; [Security, Computing] Chinese Hardware Hack Of Supermicro Boards; SQLAlchemy Joined Table Inheritance and Delete Cascade; [Translation] The Club; [Computing] Super Potato Bruh; [Computing] Extending Jupyter; Further HRM Details; [Computing, Bike] Activities in ch2; [Books, Link] Modern Japanese Lit; What ended up there; [Link, Book] Logic Book; Update - Garmin Express / Connect; Garmin Forerunner 35 v 230; [Link, Politics, Internet] Government Trolls; [Link, Politics] Why identity politics benefits the right more than the left; SSH Forwarding; A Specification For Repeating Events; A Fight for the Soul of Science; [Science, Book, Link] Lost In Math; OpenSuse Leap 15 Network Fixes; Update; [Book] Galileo's Middle Finger; [Bike] Chinese Carbon Rims; [Bike] Servicing Shimano XT Front Hub HB-M8010; [Bike] Aliexpress Cycling Tops; [Computing] Change to ssh handling of multiple identities?; [Bike] Endura Hummvee Lite II; [Computing] Marble Based Logic; [Link, Politics] Sanity Check For Nuclear Launch; [Link, Science] Entropy and Life

© 2006-2017 Andrew Cooke (site) / post authors (content).

Leaving GMail...

From: andrew cooke <andrew@...>

Date: Sun, 7 Mar 2010 15:42:24 -0300

I am increasingly concerned about Google constructing a detailed model
of "me".  While I have nothing against them as a company, I am not
that keen on anyone compiling a large pool of information about me -
particularly one over which I have little control.

A month or so ago, I tried switching to Bing for searches.
Unfortunately, Bing is significantly worse than Google and good
quality search results are critical (I am a software engineer with a
poor memory - search solves almost every problem I have).  So
switching search away from Google search failed.

The next alternative, then, was to change webmail providers.  After
checking out the summary on Wikipedia, I decided that Runbox was best.
 But when I opened a free, trial account I wasn't convinced (it's
quite solid, but I had some worries: the folder display would not
automatically update to reflect incoming messages; it wasn't clear how
to apply filtering to existing (as opposed to newly arriving) emails;
no tags).

After that, I started considering how to create a solution myself.  I
ran Squirrelmail locally for many years, and I now have a server that
could host it (in fact, my server provider also has webmail) - but
Runbox was better than that.  And admin work isn't appealing.

So I paused for a think.  A think about GMail's tagging of messages,
and how you could do something similar with maildir and soft links on
Unix.  That lead to some searching (via Google...), which led to
mairix.  Mairix is an old-school command line program that lets you
dynamically construct maildirs (folders of email) according to a
search.  And it's fast (it pre-constructs an index).

Some background on hardware:  Currently at home the only computer in
the house that's on 24 hours a day is a little, low-power box that
serves music, works as a firewall, etc (it has a Via C7-D chip - think
early netbook).  It contains all my email in a bunch of directories,
sorted by date (these are pulled from GMail every 3 minutes) - 600,000
emails going back years.  I can connect to this box from anywhere over
ssh (I use a dynamic name service to locate it).

So I started wondering about dropping webmail and going with mutt in a
terminal window.  I could use mairix to generate folders like GMail's
tags, and also to do searches...

...and the good news is that mairix compiles and appears to work just
fine.  Even on the under-powered box, with over 1/2 a million mail
messages, it's instant.  With a little scripting I can create a bunch
of directories that are equivalent to my GMail tags, and I can also
search by hand.

Mairix (from git) installed and bit with no problems.  And indexed
everything in about 10 minutes.  I've been a little frustrated with
GMail's search recently; my first impression of mairix is more
positive - it really works!  The main remaining worry is how to handle
attachments - with webmail that's trivial; it's not so much fun via a
remote tty.

Anyway, that's the latest news.  I'll report back once I have some
serious experience.

Mairix - http://www.rpcurnow.force9.co.uk/mairix/

Andrew

Mutt Working Well

From: andrew cooke <andrew@...>

Date: Tue, 9 Mar 2010 02:12:27 -0300

This is working out well so far.  The hardest part was getting mail delivery
working with my server host - MTA's send to MX addresses, but their SMTP relay
needed to be addressed directy (the solution is to use [] in postfix's
config!).

Anyway, I thought I'd describe how I'm using Mutt so that it duplicates the
things I liked about GMail.

When mail arrives it is stored by month.  My default folder is the current
month, which is similar to "inbox".  Apart from spam (which is filtered with
spamassasin), everything is stored in this way.  Messages are threaded and
sorted by date, which gives results similar to the way GMail groups related
messages.

In addition, I have some additional folders that are created by mairix.
Mairix runs in the background every 20 minutes to update its index, and every
time mail is delivered to update the extra folders.

There are two folders.  One contains work-related items for the last month -
this is created by searching for the host names of clients.  The other
contains friends and family for the last month, created by searching for email
addresses.  I can jump to both of these folders with a keypress.  These are
the equivalent of GMail's tags.

In the work folder, my "from" address is automatically changed to reflect my
work email.  In other folders it reverts back to andrew@...  GMail has
no equivalent for this.

If I need anything else, I can invoke mairix from within mutt, and the results
appear in a third folder.  This is the equivalent of GMail's search (except it
appears to be better - I found GMail search strangely unreliable, but I could
never pin down exactly why).

Now we'll see if posting here still works...

Andrew

Spam Filtering Details

From: andrew cooke <andrew@...>

Date: Fri, 12 Mar 2010 11:13:30 -0300

See this post for more on filtering spam -
http://www.acooke.org/cute/EfficientS0.html

Andrew

Comment on this post