| Andrew Cooke | Contents | Latest | RSS | Twitter | Previous | Next

C[omp]ute

Welcome to my blog, which was once a mailing list of the same name and is still generated by mail. Please reply via the "comment" links.

Always interested in offers/projects/new ideas. Eclectic experience in fields like: numerical computing; Python web; Java enterprise; functional languages; GPGPU; SQL databases; etc. Based in Santiago, Chile; telecommute worldwide. CV; email.

Personal Projects

Lepl parser for Python.

Colorless Green.

Photography around Santiago.

SVG experiment.

Professional Portfolio

Calibration of seismometers.

Data access via web services.

Cache rewrite.

Extending OpenSSH.

C-ORM: docs, API.

Last 100 entries

Some Spanish Fiction; Calling C From Fortran 95; Bjork DJ Set; Z3 Example With Python; Week 1; Useful Guide To Starting With IJulia; UK Election + Media; Review: Reinventing Organizations; Inline Assembly With Julia / LLVM; Against the definition of types; Dumb Crypto Paper; The Search For Quasi-Periodicity...; Is There An Alternative To Processing?; CARDIAC (CARDboard Illustrative Aid to Computation); The Bolivian Case Against Chile At The Hague; Clear, Cogent Economic Arguments For Immigration; A Program To Say If I Am Working; Decent Cards For Ill People; New Photo; Luksic And Barrick Gold; President Bachelet's Speech; Baltimore Primer; libxml2 Parsing Stream; configure.ac Recipe For Library Path; The Davalos Affair For Idiots; Not The Onion: Google Fireside Chat w Kissinger; Bicycle Wheels, Inertia, and Energy; Another Tax Fraud; Google's Borg; A Verion That Redirects To Local HTTP Server; Spanish Accents For Idiots; Aluminium Cans; Advice on Spray Painting; Female View of Online Chat From a Male; UX Reading List; S4 Subgroups - Geometric Interpretation; Fucking Email; The SQM Affair For Idiots; Using Kolmogorov Complexity; Oblique Strategies in bash; Curses Tools; Markov Chain Monte Carlo Without all the Bullshit; Email Para Matias Godoy Mercado; The Penta Affair For Idiots; Example Code To Create numpy Array in C; Good Article on Bias in Graphic Design (NYTimes); Do You Backup github?; Data Mining Books; SimpleDateFormat should be synchronized; British Words; Chinese Govt Intercepts External Web To DDOS github; Numbering Permutations; Teenage Engineering - Low Price Synths; GCHQ Can Do Whatever It Wants; Dublinesque; A Cryptographic SAT Solver; Security Challenges; Word Lists for Crosswords; 3D Printing and Speaker Design; Searchable Snowden Archive; XCode Backdoored; Derived Apps Have Malware (CIA); Rowhammer - Hacking Software Via Hardware (DRAM) Bugs; Immutable SQL Database (Kinda); Tor GPS Tracker; That PyCon Dongle Mess...; ASCII Fluid Dynamics; Brandalism; Table of Shifter, Cassette and Derailleur Compatability; Lenovo Demonstrates How Bad HTTPS Is; Telegraph Owned by HSBC; Smaptop - Sunrise (Music); Equation Group (NSA); UK Torture in NI; And - A Natural Extension To Regexps; This Is The Future Of Religion; The Shazam (Music Matching) Algorithm; Tributes To Lesbian Community From AIDS Survivors; Nice Rust Summary; List of Good Fiction Books; Constructing JSON From Postgres (Part 2); Constructing JSON From Postgres (Part 1); Postgres in Docker; Why Poor Places Are More Diverse; Smart Writing on Graceland; Satire in France; Free Speech in France; MTB Cornering - Where Should We Point Our Thrusters?; Secure Secure Shell; Java Generics over Primitives; 2014 (Charlie Brooker); How I am 7; Neural Nets Applied to Go; Programming, Business, Social Contracts; Distributed Systems for Fun and Profit; XML and Scheme; Internet Radio Stations (Curated List); Solid Data About Placebos; Half of Americans Think Climate Change Is a Sign of the Apocalypse; Saturday Surf Sessions With Juvenile Delinquents; Ssh, tty, stdout and stderr; Feathers falling in a vacuum

© 2006-2015 Andrew Cooke (site) / post authors (content).

Beagle, Computing in Science and Engineering

From: "andrew cooke" <andrew@...>

Date: Wed, 24 Dec 2008 11:05:23 -0300 (CLST)

While at the AGU conference I noticed this magazine (Computing in Science
and Engineering) - http://cise.aip.org/

It's not the most professional looking magazine in the world, but it is by
far the closest I've found to a magazine that covers the kind of work I
do.  So I subscribed - got a cheap price and the last 10 years on CD.

I copied the back issues from CD to my hard drive and then wondered what
to do.  They are broken down into one article per file, but they are PDF
and I had no way of searching them.

Then I remembered Beagle, which I have carefully de-installed from my
computer for several years now because it seemed (1) useless and (2) used
up so much CPU.  Beagle is the default Linux document indexing system
(think Google for your local disk).

Anyway, it's improved hugely.  It no longer locks up the computer when
you're trying to get something done.  And it appears to return moderately
useful results.  So I can now search for something like "python numerical
vector" and the second hit (when ordered by relevance) is "Python for
Scientific Computing" from the magazine.

You can also restrict to certain file types (ext:pdf), exclude terms
(-foo), etc etc.  It even indexes music metadata (so you can search for
artists) and email.

The KDE Kerry interface does quite a good job of presenting the data too -
you can click on a file and it is handed off to an appropriate handler
(although HTML is going to konquerer instead of the mozilla configured for
the desktop).

It does, however, still seem to crash quite regularly.  You can see this
by doing

  tail ~/.beagle/Log/current-Beagle

which will show a message about SIGSEGV or by typing beagle-status which
will say it cannot connect.  To restart just type "beagled" at the command
line.

I also enabled extended filesystem attributes by modifying the fstab from
/home to include the user_xattr option.  Apparently this makes things a
bit faster.

One check I did, when I found some old files I thought I had been deleted,
surprised me: it immediately picks up on deleted files and excludes them
from the results.  Which is nice.

Andrew

Tweaking Beagle and KDE

From: "andrew cooke" <andrew@...>

Date: Wed, 31 Dec 2008 12:32:28 -0300 (CLST)

While Kerry (the KDE Beagle client) looks nicer (more compact), it hangs
regularly.  The Beagle search app (beagle-search from the command line, or
just "Search" from the SuSE menu) is much more robust.

If you use Firefox, you need to make sure that:

1 - the default browser is Firefox.  Configure Desktop -> General ->
Default Applications -> Web Browser

2 - html files are associated with Firefox.  Configure Desktop -> Advanced
-> File Associations and then find text/html in the tree widget.

To make sure that everything is indexed at the start, follow the
instructions at http://beagle-project.org/FAQ

 $ beagle-shutdown
 $ export BEAGLE_EXERCISE_THE_DOG=1
 $ beagled

Also enable user attributes on your file system by modifying /etc/fstab as
described at http://beagle-project.org/Enabling_Extended_Attributes

To check what is happening, use beagle-status, but don't be worried if
there are a lot of directories to scan on subsequent logins.  Each login,
beagle slowly re-scans everything.

To check whether a particular file is indexed, use
  beagle-query uri:file:///path/to/file
and see fi anything is returned.


I still haven't worked out how to get email indexed.  I use imap, and have
the files downloaded locally, but I don't use kmail or evolution and the
files are generally in directories whose names begin with a "dot".  I
think you can fake things by configuring kmail or evolution (in addition
to the email client you actually use), but this still doesn't track any
changes.  The file backend will handle emails, but doesn't look in "dot"
files.  Apparently symlinks don't fool it either...

Andrew

Comment on this post