| Andrew Cooke | Contents | Latest | RSS | Twitter | Previous | Next

C[omp]ute

Welcome to my blog, which was once a mailing list of the same name and is still generated by mail. Please reply via the "comment" links.

Always interested in offers/projects/new ideas. Eclectic experience in fields like: numerical computing; Python web; Java enterprise; functional languages; GPGPU; SQL databases; etc. Based in Santiago, Chile; telecommute worldwide. CV; email.

Personal Projects

Lepl parser for Python.

Colorless Green.

Photography around Santiago.

SVG experiment.

Professional Portfolio

Calibration of seismometers.

Data access via web services.

Cache rewrite.

Extending OpenSSH.

C-ORM: docs, API.

Last 100 entries

Your diamond is a beaten up mess; Maths Books; Good Bike Route from Providencia / Las Condes to Panul\; Iain Pears (Author of Complex Plots); Plum Jam; Excellent; More Recently; For a moment I forgot StackOverflow sucked; A Few Weeks On...; Chilean Book Recommendations; How To Write Shared Libraries; Jenny Erpenbeck (Author); Dijkstra, Coins, Tables; Python libraries error on OpenSuse; Deserving Trump; And Smugness; McCloskey Economics Trilogy; cmocka - Mocks for C; Concept Creep (Americans); Futhark - OpenCL Language; Moved / Gone; Fan and USB issues; Burgers in Santiago; The Origin of Icosahedral Symmetry in Viruses; autoenum on PyPI; Jars Explains; Tomato Chutney v3; REST; US Elections and Gender: 24 Point Swing; PPPoE on OpenSuse Leap 42.1; SuperMicro X10SDV-TLN4F/F with Opensuse Leap 42.1; Big Data AI Could Be Very Bad Indeed....; Cornering; Postcapitalism (Paul Mason); Black Science Fiction; Git is not a CDN; Mining of Massive Data Sets; Rachel Kaadzi Ghansah; How great republics meet their end; Raspberry, Strawberry and Banana Jam; Interesting Dead Areas of Math; Later Taste; For Sale; Death By Bean; It's Good!; Tomato Chutney v2; Time ATAC MX 2 Pedals - First Impressions; Online Chilean Crafts; Intellectual Variety; Taste + Texture; Time Invariance and Gauge Symmetry; Jodorowsky; Tomato Chutney; Analysis of Support for Trump; Indian SF; TP-Link TL-WR841N DNS TCP Bug; TP-Link TL-WR841N as Wireless Bridge; Sending Email On Time; Maybe run a command; Sterile Neutrinos; Strawberry and Banana Jam; The Best Of All Possible Worlds; Kenzaburo Oe: The Changeling; Peach Jam; Taste Test; Strawberry and Raspberry Jam; flac to mp3 on OpenSuse 42.1; Also, Sebald; Kenzaburo Oe Interview; Otake (Kitani Minoru) move Black 121; Is free speech in British universities under threat?; I am actually good at computers; Was This Mansplaining?; WebFaction / LetsEncrypt / General Disappointment; Sensible Philosophy of Science; George Ellis; Misplaced Intuition and Online Communities; More Reading About Japan; Visibilty / Public Comments / Domestic Violence; Ferias de Santiago; More (Clearly Deliberate); Deleted Obit Post; And then a 50 yo male posts this...; We Have Both Kinds Of Contributors; Free Springer Books; Books on Religion; Books on Linguistics; Palestinan Electronica; Books In Anthropology; Taylor Expansions of Spacetime; Info on Juniper; Efficient Stream Processing; The Moral Character of Crypto; Hearing Aid Info; Small Success With Go!; Re: Quick message - This link is broken; Adding Reverb To The Echo Chamber; Sox Audio Tools; Would This Have Been OK?; Honesty only important economically before institutions develop; Stegangraphy via PS4

© 2006-2015 Andrew Cooke (site) / post authors (content).

Beagle, Computing in Science and Engineering

From: "andrew cooke" <andrew@...>

Date: Wed, 24 Dec 2008 11:05:23 -0300 (CLST)

While at the AGU conference I noticed this magazine (Computing in Science
and Engineering) - http://cise.aip.org/

It's not the most professional looking magazine in the world, but it is by
far the closest I've found to a magazine that covers the kind of work I
do.  So I subscribed - got a cheap price and the last 10 years on CD.

I copied the back issues from CD to my hard drive and then wondered what
to do.  They are broken down into one article per file, but they are PDF
and I had no way of searching them.

Then I remembered Beagle, which I have carefully de-installed from my
computer for several years now because it seemed (1) useless and (2) used
up so much CPU.  Beagle is the default Linux document indexing system
(think Google for your local disk).

Anyway, it's improved hugely.  It no longer locks up the computer when
you're trying to get something done.  And it appears to return moderately
useful results.  So I can now search for something like "python numerical
vector" and the second hit (when ordered by relevance) is "Python for
Scientific Computing" from the magazine.

You can also restrict to certain file types (ext:pdf), exclude terms
(-foo), etc etc.  It even indexes music metadata (so you can search for
artists) and email.

The KDE Kerry interface does quite a good job of presenting the data too -
you can click on a file and it is handed off to an appropriate handler
(although HTML is going to konquerer instead of the mozilla configured for
the desktop).

It does, however, still seem to crash quite regularly.  You can see this
by doing

  tail ~/.beagle/Log/current-Beagle

which will show a message about SIGSEGV or by typing beagle-status which
will say it cannot connect.  To restart just type "beagled" at the command
line.

I also enabled extended filesystem attributes by modifying the fstab from
/home to include the user_xattr option.  Apparently this makes things a
bit faster.

One check I did, when I found some old files I thought I had been deleted,
surprised me: it immediately picks up on deleted files and excludes them
from the results.  Which is nice.

Andrew

Tweaking Beagle and KDE

From: "andrew cooke" <andrew@...>

Date: Wed, 31 Dec 2008 12:32:28 -0300 (CLST)

While Kerry (the KDE Beagle client) looks nicer (more compact), it hangs
regularly.  The Beagle search app (beagle-search from the command line, or
just "Search" from the SuSE menu) is much more robust.

If you use Firefox, you need to make sure that:

1 - the default browser is Firefox.  Configure Desktop -> General ->
Default Applications -> Web Browser

2 - html files are associated with Firefox.  Configure Desktop -> Advanced
-> File Associations and then find text/html in the tree widget.

To make sure that everything is indexed at the start, follow the
instructions at http://beagle-project.org/FAQ

 $ beagle-shutdown
 $ export BEAGLE_EXERCISE_THE_DOG=1
 $ beagled

Also enable user attributes on your file system by modifying /etc/fstab as
described at http://beagle-project.org/Enabling_Extended_Attributes

To check what is happening, use beagle-status, but don't be worried if
there are a lot of directories to scan on subsequent logins.  Each login,
beagle slowly re-scans everything.

To check whether a particular file is indexed, use
  beagle-query uri:file:///path/to/file
and see fi anything is returned.


I still haven't worked out how to get email indexed.  I use imap, and have
the files downloaded locally, but I don't use kmail or evolution and the
files are generally in directories whose names begin with a "dot".  I
think you can fake things by configuring kmail or evolution (in addition
to the email client you actually use), but this still doesn't track any
changes.  The file backend will handle emails, but doesn't look in "dot"
files.  Apparently symlinks don't fool it either...

Andrew

Comment on this post