| Andrew Cooke | Contents | Latest | RSS | Twitter | Previous | Next

C[omp]ute

Welcome to my blog, which was once a mailing list of the same name and is still generated by mail. Please reply via the "comment" links.

Always interested in offers/projects/new ideas. Eclectic experience in fields like: numerical computing; Python web; Java enterprise; functional languages; GPGPU; SQL databases; etc. Based in Santiago, Chile; telecommute worldwide. CV; email.

Personal Projects

Lepl parser for Python.

Colorless Green.

Photography around Santiago.

SVG experiment.

Professional Portfolio

Calibration of seismometers.

Data access via web services.

Cache rewrite.

Extending OpenSSH.

Last 100 entries

Flexible Muscle-Based Locomotion for Bipedal Creatures; SQL Performance Explained; The Little Manual of API Design; Multiple Word Sizes; CRC - Next Steps; FizzBuzz; Update on CRCs; Decent Links / Discussion Community; Automated Reasoning About LLVM Optimizations and Undefined Behavior; A Painless Guide To CRC Error Detection Algorithms; Tests in Julia; Dave Eggers: what's so funny about peace, love and Starship?; Cello - High Level C Programming; autoreconf needs tar; Will Self Goes To Heathrow; Top 5 BioInformatics Papers; Vasovagal Response; Good Food in Vina; Chilean Drug Criminals Use Subsitution Cipher; Adrenaline; Stiglitz on the Impact of Technology; Why Not; How I Am 5; Lenovo X240 OpenSuse 13.1; NSA and GCHQ - Psychological Trolls; Finite Fields in Julia (Defining Your Own Number Type); Julian Assange; Starting Qemu on OpenSuse; Noisy GAs/TMs; Venezuela; Reinstalling GRUB with EFI; Instructions For Disabling KDE Indexing; Evolving Speakers; Changing Salt Size in Simple Crypt 3.0.0; Logarithmic Map (Moved); More Info; Words Found in Voynich Manuscript; An Inventory Of 3D Space-Filling Curves; Foxes Using Magnetic Fields To Hunt; 5 Rounds RC5 No Rotation; JP Morgan and Madoff; Ori - Secure, Distributed File System; Physical Unclonable Functions (PUFs); Prejudice on Reddit; Recursion OK; Optimizing Julia Code; Cash Handouts in Brazil; Couple Nice Music Videos; It Also Works!; Adaptive Plaintext; It Works!; RC5 Without Rotation (2); 8 Years...; Attack Against Encrypted Linux Disks; Pushing Back On NSA At IETF; Summary of Experimental Ethics; Very Good Talk On Security, Snowden; Locusts are Grasshoppers!; Vagrant (OpenSuse and IDEs); Interesting Take On Mandela's Context; Haskell Cabal O(n^2) / O(n) Fix; How I Am 4; Chilean Charity Supporting Women; Doing SSH right; Festival of Urban Intervention; Neat Idea - Wormholes Provide Entanglement; And a Link....; Simple Encryption for Python 2.7; OpenSuse 13.1 Is Better!; Little Gain...; More Details on Technofull Damage; Palmrest Cracked Too....; Tecnofull (Lenovo Support) Is Fucking Useless; The Neuroscientist Who Discovered He Was a Psychopath; Interpolating Polynomials; Bottlehead Crack as Pre-amp; Ooops K702!; Bottlehead Crack, AKG K701; Breaking RC5 Without Rotation; Great post thank you; Big Balls of Mud; Phabricator - Tools for working together; Amazing Julia RC5 Code Parameterized By Word Size; Chi-Square Can Be Two-Sided; Why Do Brits Accept Surveillance?; Statistics Done Wrong; Mesas Trape from Bravo; European Report on Crypto Primitives and Protocols; Interesting Omissions; Oryx And Crake (Margaret Atwood); Music and Theory; My Arduino Programs; Elliptic Curve Crypto; Re: Licensing Interpreted Code; Licensing Interpreted Code; ASUS 1015E-DS03 OpenSuse 12.3 SSD; translating lettuce feature files into stub steps files; Re: translating lettuce feature files into stub steps files; A Tale of Two Psychiatrists; The Real Reason the Poor Go Without Bank Accounts; The Rational Choices of Crack Addicts

© 2006-2013 Andrew Cooke (site) / post authors (content).

Those that can't, teach (Java) (or: combinators in Java)

From: "andrew cooke" <andrew@...>

Date: Fri, 22 Dec 2006 19:31:24 -0300 (CLST)

I should add at the start of this that I find Lisp way cool, especially
the macros (although I would prefer a (static) typed system).

However, comments like this -
http://www.lambdassociates.org/studies/study06.htm - really bug me.  They
give me the strong impression that the author has only ever learnt to
program well - or has only seen good programmers working - in one
particular language.  And so they conclude that the language, whatever it
happened to be, is somehow special.  From there it's just a couple of
small steps - some random piece of folk psychology, the always reliable
appeal to the audience's sense of being better than their peers - to a
'cult' article.

In my experience, life's not like that.  I've seen good programmers
working in C.  And I've written bad programs in Lisp.

Here's an example from my work.  It's Java code, which means it should be
sucky sucky stupid boring, but, personally, I think it's pretty neat. 
It's moderately declarative, and makes what was a rather tricky problem
(not "hard", but fiddly) easy.

private ContentFilter getHandler(SqlLoader loader) {

 // these store values; they are read/reset by ProposalHandler
 Text firstName = new Text();
 Text lastName = new Text();
 Text email = new Text();
 Text affiliation = new Text();
 Period period = new Period();

 Test periodTest = new Test() {
  public boolean test(String uri, String lName, String qName, Attributes
atts) {
   return null != qName && qName.equals("parameter") &&
   null != atts && "proprietaryPeriod".equals(atts.getValue("noao:type"));
  }
 };

 // this is reset by ProposalHandler for each new proposal
 First firstInvestigator =
  new First(
    new Parallel(
      new QName(Match.ALL, "first", firstName)
    ).and(
      new QName(Match.ALL, "last", lastName)
    ).and(
      new QName(Match.ALL, "email", email)
    ).and(
      new QName(Match.ALL, "affiliation", affiliation)
    )
  );

 return new QName(Match.ALL, Forward.ALL, "proposal",
   new ProposalHandler(salt, loader, firstInvestigator, period,
     firstName, lastName, email, affiliation,
     new Parallel(
       new QName(Match.ALL, Forward.ALL, "investigator",
                 firstInvestigator)
     ).and(
       new Element(Match.ALL, Forward.ALL, periodTest, period)
     )
   )
 );
}

If you know some XML, and some Java, and some Haskell, you may have
guessed that this code is using something rather like a combinator library
for processing XML.

Before I explain the code in more detail, I'll give some background.  We
needed to populate a database from some information in an XML file. 
There's no real constraint on how large the file may be.  It's
hand-rolled, unvalidated XML, with no DTD or Schema, contains way more
data than we need, and is very over-constrained (you can may decisions
locally within the file on what a particular element is).

The XML file is structured so that information for each "proposal" is in a
distinct subtree; I already had a set of classes that loaded data for a
proposal into the SQL database.  The problem, then, becomes one of (a)
selecting values from appropriate XML elements/attributes, and (b) calling
SQL loader for each proposal.

I chose to solve this using SAX - a library that converts an XML file to a
sequence of events - effectively an in-order traversal of the DOM tree,
but handled sequentially so that the whole XML document does not have to
be in memory at once.

This suggested that a library that allows the user to define filters that
select particular sub-trees within the XML document.  These filters could
then be nested to isolate particular paths in the document, without having
to specify the full path - only the relative position with the tree need
be used.  This approach is resilient to changes/errors in the
(unvalidated) document format, and allows test data to be written in a
more compact form.

To take a concrete example, the fragment of code...

  new First(
    new Parallel(
      new QName(Match.ALL, "first", firstName)
    ).and(
      new QName(Match.ALL, "last", lastName)
    [...]

...selects nodes relative to some parent node such that (i) only the first
(First) child node of the parent is considered and (ii) under that first
child node, at any depth (Match.ALL) an element with the name "first" or
(Parallel) the name "last" would trigger the appropriate action (firstName
is a Text instance and stores the text value of the element).

Clearly this is stateful.  ProposalHandler subclasses the library class
OnEntryExit and has methods that clear state on entry and load values to
the database on exit.  The ProposalHandler instance is embedded in a
filter that tests for the "proposal" element.

This is not the world's greates code, I admit.  But for a project with
busy programmers and tight deadlines, I think it's pretty neat: the
description of how the XML data are accessed is collected in a single
method, with no duplicated literal values, in a form that shows the logic
used.

Of course the code above is strongly influenced by combinator libraries. 
But the implementation is idiomatic Java - classes, not higher order
functions, are used.  The point being: an educated programmer can do the
job well in any language.  Ideas for how to approach a problem can be
separated from the language used for an initial implementation; they can
be implemented elsewhere if you are fluent in the target language.

Which explains my title: my suspicion is that people who write screeds
about how wonderful a certain language is are fluent only in that one
language.  In particular, there seem to be a lot of whiny academics
complaining (LtU) about Java rather than putting in the hours to become
adept at using it.  It's just a tool.

Andrew

Comment on this post