C[omp]ute

Welcome to my blog, which was once a mailing list of the same name and is still generated by mail. Please reply via the "comment" links.

Always interested in offers/projects/new ideas. Eclectic experience in fields like: numerical computing; Python web; Java enterprise; functional languages; GPGPU; SQL databases; etc. Based in Santiago, Chile; telecommute worldwide. CV; email.

Personal Projects

Choochoo Training Diary

Last 100 entries

Surprise Paradox; [Books] Good Author List; [Computing] Efficient queries with grouping in Postgres; [Computing] Automatic Wake (Linux); [Computing] AWS CDK Aspects in Go; [Bike] Adidas Gravel Shoes; [Computing, Horror] Biological Chips; [Books] Weird Lit Recs; [Covid] Extended SIR Models; [Art] York-based Printmaker; [Physics] Quantum Transitions are not Instantaneous; [Computing] AI and Drum Machines; [Computing] Probabilities, Stopping Times, Martingales; bpftrace Intro Article; [Computing] Starlab Systems - Linux Laptops; [Computing] Extended Berkeley Packet Filter; [Green] Mainspring Linear Generator; Better Approach; Rummikub Solver; Chilean Poetry; Felicitations - Empowerment Grant; [Bike] Fixing Spyre Brakes (That Need Constant Adjustment); [Computing, Music] Raspberry Pi Media (Audio) Streamer; [Computing] Amazing Hack To Embed DSL In Python; [Bike] Ruta Del Condor (El Alfalfal); [Bike] Estimating Power On Climbs; [Computing] Applying Azure B2C Authentication To Function Apps; [Bike] Gearing On The Back Of An Envelope; [Computing] Okular and Postscript in OpenSuse; There's a fix!; [Computing] Fail2Ban on OpenSuse Leap 15.3 (NFTables); [Cycling, Computing] Power Calculation and Brakes; [Hardware, Computing] Amazing Pockit Computer; Bullying; How I Am - 3 Years Post Accident, 8+ Years With MS; [USA Politics] In America's Uncivil War Republicans Are The Aggressors; [Programming] Selenium and Python; Better Walking Data; [Bike] How Fast Before Walking More Efficient Than Cycling?; [COVID] Coronavirus And Cycling; [Programming] Docker on OpenSuse; Cadence v Speed; [Bike] Gearing For Real Cyclists; [Programming] React plotting - visx; [Programming] React Leaflet; AliExpress Independent Sellers; Applebaum - Twilight of Democracy; [Politics] Back + US Elections; [Programming,Exercise] Simple Timer Script; [News] 2019: The year revolt went global; [Politics] The world's most-surveilled cities; [Bike] Hope Freehub; [Restaurant] Mama Chau's (Chinese, Providencia); [Politics] Brexit Podcast; [Diary] Pneumonia; [Politics] Britain's Reichstag Fire moment; install cairo; [Programming] GCC Sanitizer Flags; [GPU, Programming] Per-Thread Program Counters; My Bike Accident - Looking Back One Year; [Python] Geographic heights are incredibly easy!; [Cooking] Cookie Recipe; Efficient, Simple, Directed Maximisation of Noisy Function; And for argparse; Bash Completion in Python; [Computing] Configuring Github Jekyll Locally; [Maths, Link] The Napkin Project; You can Masquerade in Firewalld; [Bike] Servicing Budget (Spring) Forks; [Crypto] CIA Internet Comms Failure; [Python] Cute Rate Limiting API; [Causality] Judea Pearl Lecture; [Security, Computing] Chinese Hardware Hack Of Supermicro Boards; SQLAlchemy Joined Table Inheritance and Delete Cascade; [Translation] The Club; [Computing] Super Potato Bruh; [Computing] Extending Jupyter; Further HRM Details; [Computing, Bike] Activities in ch2; [Books, Link] Modern Japanese Lit; What ended up there; [Link, Book] Logic Book; Update - Garmin Express / Connect; Garmin Forerunner 35 v 230; [Link, Politics, Internet] Government Trolls; [Link, Politics] Why identity politics benefits the right more than the left; SSH Forwarding; A Specification For Repeating Events; A Fight for the Soul of Science; [Science, Book, Link] Lost In Math; OpenSuse Leap 15 Network Fixes; Update; [Book] Galileo's Middle Finger; [Bike] Chinese Carbon Rims; [Bike] Servicing Shimano XT Front Hub HB-M8010; [Bike] Aliexpress Cycling Tops; [Computing] Change to ssh handling of multiple identities?; [Bike] Endura Hummvee Lite II; [Computing] Marble Based Logic; [Link, Politics] Sanity Check For Nuclear Launch; [Link, Science] Entropy and Life

Image Processing with CUDA / Python (Dynamic Pipelines)

From: "andrew cooke" <andrew@...>

Date: Sun, 3 Aug 2008 13:20:21 -0400 (CLT)

I've been thinking about how best to apply CUDA to image processing
(particularly in astronomy, which is what I know).

Many image processing tasks are *very* suitable for parallelisation, since
the processing is "per-pixel" across several arrays (for example,
subtracting oen image from another).

So my idea is to write a parser (in Python) that accepts an expression in
a "language" that describes image processing and compiles that (literally)
to a CUDA process.

The motivation for this approach is to reduce the memory transfer overhead
compared to the alternative: a library of primitive operations.  If add,
multiple, etc are each separate primitives then data must be loaded for
each.  But in many cases it should be possible to combine these so that
all data are loaded just once, and the "per pixel" operation does several
steps.  Thie lowers the data transfer cost while at the same time grouping
the arithmetic processing into a single "chunk" (useful because it can run
while other data are loading).

It may not be clear that there is sufficient complexity, but my idea is to
support "error" and "uality" data too.

Andrew

Re: CUDA and astronomical image processing

From: andrew cooke <andrew@...>

Date: Sun, 8 Jul 2012 08:35:38 -0400

Hi,

I need to update my blog - it doesn't handle multipart mime messages like 
yours (which is why it wasn't displayed).

Anyway, no - I never got any further.  One reason was that I thought Theano
http://deeplearning.net/software/theano/ did a lot of what I was planning.  So
if you're looking for something like I described, you might want to consider
that.

Cheers,
Andrew

On Sun, Jul 08, 2012 at 11:47:42AM +0930, Andrew Cool wrote:
> Hi Andrew,
> 
> It's now 2012. Did you get anywhere with your CUDA processing?
> 
> Regards,
> 
> Andrew Cool
> 
> www.skippysky.com.au

CUDA and astronomical image processing

From: "Andrew Cool" <andrew@...>

Date: Sun, 8 Jul 2012 11:47:42 +0930

Hi Andrew,

It's now 2012. Did you get anywhere with your CUDA processing?

Regards,

Andrew Cool

www.skippysky.com.au

 

From: "andrew cooke" <andrew@...> 

Date: Sun, 3 Aug 2008 13:20:21 -0400 (CLT) 

I've been thinking about how best to apply CUDA to image processing

(particularly in astronomy, which is what I know).

 

Many image processing tasks are *very* suitable for parallelisation, since

the processing is "per-pixel" across several arrays (for example,

subtracting oen image from another).

 

So my idea is to write a parser (in Python) that accepts an expression in

a "language" that describes image processing and compiles that (literally)

to a CUDA process.

 

The motivation for this approach is to reduce the memory transfer overhead

compared to the alternative: a library of primitive operations.  If add,

multiple, etc are each separate primitives then data must be loaded for

each.  But in many cases it should be possible to combine these so that

all data are loaded just once, and the "per pixel" operation does several

steps.  Thie lowers the data transfer cost while at the same time grouping

the arithmetic processing into a single "chunk" (useful because it can run

while other data are loading).

 

It may not be clear that there is sufficient complexity, but my idea is to

support "error" and "uality" data too.

 

Andrew

 

 

All of us could take a lesson from the weather........ It pays no attention
to Criticism.

Comment on this post