C[omp]ute

Welcome to my blog, which was once a mailing list of the same name and is still generated by mail. Please reply via the "comment" links.

Always interested in offers/projects/new ideas. Eclectic experience in fields like: numerical computing; Python web; Java enterprise; functional languages; GPGPU; SQL databases; etc. Based in Santiago, Chile; telecommute worldwide. CV; email.

Personal Projects

Lepl parser for Python.

Colorless Green.

Photography around Santiago.

SVG experiment.

Professional Portfolio

Calibration of seismometers.

Data access via web services.

Cache rewrite.

Extending OpenSSH.

Last 100 entries

NYT Has More Details; Obvious Question; Advertising Low Cost Routes?; Similar Analysis Here; My Current Take On Surveillance Scandal; Last.fm is Hiring; How I Am 2; The back-wards compatibility fallacy; Wiggle The Mouse To Pass The Test; Python Enums on Crack, Part II; Multiple Monitors with Linux; What Is Happening In Turkey; A Simpler Enum; John Fogerty on IAmA; And You May Well Ask...; Progress on a Better Enum; I'm a MACHIIIIIIIIIIIIIIINE; Those little tab things on the side of jet engines; Re: Python's sad, unimaginative Enum; Some explanation; Printing binary trees sideways; About "Python's sad, unimaginative Enum"; Atoms in python; Some good feedback here; Frustration Understood; I agree with you #nt; What would be imaginative?; Re: Enum; this is fucking useless; Enum; Python's sad, unimaginative Enum; Possible Fix; Work, Exhaustion, Vacation; VirtualBox with Centos 6.3 to 6.4, client; Matasano - Programming Lessons Learned; PDF to HTML; Alternate Substitution; Why RSA Works; Trigger; Dreaming of Death; Example: Tracing; Using Coroutines In Protocol Simulations; Python 3.3 Only; Pure Python SHA1 and MD4 Implementations; Ubuntu on VirtualBox; Starting TOR as a service on OpenSuse 12.3; 1001 Albums; Using fail2ban on OpenSuse 12.3; PPPoE on OpenSuse 12.3; Good Article on Unified Physics; It's Police (Carabineros); Linux Software for Listening to and Exploring Music; Android is Pretty Bad; Lucky Number; 3D Printing for Casting; Cover Art for MPDroid; Who'd a thought the French were so bigoted?; PS Input Signal; Small Problem with Roksan K2 Amp; Roksan K2 Amp + ATC SCM7 Speakers; Do What Makes Sense; Re: Arguing About Tests, Still; Arguing About Tests, Still; Images; Good Article on NY Drummers; Related Bug Report; Getting Python 3.3 and Virtualenv Working in OpenSuse 12.3; How I Am; Awesome video about digital audio; The Difference Between Dimensional and Normalized Databases; The rise of the new Chinese bogeyman; Updated Syntax; Very First Steps to C-ORM; The Ideal User Interface For Music Exploration; Can The Republicans Be Saved?; Rate Limiting Calls to EchoNest; Mods to Cache; Comparing UYKFG and UYKFD/E/F; Someone Else is Concerned; EchoNest-based Playlist Generator for MPD; Example Voting Results; A Heavyweight Python Cache; Identifying Artists with EchoNest; Notes on Pregalex / Pregabalina / Lyrica; The Neil Cowley Trio; Drake - Make for Data; A Reliable Python Web Service; Useful Python Date/Time Library?; Need to Sleep, But this is Good; Command Line Set Difference; Little Details...; Linux Command Line Tricks; AutoTools Tutorial; Hangman Tactics; A Tor Proxy Embedded In A Web Page; Tree (Nested Dicts) in Python; Sleeping at Parties; I Know Someone Who Hurts Other People; Light and Tea; Description of the LCS35 Time Capsule Crypto-Puzzle; Re: I can relate to that ...

Traffic Shaping by VTR

From: "andrew cooke" <andrew@...>

Date: Wed, 16 Jul 2008 19:48:10 -0400 (CLT)

I am trying to upload the patched NVidia CUDA SDK, but my connection is
running so slowly it may take all night.

There's information on VTR (my ISP) here - http://www.neutralidadsi.org

Here are some details, taken from an email I just sent to the (helpful)
guy that runs acooke.org:

----------

hi,

sorry to bother you, but wonder if you had any idea what might be
happening.  i am trying to upload a file to acooke.org and it is extremely
slow (around 10MB an hour).  it's been this way all day and i have noticed
a similar problem with other files the last few days.

looking at the "meter" in sftp there are bursts of normal (ie fast)
downloading, and then the transmissions "stalls".  looking at the tcp
packets, the connection seems to simply disappear - a burst of fast
packets go through, then the system freezes, then after what i assume is a
timeout period (a minute or two - it varies) there's a retransmission,
sometimes some duplicate acks and more retransmissions, and then things
pick up again.

so data get through for maybe 10 seconds, then there's a pause for a
minute or two, then the cycle repeats.  this is quite regular and the
connection never actually fails.

my isp (vtr chile) has a reputation for throttling connections, but there
are no reset packets.  i don't understand things well enough to say more
than that.

tracepath gives the following:
qp6c ~: tracepath acooke.org
 1:  190.160.224.58 (190.160.224.58)                        0.189ms pmtu 1500
 1:  no reply
 2:  no reply
 3:  no reply
 4:  Hurrican-Electric-LLC.TenGigabitEthernet1-4.ar2.SJC2.gblx.net
(64.214.174.246) asymm  7 145.798ms
 5:  10gigabitethernet1-2.core1.fmt2.he.net (72.52.81.177) asymm  8 148.771ms
 6:  acooke.org (72.52.113.196)                           asymm  9
159.615ms !H
     Resume: pmtu 1500

any idea?  has anyone else reported the same thing?  as far as i know i am
dealing with the only high speed internet service in town here, and the
service is terrible.  i will try contacting them tomorrow, but don't
expect to get anywhere.

------------

Andrew

More Evidence

From: "andrew cooke" <andrew@...>

Date: Thu, 17 Jul 2008 06:00:42 -0400 (CLT)

Last night I found that:

- Using sftp from home to acooke.org was slow
- Using sftp from acooke.org to home was fast

So I ssh'ed into acooke.org and pulled files across rather than trying to
send them.  The only differences I can see in the two are:

- The role of client and server are reversed
- acooke.org doesn't use the standard port (22) for ssh

My guess is that VTR decided to limit traffic on non-standard ports.

Also, this morning, thing seem to be working OK again.  While last night
they got progressively worse (by the end it was difficult to type commands
in ssh it was so slow).  My guess there is that this is progressive (as
part of re-doing this site I have been transferring more data than
normal).

In summary, I think that what is happening is that:

- VTR appear to be "traffic shaping"
- They may be leaving standard ports alone
- They appear to progressively degrade performance
- If necessary, using pulling files over FTP is a workaround
  (because either the port or client changes)

We pay for a good (expensive) connection....

I'm going to try looking for a different provider today, but changing
things here is a real hassle (and I think it's a monopoly - there's only
one cable company).

Andrew

Comment on this post