Sigh. Ive been trying to figure out whats going wrong with a script weve been given to stream our sequencing runs as delta .tar files to the cloud in dribs and drabs as they come off the sequencers, rather than as one hossing great upload at the end (which can be 20Gb per run, compressed). As we have [redacted, but call it n, where n > 10] sequencing runs per day, this spreads the bandwidth demand out more smoothly. Further, we were going to use a bandwidth shaping tool called trickle, which caps upload and download bandwidth to a preset value, and, using the trickle daemon, trickled, can set a global bandwidth cap, too. Except trickle interferes with the streaming upload script. Or rather, it seems to do something weird with Python file permissions, so the logging info doesnt get written out, and the Python script barfs all over the place and never exits cleanly. Sigh.
Posted on: Fri, 01 Aug 2014 21:27:19 +0000
Trending Topics
Recently Viewed Topics
© 2015