Posted: December 1st, 2009 | Author: Shiran Pasternak | Filed under: Programming | Tags: high-performance computing, sge, shell-scripting, software | No Comments »
I can't seem to find a straighforward mechanism of resubmitting specific tasks in a Sun Grid Engine (SGE) array job, so I rolled my own. There's not much to it, but it's ideal for small array jobs where the failed tasks can be specified by hand.
Read the rest of this entry »
Posted: November 30th, 2009 | Author: Shiran Pasternak | Filed under: Big Data | Tags: Big Data, cloud computing, high-performance computing | 4 Comments »
David Dooling, of the Genome Center at Washington University and the blog PolITiGenomics, has written a thoughtful post about the nexus of cloud computing and bioinformatics. Dooling does a fine job summarizing the cloud computing and Big Data conversation that’s happening in bioinformatics circles, so I won’t repeat it here.
The post essentially argues that bioinformaticians are — to mix metaphors — too quick to jump on the cloud computing band wagon. It often makes more sense — and cents — to analyze genomic data locally (or privately). His cost-benefit analysis is spot on, but applies to the state of the art. The state of bioinformatics is, however, changing very rapidly and the scale (pun very much intended) is likely to tip.
Read the rest of this entry »
Recent Comments