I have recently been ‘submitting to The Grid’. This is not some kind of freaky S&M thing, disappointingly perhaps to some. It is a process we have to go through in order to analyze the data being collected by the ATLAS detector at CERN.
The ATLAS experiment has approximately a zillion (2000) people working on it. (My new town declares itself to have 11,000 people but I have not noticed any update to this since we moved here.)
It is burbling out data in vast quantities. We cant catch it all because we would then have to store it somewhere, and it is currently producing terabytes of data per second*. Mental. So we just catch and store some of it. About 100 Megabytes per second.
Continued at The Guardian.