symmetry magazine

dimensions of particle physics

dimensions of particle physics

A joint Fermilab/SLAC publication


Computing power for all

June 24, 2014

Computing power for all

The Open Science Grid enables faster, more efficient analysis of LHC data—and also contributes to advancements in fields from geology to medicine.

Related symmetry content

Elsewhere on the web

Science today collects a mind-boggling amount of data. Particle physics experiments at CERN have collected more than 100 petabytes—that’s 104,857,600 gigabytes—of data about particle collisions in the Large Hadron Collider.

Taking all this raw data and turning it into something meaningful takes enormous computing power, more than any single institution can provide. That’s where the Open Science Grid comes in.

Funded by the Department of Energy’s Office of Science and the National Science Foundation in 2006 to meet the US LHC community’s computational needs, the OSG ties together individual groups’ computing power, connecting their resources to create a large, robust computing grid. This grid allows scientists to tackle vast mountains of data in a logical, efficient way.

It also creates opportunity for non-LHC scientists.

“The LHC community has a large set of resources that work most efficiently when they’re linked together,” says OSG project manager Chander Sehgal. “But they’re not always completely busy. When they’re not, we can harvest unused cycles and make those available to other researchers.”

Scientists have used the OSG to simulate interactions between DNA and proteins, investigate the human body’s response to tuberculosis, and study the agricultural impacts of large-scale drought.

OSG scientists share computing hours with researchers in many fields to enable their science, striving to make sure the computing grid is used with maximal efficiency. If a particular research group needs more computing resources than usual—say in the lead-up to summer conferences—it can use other groups’ computing power through the OSG. But then, when that group is attending one of those conferences—and so not running as many calculations as usual—others can use the otherwise unused resources to run their own calculations.

“When you have a big enough community and you harvest all the dips in usage, you can allow researchers to get their work done by using these ‘opportunistic cycles,’” says Sehgal. “These cycles would have otherwise been wasted, so we’re putting them to good use for science in the United States.”

Don Krieger, who studies brain trauma at the University of Pittsburgh, uses the OSG as part of a comprehensive group effort to better understand, diagnose and treat concussions. He says he is able to conduct his research more quickly and economically thanks to this powerful resource.

Krieger works with a large team to characterize brain anatomy and track brain function of patients with concussions and more severe head injuries. The work involves recording magnetic fields outside the head that are produced by the brain, and then using the OSG to determine the neuroelectric activity that caused these fields. It takes about 150 CPU hours to analyze just one second of these magnetic field recordings.

With its ability to dynamically portray neurological function on previously unachievable time and distance scales, the technique already surpassed the power of functional MRI scans. With more than 2 million people with concussions visiting emergency rooms in the United States each year, Krieger’s studies could have an enormous impact.

“The work we have accomplished in the past year would have literally required millennia on a single state-of-the-art workstation,” Krieger says. “And it would have cost at least $500,000 using commercial cloud computing. Instead we were able to run ‘opportunistically’ on the OSG and use cycles which otherwise would have been lost.”

In just the past 12 months, these opportunistic cycles have added up more than 100,000,000 CPU hours. (That’s the equivalent of 100,000,000 computer cores being used for one hour each.)

“There is no comparable resource.” Krieger says.

Magnetic field recording

This magnetic field recording shows the right hemisphere of the brain while the tip of the left index finger is being tapped. Each red dot indicates neuroelectric brain activity; the green boxes are areas that are more activated (while the yellow boxes are areas that are less highly activated) when the left index finger compared with the right index finger is tapped. The recording, which offers much more information than a functional MRI, shows half of a second of data slowed down by a factor of 16. 


Like what you see? Sign up for a free subscription to symmetry!
Experiments and machines: 
Laboratories and facilities: 
Artwork by Sandbox Studio, Chicago with Shawna X.