Big Data

ocean currents near antarctica

‘Pangeo’ Project Will Improve Access to Climate Data

The better climate models become, the harder it is to use them. One team of researchers is working to fix that.

by |September 13, 2017

IEDA: Revolutionizing Big Data

The Interdisciplinary Earth Data Alliance is fueling groundbreaking multi-disciplinary discoveries worldwide. “This is a new era of data mining,” says IEDA Director Kerstin Lehnert, a geochemist at Lamont-Doherty Earth Observatory.

by |December 13, 2016
Ocean waves interact with large-scale currents in this snapshot taken from a new NASA simulation. Oceanographers eager to explore it are hampered by inadequate computing power. Image: Dimitris Menemenlis/NASA’s JPL and Chris Hill/MIT

New Group Takes On Massive Computing Needs of Big Data

The sheer number of observations now streaming from land, sea, air and space has outpaced the ability of most computers to process it. The Data Science Institute’s newest working group —Frontiers in Computing Systems—will try to address some of the bottlenecks facing scientists working with these and other massive data sets.

by |July 25, 2016
SDG diagram

Science Journalists and the Data Revolution

Journalist Cheryl Philips described using publicly accessible records of infrastructure assessments done by the Department of Transportation in Washington State to map the most vulnerable bridges and to tell the story behind a bridge that collapsed, killing several people. John Bohannon of Science Magazine used iPython coding to send a fake journal article to close to 200 open access journals in a sting operation to uncover the lack of peer review of a clearly flawed article.

by |March 24, 2015

Contest Aims to Bring ‘Dark Data’ into Digital Archives

The scientific publisher Elsevier and a data archiving facility at Columbia University’s Lamont-Doherty Earth Observatory are offering $5,000 and a trophy to the person with the best example of how data-preservation techniques are being used to advance new discoveries in the earth sciences.

by |April 29, 2013