Hadoop inventor calls NSA snooping a cautionary tale for devs

BOSTON — The creator of Hadoop said web app developers must put public trust first and argued that actions by the National Security Agency (NSA) offer a cautionary tale for the future of big data.

Doug Cutting, who in 2004 developed the open-source implementation of the Map-Reduce framework, said big data analytics has opened the floodgates for capturing new consumer data as well as analyzing vast stores of historical information.

The NSA, for example, uses Hadoop for big data analytics related to its bulk data collection program. The agency has come under heavily criticism for its secretive, widespread collection of telephone and business records under the Patriot Act.

To read this article in full or to leave a comment, please click here