Quantcast, an internet audience measurement and ad targeting service, processes over 20 petabytes of data per day using Apache Hadoop and its own custom file system called Quantcast File System (QFS).

Facebook deployed Raid in large Hadoop Distributed File System (HDFS) clusters last year, to increase capacity by tens of petabytes, as well as to reduce data replication. But the engineering team ...

What are some of the cool things in the 2.0 release of Hadoop? To start, how about a revamped MapReduce? And what would you think of a high availability (HA) implementation of the Hadoop Distributed ...

In this whitepaper, Yahoo engineers Konstantin Shvachko, Hairong Kuang, Sanjay Radia, and Robert Chansle look at HDFS, the file system component of Hadoop. While the interface to HDFS is patterned ...

Google this week announced a Google Cloud Storage Connector for Hadoop aiming to simplify Big Data analysis on its cloud platform by eliminating the need to use the oft-maligned Hadoop Distributed ...

MapR's file system was its original differentiator in the Hadoop market: unlike standard HDFS, which is optimized for reading, and supports writing to a file only once, MapR-FS fully supports the read ...

Big data can mean big threats to security, thanks to the tempting volumes of information that may sit waiting for hackers to peruse. BlueTalon hopes to tackle that problem with what it calls the first ...

Cloud computing is a new technology which comes from distributed computing, parallel computing, grid computing and other computing technologies. In cloud computing, the data storage and computing are ...

Arun C. Murthy awoke to a phone call. It was 3 a.m., and an ad-targeting application at Yahoo, where he was an engineer, was running at painfully slow speeds. The culprit: a piece of software code ...

As a poster child for big data, Hadoop is continually brought out as the reference architecture for big data analytics. But what exactly is Hadoop and what are the key points of Hadoop storage ...