CBS Interactive runs some of the world's most popular websites, including CBSNews.com, CBSSports.com, Last.fm, and CNET.com. The company had been collecting hundreds of megabytes of click stream data every hour and storing it in traditional databases. It used to take a full day to process the data to determine click through rates, conversions and generate reports for the executive dashboard.

We led the implementation of a Big Data initiative, using Hadoop, that reimagined the way CBS Interactive transforms data into insight. Team and infrastructure was built from the ground up, working with the Hadoop vendor Cloudera to train the infrastructure team as well as internal customers on the new technology. Using the new platform, CBS Interactive now has the flexibility to analyze data by the week, day, or hour and filter by OS, browser, device and geographical location. For a number of sites, data analysis can now be done in real time, which allows the company to optimize the placement of advertisements and increase revenue. By eliminating the need to upgrade the traditional data warehouse appliance, the big data initiative saved CBS Interactive nearly $2 million.

Managing Security in Enterprise

This is the first in a 2-part post on managing security within Hadoop