Customer Case Study: O'Reilly Media
Targeting the latest hot topic is critical to the success of any publishing company, but staying on top of trends is difficult to achieve, especially when focused on the rapidly-evolving technology industry. When O’Reilly decided to refine its decision making regarding which topics to cover in future books and conferences, the company turned to Pivotal. O’Reilly needed a powerful, scalable data warehouse to collect and analyze millions of IT job posts to glean insights into key trends in the technology industry. The company uses this data to come up with topics for its books and conferences, to offer consulting and custom research, and for its own internal business development. O’Reilly’s goal was to tap into one of the largest sources of technology trend data available: Simply Hired. The site serves as an aggregator of millions of available jobs in the technology industry, painting a picture of the technologies garnering the most attention, investment and focus at any given moment. O’Reilly had been collecting IT job data from Simply Hired for several years, to see which categories of jobs were increasing in number, which were diminishing and which were emerging for the first time. O’Reilly had data on about 30 million jobs in an open source database and manually analyzed query results. But the database continued to grow and the analysis process was slow and cumbersome – taking an average of 10 hours to run a single query. O’Reilly needed a faster, more robust data warehouse solution to capture and analyze the growing job data. SOLUTION Pivotal Greenplum Database Delivers High Performance and Scalability. O’Reilly consolidated hundreds of millions of job postings from Simply Hired into Pivotal Greenplum Database for trend analysis. Pivotal Greenplum Database is designed to manage very large amounts of data very quickly, and its massively-parallel architecture is perfectly suited to load and query petabytes of data – making it an ideal solution for O’Reilly’s needs. To learn more about Pivotal Greenplum Database, visit: http://www.pivotal.io/big-data/pivotal-greenplum-database
