Data Warehouse Platform Technical Lead & Manager Quantcast
THIS JOB HAS EXPIRED We seek a technical lead and manager to help build the next generation of our multi-petabyte data warehouse and integration technology.
We are leaders, not followers, in the Big Data space:
Real-time replies to 700,000+ events per second. Largest single MapReduce scan job: 6 PB. Largest sort: 971 TB. A trillion new log entries every month.
QFS, our petabyte-scale file system 2x more space efficient and faster than HDFS. https://github.com/quantcast/qfs/wiki/Performance-Comparison-to-HDFS
Quantsort, a revolutionary map-reduce sort architecture that speeds up map-reduce significantly and simplifies greatly the management of shared map-reduce clusters. https://www.quantcast.com/inside-quantcast/2012/10/quantsort-revolution-in-map-reduce-performance-and-operation/.
Turbo Sawzall, a fast analytics platform that scans billions of records in seconds. https://www.quantcast.com/inside-quantcast/2011/11/turbo-mapreduce/
A candidate for this position will have proved interest in, and experience with large-scale data warehouses and data integration.
We offer you the opportunity to make an impact and grow in a fast paced environment at the bleeding edge of commodity cluster computing. We need your passion, drive, energy and experience with distributed or supercomputing systems.
Make your mark. Build/grow your personal brand as a Big Data leader.
Work with in-house big data and own the software stack. We wrote our own file system, real-time infrastructure, distributed MapReduce sorter, resource manager. You can drive changes to the full stack. We have our own big data and complex processes around it, from responding in real-time to 600,000 events per second to multi-petabyte MapReduce jobs. Our business is based on big data and this position is at its core.
Great timing. We are a fast growing pre-IPO technocracy. It?s a rush, don?t miss it.
Quantcast is a digital advertising company specialized in audience measurement and real-time advertising. As the pioneer of direct audience measurement in 2006, Quantcast has today the most in-depth understanding of digital audiences across the web, allowing marketers and publishers to make the smartest choices as they buy and sell the most effective targeted advertising on the market. Quantcast is dedicated to making display as relevant and effective as search, and currently delivers outstanding advertising campaigns for the world's leading advertisers and publishers and brings accurate audience measurement to over 100 million web destinations.
||400 Second Street |
San Francisco, CA 94107
THIS JOB HAS EXPIRED