Software Engineer, Infrastructure Group Quantcast
THIS JOB HAS EXPIRED
We are looking for software engineers of various experience levels for Quantcast's Infrastructure Group - the group that develops custom high-performance systems for processing petabytes of data and billions of real-time transactions.
A candidate for this position will be interested and have experience in distributed systems, big data, availability and reliability of large systems, fault-tolerance, efficiency and performance, high-performance networking, message queuing, etc.
If you have used Hadoop, or any other open source software/libraries, you understand their benefits as well as their weaknesses and how one would extend the bare metal system.
As a nimble, technology-driven company, Quantcast prides itself on its engineering organization and culture. This elite group works at the cutting edge of large-scale computing while developing core infrastructure software to advance our business and, where possible, give back to the community (http://quantcast.github.com/qfs/).
Responsibilities:
Custom mapreduce framework and core data processing pipelines (20PBs processed per day)
Distributed file system (open sourced as QFS), global job schedulers, data pipeline, and visualization
Peta-scale data warehouse software stack
High-frequency advertising platform (up to 500k qps) leveraging real-time bidding and machine learning on live traffic
Software design and algorithmic solutions to continuous scaling challenges
Open source implementations including Redis, Hadoop, Storm, QFS, etc.
Requirements:
Passionate, self-driven
Excellent development skills in C/C++ or Java
Excellent problem solving skills
Excellent understanding of performance, scalability and reliability problems at large scale (thousands of processing and storage units)
Experience with distributed or supercomputing systems
Understanding of mapreduce implementation a plus
BS, MS, or PhD. in Computer Science or related field
About Quantcast
Quantcast is an audience measurement and targeting company. The pioneer of direct audience measurement, we start with the industry?s most in-depth understanding of digital audiences to help marketers and publishers buy and sell the most effective targeted advertising and drive conversions through the full funnel. Our products let publishers match their audience to the exact consumers an advertiser wants to reach with impression level targeting. Ranked Fast Company?s #3 Most Innovative Company on the Web and the Overall Winner of AlwaysOn?s Global 250 Top Private Companies, Quantcast is used by the world?s leading advertisers, the top 10 media agencies and 100+ million web destinations. Launched in 2006, Quantcast is headquartered in San Francisco and backed by Founders Fund, Polaris Venture Partners, Revolution Ventures and Cisco Systems.
| Location: |
400 Second Street
Suite 350
San Francisco, CA 94107
United States
|
THIS JOB HAS EXPIRED