Real Time Platform Architect Kosmix
THIS JOB HAS EXPIRED
The Opportunity:
As our Real Time Platform Architect, you will be leading the development of cutting-edge data processing frameworks and technologies to handle the massive amounts of real time content flowing into our system (65M daily tweets plus more to come) think developing next-generation versions of technologies like hadoop, cassandra, map/reduce, etc. This will involve working closely with our technical founders, our existing platform engineers and our content partners - the good folks at Twitter and others to be named soon.
You will be spending about 50 of your time designing/architecting/mentoring and your remaining time developing the big-scale infrastructure. You will be designing and developing sophisticated algorithms and technical solutions for massive data storage and distributed processing as well as implementing back-end pipelines that have complex business rules, sophisticated algorithms, and a high need for robustness and automation.
Challenges include: distributed storage, web-scale back-end pipelines, real-time indexing and classification of content, multi-level caching, statistical methods for analysis and performance tuning.
The Desired Skill-set:
BS/MS/PhD in Computer Science, Computer Engineering, Electrical Engineering or related field
7-10+ years of Programming experience in C/C++/Java/scripting (Perl, Python)
Extensive Linux systems programming experience
Expertise in distributed/scalable systems and algorithms with awareness of time and space complexity
Strong background in process design for reliable systems
Working knowledge of standard tools for optimizing and testing code
Past experience handling large amounts of data on distributed platforms is also a huge plus
Most important, we want self-motivated builders with a real urge to change the world through their creations
| Location: |
Mountain View, CA
United States
|