Distributed Systems / Platform Engineer (Hadoop, Java) Metamarkets
We?re looking for talented engineers to join our backend team, contributing to a fluid set of distributed systems that power our petabyte-scale data platform. This spans work on our real-time data ingestion layer (which combines the Kafka messaging system and Hadoop), our Scala-based machine learning modules, and most importantly our open-source, distributed, in-memory data store known as Druid.
You should have a strong foundation in CS fundamentals and be able to apply academic results (such as the HyperLogLog algorithm) to real-world problems in our production environment. You should be open to continuous learning and mentorship by our senior engineers, with a focus on functional architectures that easy to operate, manage, and extend. You should also be capable of making an individual contribution and teaching us something we don?t already know.
What you?ll need to know / learn: Java, the JVM, Hadoop and its friends (Pig, ZooKeeper)
What?s nice to know: Kafka, java.nio.ByteBuffer
This position is for work in our sunny San Francisco SoMa office, with benefits, competitive salary, and perks.
||San Francisco, CA |