Jetsetter Data Engineer - Platform Development Gilt Groupe
THIS JOB HAS EXPIRED Data Engineer
We are building a highly distributed system which could process an incredible amount of data in real-time, and it is self-learning in order to become more intelligent. We are looking for candidates with strong background in Data Warehouse Engineering that have managed and administered large data warehouse deployments and are open to working with and learning cutting-edge technologies in this space. Familiarity or past experience with Hive or Hadoop or related technologies is a plus.
Establish and maintain operational control and processes
Manage space, archival, and other housekeeping tasks
Work with client teams around data policies for data security
Create, run, and monitor jobs around compactions, compressions, archival
Create and maintain all operational support documentation
Bachelor's degree in Computer science or related field
Hands on programmer, strong in data structures and programming practices
At least 3 years experience writing production level PHP, Python or Java
Proficiency in Shell scripting (Bash, Awk, etc)
SQL experience highly desirable
Solid experience with large-scale, distributed systems design and development with a strong understanding of scaling, performance and scheduling
Experience being a power-user of projects in the Apache Hadoop ecosystem such as Pig, Hive, HBase etc. is a big plus
Experience with Map Reduce or other parallel programming techniques is a big plus
Expert understanding of ETL techniques and best practices to handle extremely large volume of data
3+ years combined experience among databases, shared-nothing, data warehouse applications, enterprise integration tools, data warehouse technology and modeling tools
Why work with us?
- We love traveling
- We get flexible vacation (of course apart from all the normal benefits health, dental, vision, etc.....)
- You get top of the line Mac Book Pro with great mac thunderbolt display.
You think you've got what it takes to be a Jetsetter? APPLY NOW...
PS: Did I tell you we go out for drinks often and we get unlimited vacation? (who does that, seriously?)
||33 West 19th Street |
New York, NY 10011
THIS JOB HAS EXPIRED