Senior Software Engineer - Web Mining Chief People
THIS JOB HAS EXPIRED We are looking for an intelligent and motivated senior engineer to assume ownership of our client's Web Mining Platform. The ideal candidate for this job is a Web Site Scraping Superstar. This person will have written a number of web mining spiders from scratch, and will have also utilized browser engines and other third-party tools and codebases to automate the task of walking through a complex web site and extracting data from that site.
This engineer will have sole responsibility for advancing our web mining technology. We currently use a home-grown system based on Mozilla?s XulRunner to scrape financial and other institutional sites, extracting documents on behalf of our individual users. Experience with XulRunner, at the lowest level possible, is the most valuable trait a candidate can have. Lacking XulRunner experience, the candidate would need enough experience of a similar nature to assure us that he/she could easily learn and then jump right into XulRunner-based development.
In this position, you would be advancing the toolset currently used by our team of top-notch engineers who are writing scripts to support extraction from particular institutional sites. You would be maintaining and advancing the system that accepts extraction jobs, runs one of these scripts, and passes the results along to our document management system. You would work with these engineers to help solve challenges posed by particular sites, and also work to generally make their work more efficient. You would also be expected to write some scripts, likely the ones that pose the greatest challenge and suggest particular enhancements to our platform.
Minimum Required Skills
Expert understanding of the DOM, its standad API, XPath, browser differences, and browser security models.
Significant experience in writing and working with web scraping technologies (spiders, data-miners, etc.).
Experience in working with Mozilla?s XulRunner highly desirable.
Skills and experence that will earn you bonus points
Having worked within the XulRunner codebase.
Significant experience with the CoffeeScript language.
Authored Firefox or other browser extensions.
C/C++ familiarity to read and comprehend the XulRunner source code.
What you need for this position
An entrepreneurial spirit.
5+ years of experience in software development.
Exceptional analytic and problem solving skills.
Proven ability to work in a highly collaborative environment.
Exceptional communication skills.
Simply excited about technology and what we?re doing t change the world.
||San Francisco, CA |
THIS JOB HAS EXPIRED