• Find preferred job with Jobstinger
  • ID
    #43843373
  • Job type
    Permanent
  • Salary
    TBD
  • Source
    Motion Recruitment
  • Date
    2022-07-04
  • Deadline
    2022-09-02
 
Permanent

Job Description Our client is a people search engine that utilizes deep web crawlers to aggregate data. Their mission is to reconnect friends, reunite families, prevent fraud, and more. Their most notable usage of their platform recently has been connecting Adoptees to their biological families. Our client has over 14 billion records and minimally 15 million visitors per month, so they are a high traction platform. Required Skills & Experience • 3+ years development experience in data engineering • 1+ years professional experience working in big data ecosystems, preference for Spark • 1+ years professional experience working with dataflow management tools, such as Airflow • 1+ years experience working with Pentaho (or equivalent tools such as Talend, DataStage, and Informatica)2Hands-on scripting experience with Python, Scala and/or shell scripting • Preference for development experience in highly-scalable, distributed systems and cluster architectures (e.g. AWS, Azure, Google Cloud, etc) • Familiarity with complex NoSQL databases (e.g. DynamoDB, Cassandra, Elasticsearch, etc) • Prior experience working with large data sets (>1M+ records) • B.S. preferred in Computer Science, Information Systems, or related fields (foreign education equivalent accepted) Desired Skills & Experience • 5+ years of experience in backend software development • Experience with and understanding of ETL tools • Understanding of event data collection tools like Segment Tealium, mParticle, etc. What You Will Be Doing • Build infrastructure and automation for the extraction, preparation, and loading of data from various sources • Create unit and stress test components to monitor technical performance and ensure identified issues are resolved • Build and maintain data-backed tools to give data insight and capture key metrics • Automate and integrate new components into the data pipeline. • Use best practices for data governance, data quality, data cleansing, and other ETL-related activities. • Maintain technical documentation The Offer

  • Bonus

    OR Commission eligible
You will receive the following benefits:
  • Medical Insurance
  • Dental Benefits
  • Vision Benefits
  • Paid Time Off (PTO)
  • 401(k) {including match- if applicable}
Applicants must be currently authorized to work in the US on a full-time basis now and in the future.

Report job

Related Jobs

Jobstinger