• Find preferred job with Jobstinger
  1. Jobstinger
  2. Georgia
  3. Atlanta
  4. Et cetera
  5. Data Engineer
  • ID
    #15474649
  • Job type
    Permanent
  • Salary
    Depends on Experience
  • Source
    BayOne Solutions
  • Date
    2021-06-14
  • Deadline
    2021-08-13

Data Engineer

 Georgia, Atlanta, 30301 Atlanta USA
 
Permanent

Vacancy expired!

Responsibilities:
  • Create feature roadmap, design, build and maintain an automated data quality assurance framework
  • Implement data quality governance and best practices.
  • Design and develop testing frameworks for Kubeflow ETL jobs, data pipelines, product recommendation Client model results.
  • Create/Manage validation test cases and SQL scripts for large dataset in PROS environment and compare against data from source systems.
  • Track, monitor and document testing results
  • Analyze and troubleshoot data management code and issues.
  • Monitor and improvement of data platform
  • Generate data quality reports and alerts

    • Skills:
  • Experience with data quality validation test cases and automation
  • 3-5 years of hands on experience on Python.
  • Knowledge of analytical database BigQuery, knowledge of Google Cloud preferred.
  • Experience working on relational and non-relational databases like MySQL, HBase, BigTable etc.
  • Knowledge of anomaly detection on streaming data such as MAD (median absolute deviation), boxplot, etc
  • Knowledge on some data quality check libraries such as TensorFlow Data Validation (TFDV).

    •

    Vacancy expired!

    Report job

    Related Jobs

    Jobstinger

    Atlanta

     Georgia
    Permanent

    Manager, AWS Data Engineer

    Atlanta

     Georgia
    Permanent

    Data Engineer, Analytics

    Atlanta

     Georgia
    Permanent

    Big Data Engineer

    Atlanta

     Georgia
    Permanent

    Data Center Consulting Engineer - Electrical

    Atlanta

     Georgia
    Permanent

    Data Center Consulting Engineer - Electrical

    Atlanta

     Georgia
    Permanent

    Data Engineer

    Atlanta

     Georgia
    Permanent

    Client Performance Analytics-Senior Engineer (Data Design)