• Find preferred job with Jobstinger
  • ID
    #12269732
  • Job type
    Contract
  • Salary
    $80 - $92 hr
  • Source
    iTech Solutions
  • Date
    2021-04-14
  • Deadline
    2021-06-13

Senior Data Engineer

New York, New york city, 10019 New york city USA
 
Contract

Vacancy expired!

Senior Data EngineerMust have:

  • Experience with one or few ETL tools and frameworks (MS SSIS, Pentaho, Talend, Informatica etc)
  • Experience with any of the following DWH: AWS Redshift, Snowflake, BigQuery
  • Experience with AWS/AzureP Cloud Platforms (Preferably with Analytical services)
  • Proficiency in object-oriented/object function : Python (Preferred) or Java/Scala
  • Strong analytic skills related to working with unstructured datasets
  • Build processes supporting data transformation, data structures, metadata, dependency and workload management
  • Remote team leadership skills (for US-based positions)
  • Experience with Github
Would be a plus:
  • Snowflake experience
  • Experience with BI tools (Tableau, Looker etc)
  • Experience with NoSQL databases: Cassandra, MongoDB, DynamoDB, Neo4J
  • Understanding CI/CD concepts
  • Big Data concepts and experience with Hadoop, Spark, Kafka
  • Experience in Media industry and its standards
  • Good understanding of REST technologies (REST design, RESTful services)
  • Knowledge of OOP, OOD and design patterns
Tasks:
  • Assemble large, complex data sets that meet functional / non-functional business requirements
  • Define architectural and implementation design of metadata and data pipelines
  • Requirements analysis, communication with Product Managers and other stakeholders
  • Prepare designs for database systems and recommend improvements for performance.
  • Create data pipelines (ETL/ELTs) using SQL, Python and various AWS services
  • Writing analytical SQL queries for end-user apps/services
  • Evaluate all proposals requests and assist to improve structure of DWH.
  • Perform troubleshoot on all ETL processes and resolve issues effectively.
  • Code reviews and bug fixing.

Vacancy expired!

Report job

Related Jobs

Jobstinger