-
ID
#6118168 -
Job type
Permanent -
Salary
Market related -
Source
Phoenix Staff, Inc. -
Date
2020-11-25 -
Deadline
2021-01-24
Lead Data Engineer, Azure
Nevada, Las vegas, 89101 Las vegas USAPermanent
Vacancy expired!
- Develop new features and enhance existing data pipelines
- Contribute to solution design and technical design for new features
- Support data pipeline workload in the production environment
- Monitor job execution, triage and troubleshoot job failures and other issues
- Make code changes to fix production failures and deploy code in production
- Report operations status to all stakeholders at regular cadence
- Identify opportunities to enhance, streamline, improve codebase and work with Dev leads to make that happen
- Monitor infrastructure proactively and identify opportunities to improve operational efficiency, job execution performance and overall cost
- Perform other job-related duties as requested
- Data Engineering/Data Warehousing development/operations experience of at least 7 years
- Azure cloud experience of at least 3 years with Synapse, ADF V2, ADF Data flows, Azure Databricks, SQLDB/Hyperscale, SQLDW, ADLS Gen 2 and other Azure services
- Python & PySpark development
- SQL development including PL/SQL, preferably SQL Server but another RDBMS may be fine
- Managing an offshore team
- Good communication (verbal and written) and documentation skills
- Development using ETL tools like DataStage or Informatica
- ADF source code version control using Azure DevOps or Git
- Experience with Snowflake
- Collaboration with business teams
- Experience in fast paced and complex environments, including large enterprise settings
Vacancy expired!
Report job