-
ID
#15816556 -
Job type
Contract -
Salary
Depends on Experience -
Source
Info Way Solutions -
Date
2021-06-22 -
Deadline
2021-08-21
Job Role: Data Engineer ( Only W2 )
California, Sanfrancisco, 94101 Sanfrancisco USAVacancy expired!
Hi Professionals,This is vimal kumar from infoway groupThis is W2 RequirementKindly get back to us if you are interested in this position Job Role: Data EngineerJob Location: SFO, CAOnly W2Long term Client is looking for a data engineer who has worked in Airflow, python, scala environment would be ideal. I do think it’s possible a candidate is not able to check all the boxes (in terms of specific technologies) a portion of toolkit/technologies can be picked up on the job. Minimum requirements 5+ years of relevant industry experience Bachelor’s and/or Master’s degree, preferably in CS, or equivalent experience Demonstrated ability to analyze large data sets to identify gaps and inconsistencies, provide data insights, and advance effective product solutions Experience designing and deploying high performance systems with reliable monitoring and logging practices Working knowledge of relational databases and query authoring (SQL). Excellent communication skills, both written and verbal Responsibilities Develop and automate large scale, high-performance data processing systems (batch and/or streaming) to drive Client business growth and improve the product experience. Build scalable Spark data pipelines leveraging Airflow scheduler/executor framework Design our data models for optimal storage and retrieval and to meet critical product and business requirements. Understand and influence logging to support our data flow, architecting logging best practices where needed Contribute to shared Data Engineering tooling & standards to improve the productivity and quality of output for Data Engineers across the company Improve data quality by using & improving internal tools to automatically detect issues.
Vacancy expired!