Data Engineer

Texas, Dallas / fort worth, 75001

Contract

Vacancy expired!

Note: Data Engineer will work from home. The candidate must have Big data tools experience and some healthcare data knowledge.

Day to Day Responsibilities:

Interact/integrate with cloud-based API's to pull data from external vendors
Operate within a Hadoop landscape to store and process large datasets
Utilize big data tools for the ingesting, processing, and manipulation of data
Convert raw data into usable information for analysis
Assist in the improvement of current business practices surrounding data ingestion and automation

Must Haves:

Experience working within a Hadoop environment using Big Data tools: Hive, Spark, Hbase, MapR, Python, and Scala. Kafka is a big plus.
Experience consuming and integrating cloud-based API's (REST or SOAP)
Experience working with extremely large datasets/data warehouses

Plusses:

Project:

The team is within Human Capital Market within Corporate & Employee Experience. Current about 7 Data Engineers and a mix of on and offshore teams. Their backlog is currently about 80 stories and they are hoping to get it down to about 40. Hoping to improve processes for automation and ingestion of data. 75% of data ingestion will be from external vendors and transported to a central location for it to be cleansed and then utilized for analysis.

Hadoop,Big Data,Hive,Spark,Healthcare ,Data ,API,DWs,DW,Data Warehouse ,Remote ,Workfromhome

Vacancy expired!

Report job