-
ID
#15820362 -
Job type
Permanent -
Salary
other -
Source
Quicken Loans, LLC -
Date
2021-06-23 -
Deadline
2021-08-22
Big Data Engineer
Michigan, Detroit metro, 48226 Detroit metro USAPermanent
Vacancy expired!
- Develop ELT processes from various data repositories and APIs across the enterprise, ensuring data quality and process efficiency
- Develop data processing scripts using Spark
- Develop relational and NoSQL data models to help conform data to meet users? needs using Hive and HBase
- Integrate platform into existing EDW and various operational systems
- Develop administration processes to monitor cluster performance, resource usage, backup and mirroring to ensure a highly available platform
- Address performance and scalability issues in a large-scale data lake environment
- Provide big data platform support and issues resolutions to Data Scientists and fellow engineers
- Master's degree in Computer Science, Software Engineering or closely related field
- 2 years of experience with a Hadoop distribution and ecosystem tools such as Hive, Spark, Nifi and Oozie
- 2 years of experience developing batch and streaming ETL processes
- 2 years of experience with relational and NoSQL databases, including modeling and writing complex queries
- Proficiency in at least one programming language such as Python or Java
- Experience with Linux system administration, Linux scripting and basic network skills
- Excellent communication, analytical, and problem-solving skills
Vacancy expired!
Report job