-
ID
#45313826 -
Job type
Permanent -
Salary
TBD -
Source
OneMain Financial -
Date
2022-08-29 -
Deadline
2022-10-28
Senior Data Engineer
North Carolina, Highshoals, 28077 Highshoals USAPermanent
Vacancy expired!
Core Responsibilities
- Create and manage cloud resources in AWS
- Develop optimized data pipelines using AWS Glue / Pyspark meeting business needs
- Develop an infrastructure to collect, transform, combine and publish/distribute customer data.
- Define process improvement opportunities to optimize data collection, insights and displays.
- Ensure data and results are accessible, scalable, efficient, accurate, complete, and flexible
- Identify and interpret trends and patterns from complex data sets
- Key participant in regular Scrum ceremonies with the agile teams
- Proficient at developing queries, writing reports, and presenting findings
- Mentor junior members and bring best industry practices
- 4-7+ years' experience as data engineer
- Advanced knowledge in one of these languages: Java, Scala, Python, C#
- Experience in building optimized data pipelines in AWS environment using AWS Glue or Spark
- Experience in solutioning using AWS services
- Proficient in any database technologies (e.g., PostgreSQL, Redshift, Snowflake. and Greenplum)
- Knowledge in integrating with BI tools (e.g., Tableau, Looker, MicroStrategy)
- Comfortable learning about and deploying new technologies and tools.
- Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines.
- Good written and oral communication skills and ability to present results to non-technical audiences
- Knowledge of business intelligence and analytical tools, technologies, and techniques.
- Familiarity and/or experience in the following is a plus:
- AWS certification
- Spark Streaming
- Kafka Streaming
- ELK Stack
- Cassandra / MongoDB
- Terraform
- CI/CD: Jenkins, GitLab, Jira, Confluence other related tools
- Health and wellbeing options for team members and their dependents
- Up to 4% matching 401(k)
- Tuition reimbursement
- Continuing education
- Bonus eligible
- Paid time off
- Paid volunteer time
- And more
Vacancy expired!
Report job