-
ID
#44774132 -
Job type
Permanent -
Salary
TBD -
Source
Capital One -
Date
2022-08-10 -
Deadline
2022-10-09
Lead Data Engineer (Remote Eligible)
Virginia, Richmond, 23173 Richmond USAPermanent
Vacancy expired!
West Creek 3 (12073), United States of America, Richmond, Virginia
Lead Data Engineer (Remote Eligible)Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs.Team Info: The Finance Technology team at Capital One is searching for innovative and analytical Data Engineers to join our team. Our data engineers are multi-linguists who can speak the languages of how we operate as a business, how that business impacts our financials, and the latest technologies that are reshaping our Finance Tech landscape. In this role, you will be responsible for building ETL data pipelines & frameworks using open source tools on public Cloud platforms.What You'll Do:- Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
- Leverage ETL programming skills in open source languages including Python, Scala, and SQL on various frameworks
- Provide technical guidance concerning business implications of application development projects
- Deploy DevOps techniques and practices like Continuous Integration, Continuous Deployment, Test Automation, Build Automation and Test-Driven Development to enable the rapid delivery of working code utilizing tools like Jenkins, Nexus, Maven, Github, and Docker
- Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
- Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance
- Manage multiple responsibilities in an unstructured environment where you're empowered to make a difference. In that context, you will be expected to research and develop cutting edge technologies to accomplish your goals
- Influence and provide technical guidance concerning business implications of application development projects
- Bachelor's Degree
- At least 6 years of experience in application development (Internship experience does not apply)
- At least 2 years of experience in big data technologies
- At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
- 7+ years of experience in application development including Python, SQL, Spark-Scala, or Java PySpark on maven builds, REST, JSON, relational databases, and CICD on Jenkins
- 7+ years of experience developing ETL Solutions
- 4+ years of experience developing, deploying , testing in AWS public cloud
- 4+ years of experience with Cloud computing, preferably AWS and its services including deploying S3, EMR/EC2,SNS,SQS and Lambda functions
- 4+ years experience with Distributed data/computing tools (MapReduce, EMR, S3, Lambda, Kafka, Spark, or MySQL)
- 4+ yrs of experience of delivering large-scale dataset solutions and SDLC best practices
- 4+ year experience working on real-time data and streaming applications
- 4+ years of experience with NoSQL implementation (Mongo, Cassandra)
- 4+ years of experience with UNIX/Linux including basic commands and shell scripting
- 2+ years of experience with Agile engineering practices
- AWS Certification
Vacancy expired!
Report job