-
ID
#46202426 -
Job type
Permanent -
Salary
$150,000 - $220,000 per year -
Source
Jobot -
Date
2022-10-03 -
Deadline
2022-12-01
Senior Data Engineer (TS/SCI clearance)
Virginia, Springfield, 22150 Springfield USAPermanent
Vacancy expired!
- Competitive Base Salary!
- Extremely Competitive Equity Package!
- Flexible Work Schedules!
- Accelerated Career Growth!
- Support data science team by designing, developing and implementing scalable ETL process for disparate datasets into a Hadoop infrastructure
- Design, develop, implement and maintain data ingestion process from various disparate datasets using StreamSets
- Develop processes to identify data drift and malformed records
- Modernize the data ingestion architecture
- Develop technical documentation and standard operating procedures
- Mentor new and junior data engineers
- Leads technical tasks for small teams or projects
- TS/SCI Clearance w/ability to obtain CI Poly
- Bachelor's degree in Engineering, Computer Science, Statistics, Applied Math, or a related technical field is required plus a minimum of 5 years of relevant experience; or Master's degree plus a minimum of 3 years of relevant experience. Agile experience preferred.
- Working knowledge of entity resolution systems
- Experience with messages systems like Kafka
- Experience with Python
- Experience with NoSQL and/or graph databases like MongoDB or ArangoDB
- Any of the following databases: SQL, MongoDB, Oracle, Postgres
- Working experience with ETL processing
- Working experience with data workflow products like StreamSets or NiFi
- Working experience with Python RESTful API services, JDBC
- Experience with Hadoop and Hive/Impala
- Experience with Cloudera Data Science Workbench is a plus
- Understanding of pySpark Leadership experience
- Creative thinker
- Ability to multi-task
- Excellent use and understanding of data engineering concepts, principles, and theories
Vacancy expired!
Report job