-
ID
#15468805 -
Job type
Permanent -
Salary
$110,000 - $125,000 -
Source
Analysts International -
Date
2021-06-09 -
Deadline
2021-08-08
Senior Big Data Engineer
Tennessee, Nashville, 37201 Nashville USAPermanent
Vacancy expired!
- Design, modify, implement, test, and provide operational support for enterprise software products and platforms, including software infrastructure and development tools for the Data
- Develop, operate and drive scalable and resilient data platform to address the business requirements
- Create new opportunities in this space for EHA platform with new feature capabilities and new offerings that drive customer and business value
- Ensure industry best practices around data pipelines, metadata management, data quality, data governance and data privacy
- Engages in building solutions leveraging technologies including but not limited to Python, Scala, Spark, Hive and AWS services such as EC2, S3, ECS, Lambda, EMR, ELB, SNS, Glue, Athena and SageMaker
- Strong knowledge of AWS cloud infrastructure compute, networking, storage and other AWS cloud services
- Proven experience with AWS services such as Data Pipeline, Step Functions, Batch, Lambda, CloudFormation, CloudWatch, EC2, EMR, SNS, IAM, ELB, EC2, S3, Redshift, Glue
- Experience with Big Data tech stack, including Hadoop, Java, Python, Spark, PySpark, Scala, and Hive, Columnar and NoSQL data stores
- Knowledge and previous experience with Unix and Linux
- Demonstrates strong drive to learn and advocate for development best practices
- Experience working with large datasets and large-scale distributed computing
- Working knowledge of building out data marts, data warehouses, data lakes preferred
- Experience on ETL data pipelines development and performance tuning
- Experience with manipulating and transforming data
- Experience on columnar databases like Redshift or Snowflake preferred
- Working knowledge of containers and container orchestration
- Proficiency using Kubeflow, Airflow or any other workflows
Vacancy expired!
Report job
Related Jobs
