• Find preferred job with Jobstinger
  • ID
    #15457381
  • Job type
    Permanent
  • Salary
    Depends on Experience
  • Source
    Proxim Systems
  • Date
    2021-06-11
  • Deadline
    2021-08-10

Senior Data Engineer

New York, New york city, 10001 New york city USA
 
Permanent

Vacancy expired!

Job Responsibilities:
  • Designs, develops and maintains scalable data pipelines and builds out new integrations and processes required for optimal extraction, transformation, and loading of data from a wide variety of data sources using HQL and 'Big Data' technologies
  • Assemble large, complex data sets that meet functional / non-functional business requirements and fostering data-driven decision making across the organization
  • Implements processes and systems to validate data, monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
  • Exerts data architecture influence across multiple domains
  • Owns the delivery of data solution by partnering across multiple teams
  • Defines and drives best practices and coding standards across data organization
  • Represents Data organization to interact with other engineering teams for enterprise level architecture designs
  • Performs root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement

Job Requirements:
  • Experience who is excited to apply their current skills and to grow their knowledge base.
  • BS or MS degree in Computer Science or a related technical field
  • Experience with data pipeline, data streaming, data analytics, data warehousing and big data
  • Experience with SQL/No-SQL, schema design and dimensional data modeling
  • Extensive knowledge in fine tuning SQL, understanding optimizer, and execution plans
  • Experience with Data Management and Data Governance processes and standards
  • Experience with BigData technologies stack such as Kafka, Cassandra, Airflow, HBase, Hadoop, Hive, Oozie, MapReduce
  • Experience in AWS/Cloud/Spark/Java/Python development
  • Proficiency in programming languages such as: Java, Scala
  • Familiar with Agile methodology, test-driven development, source control management, DevOps, Continuous Integration/Delivery, and testing automation

Vacancy expired!

Report job

Related Jobs

Jobstinger