-
ID
#15540447 -
Job type
Permanent -
Salary
Depends on Experience -
Source
Systems Technology Group Inc. (STG) -
Date
2021-06-16 -
Deadline
2021-08-15
Big Data Developer (Spark)
Michigan, Dearborn, 48120 Dearborn USAPermanent
Vacancy expired!
- Conduct POCs (proof of concept) and pilots to try new solutions and provide summary of results
- Participate in detailed technical design, development, implementation and support of Big Data applications
- Maintain standards compliance and ensure development artifacts are in alignment with patterns/ frameworks designed by software engineering teams
- Familiarity with Spark programming paradigms (batch and stream-processing). Understanding of different data abstraction objects used in spark for different use cases, use of optimal data format and other optimization techniques.
- Strong programming skills in at least one of the following languages: Java, Scala. Familiarity with a scripting language like Python as well as Unix/Linux shells
- Strong knowledge of writing optimized Spark and Hive sql and experience to tune poor performing queries.
- Outstanding programming and debugging skills. Strong knowledge of common algorithms and data structures.
- Experience with Java and/or Scala, preferably with Spring framework. 3+ years preferred.
- Strong experience with SQL and relational databases like PostgreSQL, MySQL, SQL Server or Oracle.
Vacancy expired!
Report job