Big Data Engineer (Spark and Scala)

NO SPONSORSHIPData EngineerLooking for a candidate with 1 to 3 years Spark and Scala who knows Big Data Platform and can help develop the platform components into the cloud. Any cloud provider will work. We will train you . and Sharp mid-weight.

• A bachelor's degree
• 2+ years of progressive experience in data and analytics, with at least 6 months experience in Google cloud platform
• Overall, 2+ years of progressive experience working in software engineering teams
• Experience with Google Cloud Platform technology stack for Data Analytics and Big data technologies (Big Query - DWH concepts, ANSI SQL, Big Table – HBase, DataProc – Spark/Hadoop, Dataflow – Apache Beam/Scala/Python) is required
• Experience in developing the data pipeline, ETL processes, data platform, data modelling, and data governance processes in delivering end-to-end solutions
• Solid foundation in design, data structures and algorithms, and strong analytical and debugging skills with customer-facing products experience
• Good understanding of private and public cloud design considerations and limitations in the areas of virtualization, global infrastructure, distributed systems, load balancing, networking, massive data storage, Hadoop, MapReduce, and security.
• Strong programming experience in Python and Scala
• Experience of using development tools like Eclipse and IntelliJ
• Experience of using Jenkins, GitHub flow and artifact repo.
• Experience developing real time data streaming pipelines
• Drive innovation by assessing, piloting, building DevOps/Cloud tooling and services to improve overall developer experience and productivity
• Expertise & experience in building large scale, cloud based and open source projects.
• Hands-on solution driven attitude, with ability to turn around quick insights along with delivering strategic capabilities
• Multi-tasking ability to participate in multiple complex programs at the same time in an agile environment
• Strong organization and prioritization skills along with outstanding written and verbal communication skills
• Knowledge of agile software development methodology