Azure Data Engineer Location: Lafayette, LADuration: 6+ MonthsJob Description:Looking for an Azure Data Engineer to join the team in Lafayette, LA.! With your required expertise in developing and deploying application on MS Azure Databricks, you will work with a high-performing team to implement a Cloud Modernization Project. You will support and interact with the client daily in an Agile way of working. You will have the opportunity to show/grow with technology in a customer-facing role. You should be self-motivated to drive solutions and proactively create (in sufficient detail) the documentation required to support and describe technical solutions. You should be able to work independently under limited supervision and apply your knowledge of Azure-based ETL. You will work with cloud architects to establish pipelines and develop spark code using Databricks platform. You should have sufficient knowledge and maturity to effectively deal with technical issues and help to support the broader team. Your future duties and responsibilitiesThe data engineer will be responsible for development, deployment, maintenance, diagnostics and support of spark ETL jobs on the MS Databricks platform.Will streamline code, rationalize datasets and tables to arrive at single source of truthWill build detailed architecture diagrams for all workflows and processesjobs, cron, ESP etc.Excellent communication skills Required qualifications to be successful in this role3 years of hands on experience with cloud automation and scripting in an Azure environment.Experience in development of apache Spark code using PySpark/ScalaExperience in using Azure Databricks PlatformExperience in using Azure Data Factory to call Azure Databricks notebook activitiesExperience in using Azure Storage (Blob/Data Lake Store), Databricks DeltaExperience in using Git based repositoriesGood fundamental knowledge about distributed computing, RDBMS and Dimensional modeling conceptsExposure to Azure DevOpsSkill Set/Years of Experience/Proficiency Level Information Technology6 yearsHighETL4 yearsHighSQL4 yearsHighAzure Databricks3 yearsHigh Minimum Education Required: Bachelor’s DegreeDisclaimer:Mindlance is an Equal Opportunity Employer and does not discriminate in employment on the basis of – Minority/Gender/Disability/Religion/LGBTQI/Age/Veterans.
