Data Engineer

R4203Employment TypeFull timeWorksite FlexibilityRemoteJob SummaryAs the Data Engineer, you will take the lead in providing complex application development services in the client's Google Cloud Platform environment.Job DescriptionWe are looking for a Data Engineer to join our team for a 6-month contract opportunity that is full time and fully remote . The selected candidate will take the lead in providing complex application development services in the client’s Google Cloud Platform environment, typically as part of a project team or in an application support role. The selected candidate will analyze, design, code, test and implement more complex systematic solutions. They also provide general support to maintain more complex applications that meet the service levels, system availability, performance and quality levels required.What You’ll Do

Takes a lead role for analyzing, designing, coding, testing and implementing more complex application enhancements, as well as providing general production support, meeting defined scope, target dates and budgets with minimal or no defects.

Utilize and participate in the more complex full system development life cycle, per current Highmark SDLC standards.

Take a lead role in collaborating with customers, business analysts, partners, and IT team members to understand business requirements that drive the analysis and design of quality technical solutions.

Concentrate on providing innovative solutions to more complex business needs.

Perform work in compliance with all Highmark and Highmark IT standards, policies and procedures.

Actively take a leading role and participates on project teams in various project roles, including, but not limited to, Developer, Technical Lead and Project Manager, based upon level of experience.

Effectively communicate with team members, customers, partners and management, including assisting with or conducting more complex technical walkthroughs, reporting project status, enabling vendor solutions and providing accurate and concise documentation.

Other duties as assigned or requested.

What You’ll NeedRequired

Bachelor’s degree in Information Technology, Computer Science or closely related field

5 years of experience as a developer

3 years of experience in Databricks technology and be experienced in working with Databricks notebooks, clusters, and jobs. They should be able to optimize and troubleshoot Databricks workflows.

Deep understanding of Spark and its core concepts

Proficient in Spark programming Python, Pyspark

Strong data engineering skills, including experience with data ingestion (batch and streaming), data transformation, and data quality validation.

Familiar with ETL and have hands-on experience with data pipelines and data orchestration tools

Expertise with GCP, including services like Google Cloud Storage, BigQuery, Pub/Sub, and Dataflow

Problem solving, root cause analysis, and issue resolution

Demonstrated leadership skills

Experience in Healthcare or Health Insurance Industry

Experience with Databricks, GCP, application development tools, business processes, software development life cycle used by Highmark enterprise

Preferred

Master’s degree in Information Technology, Computer Science or closely related field

5 years of experience as a developer with demonstrated skills in: Databricks and Python/Pyspark

GCP: Big Query and PostgreSQL

Certifications such as Python, Databricks, GCP

Physical Demands

Ability to safely and successfully perform the essential job functions consistent with the ADA and other federal, state and local standards

Sedentary work that involves sitting or remaining stationary most of the time with occasional need to move around the office to attend meetings, etc.

Ability to conduct repetitive tasks on a computer, utilizing a mouse, keyboard and monitor

#LI-JM1Reasonable Accommodation StatementIf you require a reasonable accommodation in completing this application, interviewing, completing any pre-employment testing, or otherwise participating in the employment selection process, please direct your inquiries to application.accommodations@cai.io or (888) 824 – 8111.Equal Employment Opportunity Policy StatementIt is the policy of CAI not to discriminate against any employee or applicant due to race, color, religion, sex, sexual orientation, gender identity, national origin, age, marital status, genetic information, disability or being a protected veteran. It is also the policy of CAI to take affirmative action to employ and to advance in employment, all persons regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, age, marital status, genetic information, disability or being a protected veteran, and to base all employment decisions only on valid job requirements. This policy shall apply to all employment actions, including but not limited to recruitment, hiring, upgrading, promotion, transfer, demotion, layoff, recall, termination, rates of pay or other forms of compensation and selection for training, including apprenticeship, at all levels of employment. Employees and applicants of CAI will not be subject to harassment due to race, color, religion, sex, sexual orientation, gender identity, national origin, age, marital status, genetic information, disability or being a protected veteran. Additionally, retaliation, including intimidation, threats, or coercion, because an employee or applicant has objected to discrimination, engaged or may engage in filing a complaint, assisted in a review, investigation, or hearing or have otherwise sought to obtain their legal rights under any Federal, State, or local EEO law is prohibited.