Job Description

We are seeking an experienced Data Engineer to architect, build, and lead scalable data platforms. This role requires strong hands-on experience in AWS, Spark, Databricks, and Airflow, along with technical leadership capabilities to guide teams and establish best practices. 

 

Key Responsibilities:

• Lead the design and implementation of end-to-end data engineering solutions

• Architect and optimize large-scale data pipelines using Spark, Python, and SQL

• Design and manage orchestration frameworks using Apache Airflow

• Build scalable and cost-efficient solutions on AWS ecosystem

• Drive development and optimization of Databricks-based data platformsEstablish best practices for data engineering, coding standards, and governance

• Mentor and guide data engineering teams

• Collaborate with cross-functional stakeholders to deliver business value

• Implement and drive CI/CD practices, including GitHub Actions

• Ensure data platform scalability, performance, and reliability

Required Skills & Experience:

• Strong expertise in SQL, Python, and Apache Spark

• Extensive hands-on experience with Apache Airflow

• Deep experience with AWS cloud services

• Strong experience building solutions on Databricks platform

• Proven experience in data architecture, modeling, and big data systems

• Experience leading engineering teams and projects 

• Strong analytical, problem-solving, and communication skills 

Good to Have:

• Experience with CI/CD tools, especially GitHub Actions

• Knowledge of Pharmaceutical / Life Sciences domain

• Experience with real-time/streaming pipelines (Kafka, etc.)

• Exposure to ML/data science workflows 

Education & Experience:

• Bachelor’s/Master’s degree in Computer Science or related discipline

• Typically 8+ years of experience in data engineering

Required Skills:

Amazon Web Services (AWS), Apache Airflow, Apache Spark, Databricks Platform, Python (Programming Language), Structured Query Language (SQL)

Preferred Skills:

CI/CD, GitHub Actions

Current Employees apply HERE

Current Contingent Workers apply HERE

Search Firm Representatives Please Read Carefully 
Merck & Co., Inc., Rahway, NJ, USA, also known as Merck Sharp & Dohme LLC, Rahway, NJ, USA, does not accept unsolicited assistance from search firms for employment opportunities. All CVs / resumes submitted by search firms to any employee at our company without a valid written search agreement in place for this position will be deemed the sole property of our company.  No fee will be paid in the event a candidate is hired by our company as a result of an agency referral where no pre-existing agreement is in place. Where agency agreements are in place, introductions are position specific. Please, no phone calls or emails. 

Employee Status:

Regular

Relocation:

No relocation

VISA Sponsorship:

Yes

Travel Requirements:

10%

Flexible Work Arrangements:

Hybrid

Shift:

Not Indicated

Valid Driving License:

No

Hazardous Material(s):

N/A

Job Posting End Date:

07/12/2026

*A job posting is effective until 11:59:59PM on the day BEFORE the listed job posting end date. Please ensure you apply to a job posting no later than the day BEFORE the job posting end date.