Staff Software Engineer, Data 

The Data Engineering team is building Paradigm’s platform for clinical care information, ingesting data from multiple sources, including Electronic Health Records, lab providers, Health Information Exchanges, and more.  As Paradigm’s data needs evolve with an expanding population, research, and health system footprint, Data Engineering will scale its architecture to support enhanced parallel data processing.

Data Engineering enriches, harmonizes and makes data available for multiple consumers and product verticals, including:

• AI & Data Science teams using this data to optimize and develop new classification models, define patient matching heuristics, answer feasibility queries for trial and research sites, and, ultimately, surface insights for clinical trial opportunities
• Software application teams optimizing data for Paradigm’s Clinical Trial Matching workflows (matching patients to potential trials) and Study Conduct (capturing data once a trial has begun)

As a Staff Engineer on the Data team, you’ll operate at the intersection of software and data, partnering closely with product teams and data consumers to improve the breadth, quality, and completeness of our data. We're seeking someone with experience in database technologies, distributed systems, and cloud computing, who can focus on technical architecture, roadmapping, data modeling, and ensuring appropriate data access to support our product goals. You will also mentor and guide the growth of engineers on your team.

How you’ll lead

• Foster a continuous improvement mindset and provide mentorship to your engineering team.
• Collaborate closely with product managers, data scientists, analysts, and engineering colleagues to translate complex business problems into efficient technical solutions.
• Shape the engineering vision while owning the data models and toolchain for our data platform.
• Design, develop, and optimize data models to meet the needs of the data team’s consumers.
• Build and maintain robust batch and streaming pipelines, leveraging cloud technologies and distributed systems.
• Develop tools and processes that make data accessible across products and for data consumers.
• Enhance the maturity of our monitoring systems to improve visibility and failure detection within our infrastructure.
• Become a subject matter expert on our diverse datasets and associated tooling.
• Ensure privacy and security in the governance of our data in collaboration with cross-functional teams.
• Advocate for a scalable, maintainable data platform that supports our evolving business needs.

What you’ll bring

• Extensive experience driving technical projects, prioritizing work, identifying dependencies, and facilitating technical decisions across teams.
• Deep expertise in SQL, data analysis, and data modeling, with a strong understanding of distributed systems and cloud environments.
• Proven track record in designing systems that are scalable, available, maintainable, and performant.
• Proficiency in coding (Python or other languages) and experience with ETL orchestration tools like Apache Airflow or Dagster.
• Familiarity with data transformation tools such as dbt or dataform.
• Experience with data warehouse technologies like BigQuery, Redshift, or Snowflake.
• 8+ years of experience in Software Engineering, with a focus on Data, cloud computing or distributed systems.