Data Engineer, Central Data

Posted:
11/22/2024, 8:30:06 AM

Location(s):
California, United States ⋅ San Francisco, California, United States

Experience Level(s):
Mid Level

Field(s):
Data & Analytics

Workplace Type:
Hybrid

Pay:
$150/hr or $312,000 total comp

At Lyft, our purpose is to serve and connect. To do this, we start with our own community by creating an open, inclusive, and diverse organization.

At Lyft, data isn't just part of our decision-making process; it's the foundation. It drives our ability to deliver exceptional transportation experiences and offers insights into the impact of our product launches and features.

Joining Lyft as a Data Engineer means becoming a pivotal part of a team dedicated to shaping the future of transportation. You'll be tasked with developing robust data pipelines—encompassing data transport, collection, and storage—and providing services that enable our leadership to make informed, risk-reducing decisions. We are in search of a Data Engineer to join the Central Data Engineering Team within Data Platform, responsible for designing and managing the most foundational datasets at Lyft (Rides, Routes, Sessions) . These datasets drive key parts of the Lyft business and support a variety of use cases, including but not limited to Pricing, Mapping, and Marketplace. 

As a Data Engineer, with your technical expertise you will manage project priorities, deadlines, and deliverables. You will design, develop, test, deploy, maintain, and enhance the data pipelines. Your work will have a major impact on several areas of the business.

We are looking for candidates who are self starters and have a proven track record of delivering data solutions that can solve critical business needs. The candidate should be able to dive deep into any problems with lots of ambiguity and build a technical solution to solve it. They should be willing to take ownership of a project or a feature and be able to drive it from design to implementation.

Responsibilities:

  • Owner of the core company data pipeline, responsible for scaling up data processing flow to meet the rapid data growth at Lyft
  • Evolve data model and data schema based on business and engineering needs
  • Implement systems tracking data quality and consistency
  • Develop tools supporting self-service data pipeline management (ETL)
  • SQL and Spark/Trino job tuning to improve data processing performance
  • Write well-crafted, well-tested, readable, maintainable code
  • Participate in code reviews to ensure code quality and distribute knowledge
  • Unblock, support and communicate with internal & external partners to achieve results

Experience:

  • 3+ years of data engineering industry experience 
  • Experience with Data (or similar) Ecosystem (Spark, Trino, Snowflake, Bigquery, Databricks)
  • Strong skills in a scripting language (Python, Bash)
  • Good understanding of SQL Engine and able to conduct advanced performance tuning
  • 1+ years of experience with workflow management tools (Airflow, Dagster, Prefect, Glue)
  • Experience of working directly with cross-functional data analytics, data scientists, and engineering teams to bridge Lyft’s business goals with data engineering

Benefits:

  • Great medical, dental, and vision insurance options
  • Mental health benefits
  • Family building benefits
  • In addition to 12 observed holidays, salaried team members have unlimited paid time off, hourly team members have 15 days paid time off
  • 401(k) plan to help save for your future
  • 18 weeks of paid parental leave. Biological, adoptive, and foster parents are all eligible
  • Pre-tax commuter benefits
  • Lyft Pink - Lyft team members get an exclusive opportunity to test new benefits of our Ridership Program

Lyft is an equal opportunity/affirmative action employer committed to an inclusive and diverse workplace. All qualified applicants will receive consideration for employment without regards to race, color, religion, sex, sexual orientation, gender identity, national origin, disability status, protected veteran status or any other basis prohibited by law. We also consider qualified applicants with criminal histories consistent with applicable federal, state and local law.

This role will be in-office on a hybrid schedule — Team Members will be expected to work in the office 3 days per week on Mondays, Thursdays and a team-specific third day. Additionally, hybrid roles have the flexibility to work from anywhere for up to 4 weeks per year. #Hybrid

The expected base pay range for this position in the San Francisco area is $124,000.00 - $155,000.00. Salary ranges are dependent on a variety of factors, including qualifications, experience and geographic location. Range is not inclusive of potential equity offering, bonus or benefits. Your recruiter can share more information about the salary range specific to your working location and other factors during the hiring process.

Lyft

Website: https://www.lyft.com/

Headquarter Location: San Francisco, California, United States

Employee Count: 5001-10000

Year Founded: 2012

IPO Status: Public

Last Funding Type: Post-IPO Equity

Industries: Apps ⋅ Mobile Apps ⋅ Ride Sharing ⋅ Software ⋅ Transportation