Data Engineer

Posted:
8/12/2024, 7:11:30 AM

Location(s):
Ontario, Canada ⋅ Toronto, Ontario, Canada

Experience Level(s):
Junior

Field(s):
Data & Analytics

Workplace Type:
Hybrid

Pay:
$135/hr or $280,800 total comp

At Lyft, our mission is to improve people’s lives with the world’s best transportation. To do this, we start with our own community by creating an open, inclusive, and diverse organization.

Lyft thrives on community—it's the essence of who we are and what we do. Our commitment to fostering an open, inclusive, and diverse environment is paramount, ensuring every team member is valued for their unique contributions.

At Lyft, data isn't just part of our decision-making process; it's the foundation. It drives our ability to deliver exceptional transportation experiences and offers insights into the impact of our product launches and features.

Joining Lyft as a Data Engineer means becoming a pivotal part of a team dedicated to shaping the future of transportation. You'll be tasked with developing robust data infrastructure—encompassing data transport, collection, and storage—and providing services that enable our leadership to make informed, risk-reducing decisions. We're in search of a Data Engineer to construct a scalable insurance data pipeline that will inform our financial strategies. Collaborating closely with our claims engineering, actuarial, and science teams, as well as our insurance partners, you'll lead the charge from technical proposal to final implementation. This role involves clear communication of technical challenges to both our internal teams and external partners, ensuring a cohesive approach to problem-solving.

As the steward of our core data pipeline, which underpins Lyft's key metrics, you'll leverage your data expertise to refine data models and spearhead the creation and launch of scalable data pipelines. These efforts will support Lyft's expanding needs in insurance data processing and analytics, providing critical business and user behavior insights. With access to vast amounts of Lyft data, your work will empower teams across Analytics, Data Science, Engineering, and beyond, driving innovation and growth.

Responsibilities:

  • Design and implement insurance and claim-related data pipeline to help optimize insurance operation strategies
  • Tune ETL and MapReduce job to improve data processing performance
  • Partner with external insurance partners and Lyft business stakeholders to ensure seamless execution within established timelines
  • Owner of the core company data pipeline, responsible for converting the business and engineering need to efficient & reliable data pipelines
  • Main contributor to the team roadmap and lead the team to make the right technical decisions

Experience:

  • 2+ years of relevant professional experience
  • Strong experience with Spark
  • Experience with Hadoop (or similar) Ecosystem, S3, DynamoDB, MapReduce, Yarn, HDFS, Hive, Spark, Presto, Pig, HBase, Parquet
  • Strong skills in a scripting language (Python, Ruby, Bash)
  • Good understanding of SQL Engine and able to conduct advanced performance tuning
  • Proficient in at least one of the SQL languages (MySQL, PostgreSQL, SqlServer, Oracle)
  • Experience with workflow management tools (Airflow, Oozie, Azkaban, UC4)
  • Comfortable working directly with data and business partners to bridge Lyft’s business goals with data engineering
  • Preferred to have experience of building and maintaining insurance related data pipeline for large organizations

Benefits:

  • Extended health and dental coverage options, along with life insurance and disability benefits
  • Mental health benefits
  • Family building benefits
  • Access to a Health Care Savings Account
  • In addition to provincial observed holidays, team members get 15 days paid time off, with an additional day for each year of service 
  • 4 Floating Holidays each calendar year prorated based off of date of hire
  • 10 paid sick days per year regardless of province
  • 18 weeks of paid parental leave. Biological, adoptive, and foster parents are all eligible

Lyft proudly pursues and hires a diverse workforce. Lyft believes that every person has a right to equal employment opportunities without discrimination because of race, ancestry, place of origin, colour, ethnic origin, citizenship, creed, sex, sexual orientation, gender identity, gender expression, age, marital status, family status, disability, pardoned record of offences, or any other basis protected by applicable law or by Company policy.  Lyft also strives for a healthy and safe workplace and strictly prohibits harassment of any kind.  Accommodation for persons with disabilities will be provided upon request in accordance with applicable law during the application and hiring process.  Please contact your recruiter now if you wish to make such a request.

This role will be in office in our Toronto office on a hybrid schedule — Team Members will be expected to work in the office 3 days per week on Mondays, Thursdays and a team-specific third day. Additionally, hybrid roles have the flexibility to work from anywhere for up to 4 weeks per year. #Hybrid

Lyft

Website: https://www.lyft.com/

Headquarter Location: San Francisco, California, United States

Employee Count: 5001-10000

Year Founded: 2012

IPO Status: Public

Last Funding Type: Post-IPO Equity

Industries: Apps ⋅ Mobile Apps ⋅ Ride Sharing ⋅ Software ⋅ Transportation