Senior Software Engineer II, Data Discovery

Posted:
9/25/2024, 8:38:58 AM

Location(s):
New York, New York, United States ⋅ New York, United States

Experience Level(s):
Senior

Field(s):
DevOps & Infrastructure ⋅ Software Engineering

Company Description
Etsy is the global marketplace for unique and creative goods. We build, power, and evolve the tools and technologies that connect millions of entrepreneurs with millions of buyers around the world. As an Etsy Inc. employee, whether a team member of Etsy, Reverb, or Depop, you will tackle unique, meaningful, and large-scale problems alongside passionate coworkers, all the while making a rewarding impact and Keeping Commerce Human.

Salary Range:

$178,000.00 - $208,000.00

Etsy is the global marketplace for unique and creative goods. We build, power, and evolve the tools and technologies that connect millions of entrepreneurs with millions of buyers around the world. As an Etsy Inc. employee, whether a team member of Etsy, Reverb, or Depop, you will tackle unique, meaningful, and large-scale problems alongside passionate coworkers, all the while making a rewarding impact and Keeping Commerce Human.

Etsy's Data 360 initiative mission is to empower our internal customers to find and leverage data efficiently. Our internal customers, who are analysts, product managers, applied scientists and more, navigate Etsy’s vast data lake every day. As part of the Data Discovery team, you’ll help streamline their journey through Etsy’s vast data lake by developing systems that ensure data quality and governance. Under the new initiative, you’ll have opportunities to modernize Etsy’s relationship with data, and work on impactful, highly visible projects.

We use Python mainly, and we work with technologies like Google Cloud Platform (GCP), Terraform, Docker, Spark, Airflow, and BigQuery. We also use data governance technologies, such as Datahub and Great Expectations. Experience with any of these is helpful but not required. Above all, we value empathy towards our customers, curiosity, responsibility, and eagerness to tackle complex engineering problems, with a focus on data quality and discovery. We're looking for an engineer who embraces flexibility and adapts to the best tools and technologies, and has excellent communication skills that can work with our internal customers. An engineer who likes to share their thought process while debugging or designing projects to foster team learning and growth would thrive in this role.

The technical staff at Etsy believes that code is craft, and that the work we do is part of a larger creative culture that includes the hundreds of thousands of inspired artists and designers who make Etsy such a unique marketplace. We believe that small, empowered, self-motivated teams can do big things. We believe in measuring everything and taking advantage of our continuous deployment system to ship code early and often. We have a strong blameless culture based on trust and a commitment to learning. 


This is a full-time position reporting to the Engineering Manager, Data Discovery. In addition to salary, you will also be eligible for an equity package, an annual performance bonus, and our competitive benefits that support you and your family as part of your total rewards package at Etsy.

For this role, we are considering candidates based in the United States. Candidates living within commutable distance of Etsy’s Brooklyn Office Hub may be the first to be considered. For candidates within commutable distance, Etsy requires in-office attendance once or twice per week depending on your proximity to the office. Etsy offers different work modes to meet the variety of needs and preferences of our team. Learn more details about our work modes and workplace safety policies here.

What’s this team like at Etsy? 

  • We help Etsy employees use our data lake as efficiently as possible by making it easier to navigate and discover. By cataloging metadata about our data lake and making it accessible, we empower our customers to find the information they need quickly and easily.

  • We are redefining Etsy’s data governance standards to provide a consistent and predictable user experience for the hundreds of Etsy employees that use data to make product decisions, build data-powered experiences, and more.

  • We design and implement components in our system that proactively identify data quality issues, enhance the data discovery experience, signal high-quality data, and more.

  • We collaborate closely with a variety of teams at Etsy including product engineers, business analysts, and machine learning teams. In addition, we partner closely with our vendors that allows us to help shape new features.

What does the day-to-day look like?

  • You will develop metrics, tools, and dashboards to understand data storage and usage patterns.

  • You will collaborate with other Etsy engineering teams to optimize data storage and access, and build tools to support these processes.

  • You will work closely with internal customers to understand their struggles and come up with engineering solutions to address them.

  • You will guide our roadmap, design, and implement solutions to improve how customers discover data, and manage technical debt.

  • You will mentor peers and less experienced engineers by sharing best practices and feedback.

  • Of course, this is just a sample of the kinds of work this role will require! You should assume that your role will encompass other tasks too. Your job duties and responsibilities may change from time to time at Etsy's discretion, or otherwise applicable with local law.

Qualities that will help you thrive in this role are:

  • You are comfortable with Python.

  • You have familiarity with some of the following: 

    • A cloud platform such as AWS, GCP or Azure 

    • Building and monitoring cloud services using Docker/kubernetes

    • Infrastructure as code technologies such as Terraform, AWS Cloud Formation, Ansible, etc

    • Big Data experience with tools such as Spark, BigQuery, and etc.

    • Data governance tools such as Datahub, Great Expectations, and etc.

  • You understand that being an effective software engineer is about communicating with people (especially those with different expertise and backgrounds) as much as it is about writing code.

  • You are eager to design and implement technical solutions to address customer needs related to data quality and discoverability.

  • You are flexible with languages and tools, and are willing to learn whatever is necessary to get the job done.

What's Next
If you're interested in joining the team at Etsy, please share your resume with us and feel free to include a cover letter if you'd like. As we hope you've seen already, Etsy is a place that values individuality and variety. We don't want you to be like everyone else -- we want you to be like you! So tell us what you're all about.

 

Our Promise
At Etsy, we believe that a diverse, equitable and inclusive workplace furthers relevance, resilience, and longevity. We encourage people from all backgrounds, ages, abilities, and experiences to apply. Etsy is proud to be an equal opportunity workplace. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. If, due to a disability, you need an accommodation during any part of the interview process, please let your recruiter know. While Etsy supports visa sponsorship, sponsorship opportunities may be limited to certain roles and skills.

Additional Information

What's Next
If you're interested in joining the team at Etsy, please share your resume with us and feel free to include a cover letter if you'd like. As we hope you've seen already, Etsy is a place that values individuality and variety. We don't want you to be like everyone else -- we want you to be like you! So tell us what you're all about.

Our Promise
At Etsy, we believe that a diverse, equitable and inclusive workplace furthers relevance, resilience, and longevity. We encourage people from all backgrounds, ages, abilities, and experiences to apply. Etsy is proud to be an equal opportunity workplace. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. If, due to a disability, you need an accommodation during any part of the interview process, please let your recruiter know. While Etsy supports visa sponsorship, sponsorship opportunities may be limited to certain roles and skills.

Etsy

Website: https://www.etsy.com/

Headquarter Location: Brooklyn, New York, United States

Employee Count: 1001-5000

Year Founded: 2005

IPO Status: Public

Last Funding Type: Post-IPO Equity

Industries: Consumer Goods ⋅ E-Commerce ⋅ Internet ⋅ Retail ⋅ Sales