Sr Data Engineer - Data Activation & Sharing

Posted:
11/26/2024, 8:55:45 AM

Location(s):
New York, New York, United States ⋅ New York, United States

Experience Level(s):
Senior

Field(s):
Data & Analytics

Job Posting Title:

Sr Data Engineer - Data Activation & Sharing

Req ID:

10101295

Job Description:

About Disney Entertainment & ESPN Technology

On any given day at Disney Entertainment & ESPN Technology, we’re reimagining ways to create magical viewing experiences for the world’s most beloved stories while also transforming our media business for the future. Whether that’s evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to enhance flexibility and efficiency, or delivering Disney’s unmatched entertainment and sports content, every day is a moment to make a difference to partners and to hundreds of millions of people around the world.

A few reasons why we think you’d love working here:

  • Building the future of Disney’s media: DE&E Technologists are designing and building the infrastructure that will power our media, advertising, and distribution businesses for years to come.

  • Reach & Scale: The products and platforms this group builds and operates delight millions of consumers every minute of every day – from Disney+ and Hulu, to ABC News and Entertainment, to ESPN and ESPN+, and much more.

  • Innovation: We develop and implement groundbreaking products and techniques that shape industry norms and enhance how audiences experience sports, entertainment & news.

About The Role

We are looking for a Sr. Data Engineer to join the Data Activation team who can operate across the enterprise to ensure on-time, high-quality delivery of products and features that directly drive our business.

The Data Activation team, within the Product & Data Engineering business unit, is responsible for sharing data with internal customers and external 3rd party partners in a secure and reliable fashion, ensuing that “chain-of-custody” of our sensitive data is maintained at every step of the process.

Responsibilities                   

  • Interfacing with the key stakeholders to understand the business requirements

  • Designing and developing necessary data models, ETL's, reports, etc. as per requirements

  • Working with big data technologies such as Spark and cloud database technologies like Snowflake

  • Writing test scripts and automating where possible (using tools such as but not limited to Pyspark, bash scripting, python)

  • Participating in code reviews

  • Ensuring code is checked in as per company guidelines

  • Participating in weekly scrum meetings and daily stand up meetings

  • Contributing to ensure correct status in burn down charts

  • Ensuring QA sign off is obtained, fix any bugs as discovered

  • Supporting product signoff process and fix any issues / bugs discovered

  • Providing post go-live support for addressing any P1 issues

Preferred Qualifications

  • 5+ years of data engineering experience developing large data pipelines

  • Strong SQL skills and ability to create queries to extract data and build performant datasets

  • Hands-on experience with distributed systems such as Spark (via Databricks using Scala or Python) to query and process data.  

  • Experience with at least one major MPP (elastic map reduce) or cloud database technology (Snowflake, Redshift, Big Query).  Snowflake experience is strongly preferred.

  • Experience with AWS Cloud technologies (S3 at a minimum)

  • Solid experience with data integration toolsets (i.e Airflow) and writing and maintaining Data Pipelines

Required Education

  • Bachelor’s Degree in Computer Science, Information Systems or related field, or equivalent work experience.

  • Master’s Degree a plus

Additional Information

#DISNEYTECH

The hiring range for this position in New York, NY is $138,900 to $186,200 per year. The base pay actually offered will take into account internal equity and also may vary depending on the candidate’s geographic region, job-related knowledge, skills, and experience among other factors. A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.

Job Posting Segment:

Product & Data Engineering

Job Posting Primary Business:

PDE - Data Platform Engineering

Primary Job Posting Category:

Data Engineering

Employment Type:

Full time

Primary City, State, Region, Postal Code:

New York, NY, USA

Alternate City, State, Region, Postal Code:

Date Posted:

2024-11-26