Job Posting Title:

Sr Data Engineer I

Req ID:

10152028

Job Description:

An employee at the Disney Entertainment & ESPN Technology On any given day at Disney Entertainment & ESPN Technology, we’re reimagining ways to create magical viewing experiences for the world’s most beloved stories while also transforming Disney’s media business for the future. Whether that’s evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to maximize flexibility and efficiency, or delivering Disney’s unmatched entertainment and sports content, every day is a moment to make a difference to partners and to hundreds of millions of people around the world. A few reasons why we think you’d love working for Disney Entertainment & ESPN Technology:

● Building the future of Disney’s media business: DE&E Technologists are designing and building the infrastructure that will power Disney’s media, advertising, and distribution businesses for years to come.

● Reach & Scale: The products and platforms this group builds and operates delight millions of consumers every minute of every day – from Disney+ and Hulu to ABC News and Entertainment, to ESPN and ESPN+, and much more.

● Innovation: We develop and execute groundbreaking products and techniques that shape industry norms and enhance how audiences experience sports, entertainment & news. Engineering Services designs, builds, and sustains technology that powers DE&E Technology’s worldwide content production and distribution platforms. In doing so, they contribute to a series of cross-functional services and technologies, including Quality Assurance, Data Analytics, Software Development, Broadcast Infrastructure, and Networking & Security. s level is establishing skill/knowledge in a given functional field, likely building on a minimal amount of professional experience

The Core Data team within the Data organization at DEET is seeking a Senior Data Engineer to drive the design, development, and operational excellence of our foundational streaming and batch data pipelines. Core Data is the backbone of the data organization — we own end-to-end ingestion infrastructure that lands datasets for identity, commerce, telemetry, experimentation, and more, serving dozens of downstream engineering, analytics, ML, and operational teams across Disney's streaming platforms.

As a Senior Data Engineer on Core Data, you will own high-throughput, low-latency streaming pipelines and largescale batch processing systems that handle billions of events daily. You will assist in the technical direction for pipeline architecture, drive data quality and observability initiatives, and partnering cross-functionally to evolve our platform. This is a hands-on technical role where you will architect solutions, write production code, and set engineering standards that scale across the organization.

• Architect and development of high-throughput streaming pipelines (Spark Structured Streaming, Kinesis) and batch data pipelines (Spark, Databricks) processing billions of events daily across identity, commerce, telemetry, and experimentation domains

• Own end-to-end pipeline lifecycle from ingestion through transformation, orchestration, and delivery — ensuring data lands accurately, on time, and in the right shape for downstream consumers

• Design and implement scalable data platform components in Scala and Python/PySpark, including shared libraries, schema evolution strategies, and reusable pipeline patterns that standardize development across the Data organization

• Drive data observability and reliability — build and maintain monitoring, alerting, anomaly detection, and SLA enforcement systems that provide a single pane of glass into pipeline health

• Implement and evolve the Lakehouse architecture on Databricks (Unity Catalog, Delta Lake) — designing table structures, partitioning strategies, and access patterns that optimize for both streaming and batch workloads.

• Ensure operational excellence — maintain strict uptime SLAs, participate in on-call rotations, drive incident response, and lead post-mortems to continuously improve system resilience.
• Collaborate cross-functionally with product managers, architects, data scientists, and partner engineering teams to prioritize platform investments, define roadmaps, and deliver high-impact data products

• Champion data quality and governance — implement data contracts, validation frameworks, reconciliation processes, and documentation standards that ensure trust in Core Data datasets

• Optimize for cost and performance — tune Spark jobs, right-size clusters, optimize Kinesis shard configurations, and drive infrastructure cost efficiency without sacrificing reliability

• Contribute to CI/CD and automation — improve deployment pipelines, infrastructure-ascode (Terraform), and developer tooling that reduces toil and accelerates delivery.

Basic Qualifications:

● 5+ years of data engineering experience building and operating large-scale data pipelines in production

● Strong programming skills in Scala (primary) and Python/PySpark

● Deep experience with Apache Spark (batch and Spark Structured Streaming) at scale

● Proficiency with Databricks platform (Delta Lake, Unity Catalog, Workflows, cluster management)

● Strong experience with streaming technologies (Kinesis, Kafka, or equivalent) for real-time data ingestion

Preferred Qualification:

● Advanced SQL skills with ability to write complex, performance-optimized queries

● Hands-on experience with AWS cloud services (S3, Kinesis, IAM, CloudWatch) ● Experience with workflow orchestration systems such as Airflow for creating and maintaining data pipelines

● Excellent problem-solving, analytical, and communication skills Preferred Qualifications

● Experience with schema registries, schema evolution, and data observability systems (monitoring, alerting, anomaly detection, lineage)

● Familiarity with Snowflake for data warehousing and cross-platform data sharing

● Deep understanding of data modeling techniques and Data Warehousing standard methodologies and practices

● Experience with Infrastructure as Code (Terraform) and CI/CD pipelines (GitHub Actions, Jenkins)

● Familiar with Scrum and Agile methodologies.

Required Education:
● Bachelor's or master's degree in computer science, Information Systems, or equivalent industry experience.

Job Posting Segment:

Disney Entertainment and ESPN Product & Technology

Job Posting Primary Business:

Commerce, Data & Identity

Primary Job Posting Category:

Data Engineering

Employment Type:

Full time

Primary City, State, Region, Postal Code:

Bangalore, India

Alternate City, State, Region, Postal Code:

Date Posted:

2026-07-06