Role Description

Responsibilities

• Participate in data migration from legacy platforms to Databricks and develop scalable, efficient, and cost-optimized data pipelines
• Build and integrate data health metrics and quality management tools, ensuring robust data governance and consistent standards
• Design and maintain tools for efficient data investigations, issue detection, and automated mitigation to uphold data quality and consistency
• Replace outdated infrastructure with modern systems and provide operational support for critical data pipelines
• Solve complex data integration challenges using optimal ETL patterns, frameworks, and techniques for structured and unstructured data
• Collaborate with cross-functional teams to meet technical and business needs while fostering a culture of innovation and continuous improvement
• Define and manage SLAs for high-priority datasets, including those driving critical (P0) business metrics
• Apply Agile methodologies and industry best practices to ensure consistent delivery and alignment with business objectives

Many teams at Dropbox run Services with on-call rotations, which entails being available for calls during both core and non-core business hours. If a team has an on-call rotation, all engineers on the team are expected to participate in the rotation as part of their employment. Applicants are encouraged to ask for more details of the rotations to which the applicant is applying

Requirements

• 5+ years of experience in data engineering or related roles
• Bachelor’s degree or foreign equivalent in Computer Science or a closely related field
• Proven experience with data migration projects, specifically to Databricks
• Strong expertise in data health metrics, data governance, and quality management, with experience integrating tools like Monte Carlo and Atlan
• Solid experience in building and maintaining data pipelines and infrastructure
• Excellent problem-solving skills and the ability to troubleshoot complex data issues
• Strong programming skills in Python, Scala, or Java
• Demonstrated ability to innovate and drive accountability within a team
• Experience with version control systems like Git and test automation and CICD