Senior DataBricks, Python

Posted:
3/12/2025, 8:23:29 AM

Experience Level(s):
Senior

Field(s):
Software Engineering

Important Information 

Location: Peru, Colombia, Costa Rica, Bolivia 

Work Mode: Remote 

Job Summary 

As a Senior DataBricks, Python (14080), you will be responsible for designing, developing, and maintaining high-quality software solutions. You will collaborate with cross-functional teams to understand business requirements and translate them into scalable and efficient software applications. Your role will involve leading technical projects, mentoring junior engineers, and continuously improving software development practices to ensure the delivery of robust and reliable software systems.  

Responsibilities and Duties 

  • Design and optimization of ETL pipelines in Databricks and Python
  • Development of real-time and batch data processing
  • Performance optimization in Apache Spark and Delta Lake
  • Monitoring and troubleshooting of Databricks clusters
  • Collaboration with data and business teams for modeling and architecture
  • Implementation of CI/CD for Databricks notebooks and scripts
  • Management of workloads in Azure, AWS, or GCP

Qualifications and Skills 

  • Bachelor’s degree in computer science, software engineering, or a related field.  
  • Extensive experience in software development with a focus on designing and building scalable applications. 
  • Professional/ Advanced English skills. 
  • +5 years of experience. 
  • Experienced automation engineer writing end-to-end tests.
  • Proficient in SQL. Should understand complex SQL queries about transformations data undergo to effectively write expected behaviors
  • Basic knowledge of Databricks. Should know the basics about catalogs/schemas/tables and how to run queries against an existing warehouse
  • Basic knowledge on DBT. Must at the very least know the structure of a DBT project and how to write seeds.

About Encora 
 
Encora is a global company that offers Software and Digital Engineering solutions. Our practices include Cloud Services, Product Engineering & Application Modernization, Data & Analytics, Digital Experience & Design Services, DevSecOps, Cybersecurity, Quality Engineering, AI & LLM Engineering, among others.  

At Encora, we hire professionals based solely on their skills and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.