Lead Data Engineer

Important Information

Location: India

Experience: 8 years

Job Mode: Full-time

Work Mode: Work from home/On-site/Hybrid

Job Summary

As a Lead Data Engineer, you will provide technical guidance and supervision to data teams and help develop advanced analytics solutions to optimize data value for partnered organizations. You will ensure company and industry standards are met and tackle unique challenges using your skills in programming, statistics, and data analysis, along with your business knowledge and leadership.

Responsibilities and Duties

• Collaborate and partner with Business Analyst teams located in US and EMEA regions.

• Interface across our Business Analyst and Data Science teams

• Play a key role in integrating new data sources into our data & analytical ecosystem over AWS cloud

• Implement data lake solutions while addressing common data concerns, such as data quality, data governance

• Set the standard for technical excellence as we move / build our data ecosystem into the cloud

• understanding their common data problems and deliver scalable solutions

Qualifications and Skills

• 7-10 years of strong development experience performing ETL and/or data pipeline implementations.

• Expert in programming languages, preferably Python.

 • Expert in delivering end-to-end analytic solutions using AWS services (EMR, Airflow, S3, Athena, Kinesis, Redshift).

• Experience in batch technologies like Hadoop, Hive, Athena, Presto.

• Strong SQL skills, including query optimization, schema design, complex analytics.

• Expert in data modeling and metadata management like Glue Catalog etc.

• Experience in deployment tools like GitHub actions, Jenkins, AWS Code Pipeline etc.

• Experience in data quality tools like Deque or Great Expectations is Nice To Have

Role Specific requirement:

• Strong Experience in SQL, EMR, AWS, Pyspark, Python, EMR, Airflow

About Encora

Encora is the preferred digital engineering and modernization partner of some of the world’s leading enterprises and digital native companies. With over 9,000 experts in 47+ offices and innovation labs worldwide, Encora’s technology practices include Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering.

At Encora, we hire professionals based solely on their skills and qualifications, and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.