Senior Data Engineer

Posted:
10/24/2024, 5:00:00 PM

Location(s):
Karnataka, India

Experience Level(s):
Senior

Field(s):
Data & Analytics

Job Requisition ID #

24WD82866

Position Overview 

Data Engineers will be responsible for designing, building, maintaining, monitoring, integrating, and testing scalable data pipelines in production. You will partner with multi-disciplinary teams such as Machine Learning Engineering, Platform Engineering, Data Analysts on coordinating delivery of pipelines for specific business needs. Your work will contribute to strategic initiatives such as optimization of digital conversion metrics and development of Autodesk Assistant, an LLM-driven chatbot intended to answer customer inquiries. Our team culture is built on collaboration, mutual support, and continuous learning. We emphasise an agile, hands-on, and technical approach at all levels of the team. As a group, we want to continuously improve our work as well as our knowledge of trends and techniques relevant to our areas. We encourage personal development and knowledge sharing. 

Responsibilities 

  • Data Pipeline Construction: Design, build, and maintain scalable data pipelines to support continuous data flow and analytics

  • Data Modeling: Develop and implement effective data models and schemas to ensure data integrity and accessibility

  • Database Management: Oversee and optimize database systems (SQL, NoSQL) ensuring high performance and availability

  • Data Integration: Integrate data from various sources, ensuring consistency, quality, and reliability

  • ETL Processes: Design and manage Extract, Transform, Load (ETL) processes to move data between systems

  • Data Governance: Implement and enforce data governance policies to ensure data security, privacy, and compliance

  • Collaboration: Work closely with data scientists, analysts, and stakeholders to understand data requirements and deliver solutions

  • Performance Tuning: Enhance and tune database performance for efficient processing and querying of large datasets

  • Documentation: Maintain comprehensive documentation for data processes, models, and architecture

  • Platform Mindset: Partner with internal platform team on the following tasks

  • Provide technical leadership and mentorship for less-experienced members of the team

  • Demonstrate experience working in cross-functional teams to deliver data engineering solutions in production

Minimum Qualifications 

Technical Skills: 

  • 5 to 8 years of experience in Data Engineering

  • Proficiency in programming languages such as Python or Scala

  • Strong knowledge of SQL and experience with relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra)

  • Knowledge of big data technologies and frameworks (e.g., Kafka, Flink, Parquet, Iceberg, etc) 

  • ETL Tools: Skilled in using ETL tools like Apache Airflow

  • Experience with AWS cloud services ,data-related services like AWS Glue, EMR, Redshift, and S3

  • Experience with data warehousing solutions like Snowflake, Redshift, or Hive

  • Understanding of data modeling, data architecture, and ETL processes

  • Experience with version control systems (e.g., Git) and continuous integration/continuous deployment pipelines

  • Strong problem-solving abilities and attention to detail

  • Ability to analyse complex datasets and derive actionable insights

  • Experience with data visualisation tools

  • Excellent communication and collaboration skills

  • Ability to work effectively in a team-oriented environment

  • Strong organizational and time-management abilities


#LI-AK1 

Learn More

About Autodesk
Welcome to Autodesk! Amazing things are created every day with our software – from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.

We take great pride in our culture here at Autodesk – our Culture Code is at the core of everything we do. Our values and ways of working help our people thrive and realize their potential, which leads to even better outcomes for our customers.

When you’re an Autodesker, you can be your whole, authentic self and do meaningful work that helps build a better future for all. Ready to shape the world and your future? Join us!

Salary transparency

Salary is one part of Autodesk’s competitive compensation package. Offers are based on the candidate’s experience and geographic location. In addition to base salaries, we also have a significant emphasis on discretionary annual cash bonuses, commissions for sales roles, stock or long-term incentive cash grants, and a comprehensive benefits package.

Diversity & Belonging
We take pride in cultivating a culture of belonging and an equitable workplace where everyone can thrive. Learn more here: https://www.autodesk.com/company/diversity-and-belonging

Are you an existing contractor or consultant with Autodesk?

Please search for open jobs and apply internally (not on this external site).

Autodesk

Website: http://www.autodesk.com/

Headquarter Location: San Francisco, California, United States

Employee Count: 10001+

Year Founded: 1982

IPO Status: Public

Last Funding Type: Seed

Industries: 3D Technology ⋅ Architecture ⋅ Construction ⋅ Manufacturing ⋅ Software ⋅ Software Engineering