Organization: At CommBank, we never lose sight of the role we play in other people’s financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Together we can achieve great things.

Job Title: Principal Data Engineer
Location: Bangalore-Manyata Tech Park
Business & Team: Technology Delivery

Impact &contribution: Here, you’ll thrive. You’ll be supported when faced with challenges and empowered to tackle new opportunities. We’re hiring engineers from across India and have opened technology hubs in Bangalore. We really love working here, and we think you will too.
 

Roles & responsibilities:

• Defines technical strategy for key business areas, contributing to roadmaps.

• Identifies disruptive technologies and drives adoption where beneficial.

• Works on solutions and shapes the technical direction of a crew or several teams in their BU.

• Leads implementation of complex initiatives with impact across several teams.

• Designs and shares resilient solutions with high fault tolerance and graceful degradation.

• Identify and drive differentiating outcomes around toil reduction, efficiency and new capability.

• Influences crew leadership on technical matters.

• Drives cross-functional technical alignment across multiple business units.

• Builds a culture of trust where team members feel confident to share their ideas and concerns.

Essential Skills:

• 15-18 years of experience as a Data Engineering professional in a data-intensive environment.

• The individual should have strong analytical and reasoning skills in the relevant area.

• Proficiency in AWS cloud services, specifically EC2, S3, Lambda, Athena, Kinesis, Redshift, Glue, EMR, DMS, Event Bridge, DynamoDB, IAM, Secret Manager, KMS, Step functions, SQS, SNS,

• Experience in Cloud Foundation (CFN), Cloud Development Kit (CDK) and Software Development Kit (SDK).Exposure to MSK, Flink, Iceberg [good to have]

• Cloud Watcher, User Notification, Appflow, Fargate, ECS, EKS, Airflow, Boto3, RDS, Sagemaker, IAM, , Cookie Cutter.

• Excellent skills in Python-based framework development are mandatory.

• Proficiency in SQL for efficient querying, managing databases, handling complex queries, and optimizing query performance.

• Excellent automation skills are expected in areas such as:

  • Automating the testing framework and various test cases including unit, integration, functional tests, and mock-ups using tools such as PyPy, Pytest

  • Modularisation and automating the data pipeline and expediting tasks such as data ingestion and transformation using various tools like DBT.

  • API-based automated and integrated calls (REST, cURL, authentication & authorization, tokens, pagination, open Api, Swagger).

  • Implementing advanced engineering techniques and handling ad hoc requests to automate processes on demand.

  • Implementing automated and secured file transfer protocols like XCOM, FTP, SFTP, and HTTP/S.

Education Qualification:

• Bachelor’s degree or master’s degree in engineering in Computer Science/Information Technology

Advertising End Date: 30/12/2025