Technical Delivery Lead - Databricks

Posted:
8/21/2024, 5:00:00 PM

Location(s):
Melbourne, Victoria, Australia ⋅ Victoria, Australia

Experience Level(s):
Senior

Field(s):
Data & Analytics

We are seeking a seasoned technical delivery lead to join our team and play a key role in implementing the regulatory reporting (like International Financial Reporting Standard (IFRS) 17) using Databricks on Microsoft Azure.

The Opportunity:

We are seeking a seasoned technical delivery lead to join our team and play a key role in implementing the regulatory reporting (like International Financial Reporting Standard (IFRS) 17) using Databricks on Microsoft Azure. You will be responsible for designing, developing, and maintaining a robust and scalable data solution to support our regulatory reporting requirements within the Azure cloud environment.

This is a 6-month initial contract starting ASAP.

To do this successfully you will:

  • Work closely with business stakeholders, finance, actuaries to understand data requirements and business rules for regulatory reporting like IFRS17 and translate them to technical requirements for data engineering team.
  • Define a detailed technical solution and manage technical delivery of the data engineering team (onshore and offshore) in alignment to business requirements and overall solution architecture.
  • Led a team of data engineers (both onshore and offshore) to develop data pipelines using on Azure Databricks for ingestion, curation, enrichment and transformation of finance and non-finance data as per requirements.
  • Leverage your knowledge of best practices of Azure services like Azure Data Lake Storage and Azure Data Factory to optimize data storage, access, and orchestration within the data platform.
  • Take full responsibility for delivery of fit-for-purpose Data solutions, by working closely with Project Managers – providing inputs on technical tasks required, estimations and overseeing release management processes to ensure successful project implementation.
  • Collaborate with key stakeholders across Business, Finance, Actuaries, IT teams (local and offshore) to ensure the solution meets their needs for regulatory reporting.
  • Mentor and support a team of data engineers (both onshore and offshore), in development of engineering best practice and doing code reviews etc

To be successful in this position you will have.

  • Proven experience in leading technical delivery on Databricks projects and minimum five years of experience working as a data engineer or similar role.
  • Proven experience in designing and developing ETL pipelines using Databricks / Spark/ Python
  • Good knowledge of Microsoft Azure cloud platform and broader Databricks ecosystem (Azure Data Lake Storage, Azure Data Factory, Databricks notebooks, clusters, libraries, workflow, Unity Catalog etc).
  • Experience of CI/CD pipelines for deploying code and models with Databricks
  • Experience with SQL and knowledge of data warehousing concepts and practices
  • Experience working in a fast-paced, Agile environment.
  • Strong communication and collaboration skills.
  • Certification in Databricks will be highly regarded.
  • Experience in building finance related regulatory reporting solution like IFRS17 in banking / insurance industry is not mandatory but highly regarded.

Why choose AIA:

At AIA, we’ve made a promise to help people live healthier, longer, better lives. And it starts with our own people.

  • Work for a business helping millions of Australians and make a difference to someone’s life everyday
  • Enjoy wonderful Health and Wellbeing initiatives that support you
  • Work with supportive and inclusive managers
  • Flexible working arrangement

At AIA Australia, we’re proud to help guide, support and protect the wellbeing of over 3.5 million Australians. As part of the AIA Group - the largest independent publicly listed pan-Asian life insurance group – it is our ambition to engage one billion people to live Healthier, Longer, Better Lives by 2030.  Lots of companies like to say they’re different. What makes us truly different at AIA, is the difference we make in people’s lives. We are proud that this difference has been recognised in the 2023 ANZIIF awards by being named Life Insurance Company of the Year.

AIA is different. Are you?

If you want to be part of an organisation that helps people live better every single day simply apply now.