The role:

Euronext is seeking a talented data engineer with expertise in AWS or Azure and a strong background in solution architecture, database management, and data engineering. The ideal candidate will have experience with AWS and Azure services, along with proficiency in Python, SQL, and database technologies. Experience with Iceberg tables for managing large datasets is highly desirable.

As a data engineer, you will be responsible for designing, implementing, and maintaining scalable data solutions and pipelines using various tools and platforms. You will collaborate with cross-functional teams to develop robust data pipelines, ETL processes, and orchestration workflows. Strong production awareness and troubleshooting skills are essential.

Key Accountabilities:

Design and Implement Cloud Solutions

• Utilise expert knowledge of AWS and Azure services such as Lambda, Glue, Step Functions, Azure Functions, Azure Databricks and Azure Data Factory to design, implement, and maintain scalable and efficient data solutions on cloud platforms.

Solution Architecture and Cloud Infrastructure

• Develop robust solution architectures and cloud infrastructure designs, considering factors such as scalability, performance, security, and cost optimisation.
• Demonstrate knowledge in cloud networking, including VPCs, subnets, security groups, and routing tables, to ensure secure and reliable data transmission.

Data Engineering and Database Management

• Data Modelling: Design efficient data models for optimal query performance.
• SQL Proficiency: Write and optimise SQL queries.
• ETL and Data Integration: Extract, transform, and load data into Redshift, MySQL, PostgreSQL, or Azure SQL Database.
• Security and Compliance: Implement security measures and ensure compliance.
• Cloud Integration: Integrate data solutions with other AWS or Azure services.
• Monitoring and Troubleshooting: Monitor performance and resolve issues.

Orchestration and Workflow Management

• Implement orchestration solutions using tools like Apache Airflow, AWS Step Functions, or Azure Logic Apps to automate and manage data workflows effectively.

Technical Leadership and Solution Documentation

• Provide technical guidance to the business lines, acting as a subject matter expert in AWS, Azure, and data engineering technologies.
• Write comprehensive solution documents and technical documentation to communicate architecture designs, data workflows, and best practices effectively.

Proactive Production Awareness and Troubleshooting

• Demonstrate production awareness by proactively monitoring system health, automating checks, and anticipating potential issues to ensure smooth operation of data solutions.
• Utilise strong troubleshooting skills to identify and resolve issues promptly, minimising downtime and impact on business operations.

Continuous Improvement and Innovation

• Stay updated on emerging technologies and industry trends, continuously evaluating and incorporating new tools and techniques to enhance data engineering processes and infrastructure.
• Take a proactive approach to challenge business requirements and propose innovative solutions to improve efficiency, scalability, and performance.

Knowledge, Skills and Experience:

• BS/MS degree in Computer Science, Engineering or equivalent working experience
• Proficiency in Python, SQL, and Databases: Strong programming skills in Python and experience with relational databases (MySQL, PostgreSQL, Redshift, Azure SQL Database) and NoSQL databases.
• Expertise in Cloud Services: Extensive experience with AWS and Azure services, particularly Lambda, Glue, Step Functions, Azure Functions, Azure Data Factory, Azure Databricks.
• Orchestration and Workflow Management: Experience with orchestration tools such as Apache Airflow for automating and managing data workflows.
• ETL Tools and Big Data Experience: Knowledge of ETL tools and experience working with large volumes of data, with a preference for Kafka experience.
• Production Awareness and Troubleshooting: Proactive approach to production monitoring and troubleshooting, with the ability to anticipate and mitigate potential issues.
• Strong Analytical and Problem-Solving Skills: Ability to analyse requirements, define technical approaches, and propose innovative solutions to complex problems.
• Documentation and Requirements Analysis: Experience in writing solution documents, technical documentation, and the ability to challenge and refine business requirements.
• English (B2 or higher level)
• Nice to have experience with Iceberg Tables: Familiarity with Iceberg tables for managing large datasets efficiently, ensuring data consistency, and supporting ACID transactions.
• Nice to have experience working on Dataiku

Euronext Values

Unity

•        We respect and value the people we work with

•        We are unified through a common purpose

•        We embrace diversity and strive for inclusion

Integrity

•        We value transparency, communicate honestly and share information openly

•        We act with integrity in everything we do

•        We don’t hide our mistakes, and we learn from them

Agility

•        We act with a sense of urgency and decisiveness

•        We are adaptable, responsive and embrace change

•        We take smart risks

Energy

•        We are positively driven to make a difference and challenge the status quo

•        We focus on and encourage personal leadership

•        We motivate each other with our ambition

Accountability

•           We deliver maximum value to our customers and stakeholders

•           We take ownership and are accountable for the outcome

•           We reward and celebrate performance

We are proud to be an equal opportunity employer. We do not discriminate against individuals on the basis of race, gender, age, citizenship, religion, sexual orientation, gender identity or expression, disability, or any other legally protected factor. We value the unique talents of all our people, who come from diverse backgrounds with different personal experiences and points of view and we are committed to providing an environment of mutual respect.

Additional Information

This job description is only describing the main activities within a certain role and is not exhaustive. It does not prevent to add more tasks, projects.