Senior Big Data Engineer (Python & Spark) - (ODS)

Posted:
6/23/2024, 5:00:00 PM

Location(s):
Madrid, Community of Madrid, Spain ⋅ Community of Madrid, Spain

Experience Level(s):
Senior

Field(s):
DevOps & Infrastructure ⋅ Software Engineering

Workplace Type:
Remote

Senior Big Data Engineer (Python & Spark) - Openbank

Country: Spain

Open Digital Services is a tech company with a unique culture, dedicated to creating innovative products for Santander Group Affiliates. Open Digital Services is part of the Retail & Commercial Division of Santander Group, one of the world's largest financial institutions and the Eurozone's leader, we're committed to being the best Digital Bank with Branches in the industry.    

Our mission at ODS is to design and support an advanced digital and omnichannel platform, ensuring the best customer experience using cutting-edge technology. Openbank, our flagship partner, is where we develop our most advanced concepts. Be part of our Best-in-Class tech team and help us create unique value for our customers! 

Join us to tackle exciting tech challenges in an agile environment, benefiting from learning, growth, and local and international career opportunities in a modern, diverse setting.

Responsibilities:

  • Design and implement production big data environments using modern technologies.

  • Build, validate, and optimize large-scale, big data solutions in heterogeneous data environments.

  • Develop and manage ETLs in batch and streaming (Apache flink)

To be successful in the role you must have:

  • 3+ years of experience working with Python, Spark, software design patterns, and TDD.

  • Experience working with big data – Spark or PySpark is a must – Hadoop, Hive, and/or Kafka would be a plus.

  • Experience with different database structures, including SQL (Postgres, MySQL), and NOSQL (DynamoDB, DocumentDB, Redis, Elasticsearch).

  • Experience and expertise across data integration and data management with high data volumes.

  • Experience with Cloud ecosystems, AWS ecosystem (EMR, EC2, IAM, GLUE, ATHENA, S3, CloudFormation, LakeFormation, Redshift, DynamoDB, RDS, ECS & ECR) would be a great plus!

  • Experience working in agile continuous integration/DevOps paradigm and tool set (Git, Jenkins, Sonar, Nexus, Jira, and Splunk).

  • Bachelor’s Degree in Computer Science, Information Systems, Mathematics, or other STEM, and related fields, or equivalent work experience.

  • Professional working proficiency in English.

Nice to have:

  • Experience with data warehousing, apache iceberg, and visualisation tools.

  • Experience with NRT applications: Apache Flink, spark streaming.

What do we offer?

  • Joining a dynamic and agile environment, with plenty of opportunities to grow, and have impact!
  • We are a flexible and fast adapting team currently working remotely most of the time using all kinds of communication tools!
  • Working in a start-up mode with the support of Santander Group in a growing and expansion project.
  • Competitive remuneration and attractive benefits package.
  • Collaboration in international projects with peers from all around the globe.
  • Excellent work environment, social clubs, and frequent events.

ODS is an equal opportunity employer. All applicants will be considered as equal without paying attention to gender identity, sexual orientation, ethnicity, religion, age, political orientation, union membership nor disability status.

We make recruiting decisions based on your experience and skills. We value your passion to discover, invent, simplify and build.

The personal data you provide as well as any data generated during the selection process are confidential and will be processed by Open Bank, S.A./ Open Digital Services, S.L. with registered office at Plaza de Santa Bárbara 2, 28004 (Madrid), for the sole purpose of managing your participation in the selection processes and, where appropriate, to formalise your recruitment. 

For further information about your rights and data protection, please read the ODS/Openbank Privacy Policy applicable to this type of data processing here.

OBTECH22 OBDATA22