Hi, is Verónica from CI&T!I am a Talent Attracting Analyst looking for people located in Brazil for a Data Engineer Position to join us!
As a Data Engineer, you will play a pivotal role in optimizing our data infrastructure and ensuring seamless data migration processes. You will be responsible for migrating data from our current PostgreSQL database to AWS DynamoDB, leveraging your expertise to enhance our data architecture and support our cross-functional teams. Your work will directly impact our ability to derive insights from data, enabling data-driven decision-making across the organization. In this role, you will implement efficient data models for DynamoDB, taking into account its unique non-relational structure and access patterns. You will collaborate closely with developers, data scientists, and project managers to troubleshoot issues and streamline workflows, ensuring
successful project delivery.
Key Responsibilities:
● Implement data migration processes from PostgreSQL to AWS DynamoDB, ensuring data integrity and minimal downtime.
● Utilize ETL processes and data migration tools to facilitate efficient data transfers and transformations between SQL and NoSQL databases.
● Automate data migration tasks using programming languages such as Python and Bash, along with AWS SDKs, to improve efficiency and reduce manual effort.
● Optimize data models for DynamoDB, considering its non-relational structure and access patterns to enhance performance.
● Collaborate with cross-functional teams, including developers, data scientists, and project managers, to troubleshoot data-related issues and streamline workflows.
● Create and maintain comprehensive documentation for data migration processes, data mappings, and system configurations to support knowledge sharing.
● Monitor and optimize data loading and query performance in both PostgreSQL and DynamoDB to ensure the reliability and scalability of the data infrastructure.
Requirements
● Proven experience in database management and data migration, specifically with PostgreSQL and AWS DynamoDB.
● Familiarity with data migration tools and techniques, including ETL processes and best practices for migrating data between SQL and NoSQL databases.
● Strong understanding of AWS services, particularly AWS DynamoDB, AWS Lambda, and AWS Data Pipeline, including their architecture, features, and configurations.
● Ability to design and implement efficient data models for DynamoDB, considering its non-relational structure and access patterns.
● Proficiency in programming languages (e.g., Python, Bash) and experience with tools like AWS SDKs to automate data migration tasks.
● Knowledge of strategies for optimizing data loading and query performance in both PostgreSQL and DynamoDB.
● Experience with version control systems (e.g., Git) and collaborative tools (e.g., JIRA, Confluence) to manage project workflows.
● Strong analytical and problem-solving abilities to troubleshoot and resolve issues during the migration process.
● Ability to create comprehensive documentation for migration processes, data mappings, and system configurations.
● Excellent communication skills to collaborate with cross-functional teams, including developers, data scientists, and project managers, ensuring successful project.
Our benefits:
- Health plan and dental plan;
- Meal allowances;
- Childcare assistance;
- Extended parenting leave;
- Gympass
- Annual profit-sharing distribution;
- Life insurance;
- Partnership with an online mental health platform;
- CI&T University;
- Discount Club;
- Support Program: financial; psychological guidance; nutritionist and more;
- Pregnancy course and responsible parenthood;
- Partnership with online course platforms
- Platform for language learning;
- And many others.
#LI-MR4