Seeking to hire a Contractor based out of Brazil or Argentina for Lead-Level Data Engineering Services.
Scope of Services:
- As a Contractor you will work alongside app developers and data stakeholders to create data system changes and to respond to data inquires
- You will Lead initiatives and problem definition scoping, design, and planning through epics and blueprints.
- With your deep domain knowledge and radiation of that knowledge you will develop documentation, technical presentation, discussion, and incident reviews.
- You will build and maintain data pipelines and DAG tooling
- You will establish and maintain a data catalog with business-related metadata
Skills & Experience:
- Mastered proficiency in SQL, Python, and relational datastores (columnar and row databases)
- Proficiency in building and maintaining data pipelines and DAG tooling (Dagster, Airflow, etc)
- Advanced experience with event-based pipelines and CDC tooling
- Advanced experience in managing large-scale data migrations in relational datastores
- Advanced experience in optimizing SQL query performance
- Advanced experience with data testing strategies to ensure resulting datastores are aligned with expected business logic
- Experience with DBT orchestration and best practices
- Experience with enabling monitoring, health checks and alerting on data systems and pipelines
- Experience establishing and maintaining a data catalog with business-related metadata
- Experience building tools and automation to run data infrastructure
- Experience with writing and maintaining cloud-based infrastructure for data pipelines (AWS, GCP and Terraform) is a plus
- Experience in document, graph or schema-less datastores is a plus
Please note that given the nature of the contract, this role will not be eligible to participate in company-sponsored benefits.