RaceTrac Company Overview
Job Description:
The Data Integration Architect will be responsible for designing, implementing, and managing data integration solutions across the enterprise. This role involves leading the integration of various data sources, ensuring seamless data flow, and supporting advanced analytics and business intelligence initiatives. The data integration architect will create and maintain the blueprint for data ingestion, transformation, and storage. The architect will work closely with other IT teams, data engineers, and business stakeholders to create a cohesive data architecture that supports the organization's strategic goals.
Responsibilities:
- Develop comprehensive data integration architectures using tools such as Azure Data Factory, Databricks, and other ETL platforms.
- Oversee the integration of diverse data sources, ensuring data quality, consistency, and security across all systems.
- Work closely with data engineers, business intelligence teams, and application developers to ensure data integration aligns with business needs.
- Continuously evaluate and optimize data integration processes for performance, scalability, and cost-effectiveness.
- Automate workflows, deploy pipelines, and utilize CI/CD tools (e.g Jenkins, GitLab CI) to streamline the development and deployment process.
- Create and maintain detailed documentation of integration processes, data flow diagrams, and architecture blueprints.
- Leverage automation and orchestration tools to streamline and automate data integration workflows.
- Implement schedulers, workflow engines, and monitoring tools to orchestrate ETL processes, manage dependencies, and monitor performance.
- Ensure all data integration processes comply with industry standards and organizational policies, including data security and privacy regulations.
- Lead the resolution of data integration issues, providing support to internal teams and ensuring minimal disruption to business operations.
Qualifications:
- Bachelor’s degree in Computer Science, Information Technology, or a related field is required.
- 7+ years of experience in data integration, ETL processes, and data architecture.
- Proven experience with cloud-based platforms, especially Azure.
- Experience with Databricks, Power BI, and other enterprise data tools.
- Proficiency in ETL tools like Azure Data Factory, Databricks, or Talend.
- Strong understanding of SQL, Python, and data modeling.
- Knowledge of cloud computing and data services on platforms like Azure.
- Strong analytical and problem-solving skills.
- Excellent communication and teamwork abilities.
- Ability to manage multiple projects and deadlines effectively.
- Experience in big data technologies and tools like Hadoop, Spark, or similar is a plus.
- Certification in cloud platforms such as Microsoft Certified: Azure Solutions Architect or equivalent is a plus.