Sr. Data Engineer

Posted:
10/23/2024, 9:16:05 AM

Experience Level(s):
Senior

Field(s):
Data & Analytics

  • Important Information:

    • Years of Experience: 5+ years in data engineering, 5+ years in at least two modern programming languages (such as .Net, Python, PySpark, Scala, Java, SQL).
    • Job Mode: Full-time.
    • Work Mode: Remote
  • Job Summary: The Senior Data Engineer will lead the design, development, integration, and management of large-scale data solutions. This role is crucial in ensuring that data systems are scalable, high-performing, and in line with the architectural strategy of the client. The Senior Data Engineer will collaborate with Agile teams, mentor junior engineers, and continuously explore emerging technologies to optimize the client's data infrastructure.

  • Responsibilities and Duties:

    • Design, develop, integrate, and manage large-scale data solutions, including data storage, data modeling, ETL processes, querying, and reporting.
    • Stay up to date with technological advancements, experiment with new tools, and actively participate in tech communities.
    • Deliver robust cloud-based data solutions and facilitate migrations from SQL Server.
    • Lead the research, evaluation, and adoption of relational and NoSQL data solutions.
    • Utilize programming languages like Python and PySpark alongside AWS tools for data management.
  • Qualifications and Skills:

    • Minimum of 5 years of experience in data engineering.
    • Proficiency in at least two modern programming languages, including .Net, Python, PySpark, Scala, Java, or SQL.
    • 1+ years of hands-on experience with AWS.
    • 2+ years of experience working with open-source frameworks.
    • Familiarity with Agile development methodologies.
  • Role-specific Requirements:

    • Experience working with AWS Glue, Firehouse, and Lake Formation.
    • Strong understanding of data migration and cloud-based data architecture.
  • Technologies:

    • AWS tools and services, including Glue, Firehouse, and Lake Formation.
    • Programming languages such as .Net, Python, PySpark, Scala, Java, SQL.
    • SQL Server, AWS Redshift, Athena, S3 (optional but preferred).
  • Skillset competencies:

    • Data storage, modeling, and querying.
    • ETL processes.
    • Agile methodologies and team collaboration.
    • Open-source frameworks.
    • Cloud-based data solutions.
  • About Encora: Encora is a leading digital engineering and modernization partner for top-tier enterprises and digital-native companies worldwide. With over 9,000 experts in 47+ offices and innovation labs, Encora specializes in Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering. At Encora, we hire professionals based solely on their skills and qualifications, fostering a diverse, inclusive workplace that values talent from all backgrounds.