What You'll do:

• Develop Data Pipelines using Scala/Java and Spark EMR to move data into our consolidated data lake Consolidate/join datasets to create easily consumable, performant, and consistent information
• Look for ways to improve processes and take initiative to implement them
• Proficient in Data Infrastructure framework for building Data Processing pipelines
• Collaborate with cross-functional teams to design and implement impactful solutions to department and business problems
• Be able to Lead a few teammates/members on a project or task basis.
• Be able to architect/design a good Data Tools framework
• Evaluate new technology and advise on our data lake ecosystem
• Creates and maintains documentation for business end users and other data analysts.
• Collaborate with Data Scientists in order to design scalable implementations of their models

What You'll bring:

• Degree (Masters preferred) in Computer Science, Information Systems, Data Science, or related field and 10+ years of experience in data engineering, or an equivalent combination of education and experience.
• Expert in coding/architecting distributed computing environment using  Hadoop, Scala/Java, Spark and Apache Airflow
• Experience in architecting Data Tools in collaboration with development and architecture teams.
• Advanced SQL knowledge and understanding 
• Experience working with third party APIs for data collection
• Ability to communicate effectively with, and provide excellent customer service to, stakeholders at all levels of the organization.
• Expertise and Hand-On working knowledge of AWS 
• Experience with Git/Github or other version control systems
• Experience mentoring/coaching business end users and junior analysts
• Self-motivated; able to work independently to complete tasks and collaborate with others to identify and implement solutions.

#LI-SK

#LI-Hybrid