What You'll do:

• Develop Data Pipelines using Scala/Java and Spark EMR to move data into our consolidated data lake Consolidate/join datasets to create easily consumable, performant, and consistent information
• Look for ways to improve processes and take initiative to implement them
• Evaluate new technology and advise on our data lake ecosystem
• Collaborate with cross-functional teams to design and implement impactful solutions to department and business problems
• Be a Technical Lead for junior teammates on code-related questions and issues.
• Be able to architect/design a good Data Tools framework
• Creates and maintains documentation for business end users and other data analysts.
• Determine where in our infrastructure we should house our data based on the use case and data model
• Collaborate with Data Scientists in order to design scalable implementations of their models

What you bring:

• Degree (Masters preferred) in Computer Science, Information Systems, Data Science, or related field and 8+ years of experience in data engineering, or an equivalent combination of education and experience.
• Expert and Hands-On development in distributed computing environment using  Hadoop, Scala/Java, Spark and Apache Airflow
• Experience architecting Data Tools in collaboration with development and architecture teams.
• Advanced SQL knowledge and understanding 
• Experience working with third party APIs for data collection
• Ability to communicate effectively with, and provide excellent customer service to, stakeholders at all levels of the organization.
• Expertise and Hand-On working knowledge of AWS 
• Experience with Git/Github or other version control systems
• Experience mentoring/coaching business end users and junior analysts
• Self-motivated; able to work independently to complete tasks and collaborate with others to identify and implement solutions.

#LI-

#LI-Hybrid