Data Engineer
Experience: 8-12 years
Work Mode: Hybrid
What you’ll do
- Responsible for leading data onboarding workstreams with new customers / pilots / POCs
- Work directly with customers’ data teams on data interfaces, specifications and integration projects
- Design, implement and maintain performance of reliable data pipelines and interfaces that feed various analytics applications
- Design, develop, and maintain ETL from various data streams via multiple consumption methods (e.g. Blob, Kafka, SFTP, SQL connectors, REST API).
- Design, development, and implementation of new and existing data processing solutions; enabling teams to be more efficient and effective in analyzing data and getting to insights faster.
- Create, implement, and maintain data transformation and data validation processes.
- Perform data validation activities, normalize and explore datasets, investigate and solve data related problems
- Support data architecture efforts in support of key analytics innovations that involve multiple internal and/or external (client) stakeholders.
We’re looking for people who have
- 8+ years of experience working as a data engineer in ETL and data integration
- 8+ years of experience in client facing consultation role, project management expertise, managing customer expectations and deadlines and excellent communication skills
- Strong Python – Pyspark development experience
- Strong SQL with experience in querying large, complex data sets.
- Databricks, Spark and Scala development experience
- Experience working with retailer and supplier analytics data
- Experience with Cloud platforms – Azure strongly preferred
- Computer Science, Engineering, Information Systems, Statistics, Math degree (or equivalent combination of skill and experience).
- Experience in data integration design, development and maintenance, data lakes/hubs.
- Result-driven, pragmatic, and innovative
- Experience with developing REST APIs and microservices.
- Experience with SingleStore, Snowflake, BI tools i.e. PowerBI – nice to have
About Encora
Encora is a Sofware development arm of Encora Corporation created specifically to address the growing Sofware needs of the business. Encora offers maintenance and reliability teams the tools, Sofware, and services they need to optimize asset performance. Home to three powerful iconic brands – we serve over 70,000 customers worldwide with a relentless dedication to quality, innovation, and service. Our products inform customers on the health of their assets and our Sofware and services drive better maintenance decisions – improving productivity, driving uptime, and reducing costs.
We're serious about our commitment to diversity, which is why Encora prohibits discrimination based on race, color, religion, gender, national origin, age, disability, veteran status, marital status, pregnancy, gender expression or identity, sexual orientation or any other legally protected status.