Project Role : Data Engineer
Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
Must have skills : Palantir Foundry
Good to have skills : NA
Minimum 7.5 year(s) of experience is required
Educational Qualification : 15 years full time education

Summary:
As a Lead Data Engineer, Design, build and enhance applications to meet business process and requirements in Palantir foundry. The role includes creating efficient data pipelines and ensuring the integrity and quality of data throughout its lifecycle. You will be responsible for implementing processes that extract, transform, and load data to facilitate seamless migration and deployment across various systems. This position requires continuous collaboration with different teams to optimize data workflows and support organizational data needs effectively.
Work experience: Minimum 6 years

Job Requirements & Key Responsibilities :
Responsible for designing , developing, testing, and supporting data pipelines and applications on Palantir foundry.
Configure and customize Workshop to design and implement workflows and ontologies.
Collaborate with data engineers and stakeholders to ensure successful deployment and operation of Palantir foundry applications.
Work with stakeholders including the product owner, data, and design teams to assist with data-related technical issues and understand the requirements and design the data pipeline.
Work independently, troubleshoot issues and optimize performance.
Communicate design processes, ideas, and solutions clearly and effectively to team and client.
Assist junior team members in improving efficiency and productivity.

Technical Experience :
Must have Skills : Palantir Foundry , PySpark
Proficiency in PySpark, Python and Sql with demonstrable ability to write & optimize SQL and spark jobs.
Hands on experience on Palantir foundry related services like Data Connection, Code repository, Contour , Data lineage & Health checks.
Good to have working experience with workshop , ontology , slate.
Hands-on experience in data engineering and building data pipelines (Code/No Code) for ELT/ETL data migration, data refinement and data quality checks on Palantir Foundry.
Experience in ingesting data from different external source systems using data connections and sync.
Good Knowledge on Spark Architecture and hands on experience on performance tuning & code optimization.
Proficient in managing both structured and unstructured data, with expertise in handling various file formats such as CSV, JSON, Parquet, and ORC.
Experience in developing and managing scalable architecture & managing large data sets.
Good understanding of data loading mechanism and adeptly implement strategies for capturing CDC.
Nice to have test driven development and CI/CD workflows.
Experience in version control software such as Git and working with major hosting services (e. g. Azure DevOps, GitHub, Bitbucket, Gitlab).
Implementing code best practices involves adhering to guidelines that enhance code readability, maintainability, and overall quality.

Good to Have Skills :
Knowledge on Big Data tools & Technologies
Organizational and project management experience.

Educational Qualification:15 years of full-term education

15 years full time education

About Accenture

Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.

Visit us at www.accenture.com 

Equal Employment Opportunity Statement

We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, military veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by applicable law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.