Project Role : Custom Software Engineer
Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs.
Must have skills : PySpark
Good to have skills : NA
Minimum 3 year(s) of experience is required
Educational Qualification : 15 years full time education

Summary:
As a Custom Software Engineer, a typical day involves creating tailored software solutions by designing, coding, and improving various components within systems or applications. The role requires working with modern development frameworks and following agile methodologies to ensure the delivery of scalable and efficient software that meets unique business requirements. Collaboration with team members and stakeholders is an integral part of the daily routine to align development efforts with project goals and timelines.

Roles & Responsibilities:
-Strong experience in designing, developing, and maintaining ETL pipelines for large-scale data processing.
-Hands-on experience with data extraction, transformation, and loading from various structured/unstructured sources.
-Experience with data quality checks, data validation, and data lineage tracking.
-Knowledge of incremental loads, CDC (Change Data Capture), and data partitioning strategies.
-Data Processing: pandas, numpy,
-Data Extraction & Loading: boto3 (AWS SDK), requests,
-Database Connectivity: psycopg2, pymysql
-Testing: pytest, unittest
-The candidate should have a minimum of 5-6 years of experience in Pyspark
-AWS certifications at the Professional or Specialty level will be an added advantage
- Expected to perform independently and become an SME.
- Required active participation/contribution in team discussions.
- Contribute in providing solutions to work related problems.
- Collaborate with cross-functional teams to understand business needs and translate them into technical solutions.
- Maintain and enhance existing software components to improve performance and reliability.
- Document development processes and solutions to support knowledge sharing and future maintenance.
- Assist junior team members by providing guidance and support to foster their professional growth.

Professional & Technical Skills:
-Experience in PySpark for distributed data processing on Hadoop or Spark clusters.
-Ability to write optimized Spark SQL, DataFrame, and RDD transformations.
-Strong experise using PySpark ETL libraries -pyspark.sql, pyspark.sql.functions
-Strong expertise in Python for ETL development.
- Must To Have Skills: Proficiency in PySpark.
- Experience in developing scalable software solutions using distributed computing frameworks.
- Strong problem-solving skills with the ability to analyze and optimize code performance.
- Familiarity with agile software development practices and continuous integration/continuous deployment pipelines.
- Ability to work effectively in a collaborative team environment and communicate technical concepts clearly.
- Knowledge of data processing and transformation techniques within big data ecosystems.

Additional Information:
- The candidate should have minimum 3 years of experience in PySpark.
- This position is based at our Bengaluru office.
- A 15 years full time education is required.

15 years full time education

About Accenture

Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.

Visit us at www.accenture.com 

Equal Employment Opportunity Statement

We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, military veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by applicable law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.