What you'll do...

Position: Staff Data Engineer

Job Location:  860 W. California Avenue, Sunnyvale, CA 94086

Duties: Design, build, and maintain scalable data pipelines and infrastructure for large-scale data processing and analytics using technologies such as Hadoop, Spark, distributed event store and stream-processing platform, in-memory databases, and other big data tools. Build large-scale distributed event streaming platforms such as Apache Kafka and Google Cloud Pub/Sub. Develop and deploy real-time data processing pipelines for near-real-time (NRT) streaming data. Design and implement data storage solutions using Data Lakes and NoSQL databases to support high-volume and high-velocity data processing. Develop and implement machine learning models to support predictive analytics and automation. Develop and deploy natural language processing (NLP) models using chatgpt and other Gen AI focused tools and platforms. Work with data scientists, analysts, and other stakeholders to understand data requirements and develop solutions that meet their needs. Develop and maintain data quality and governance processes to ensure data accuracy, completeness, and consistency across different systems and sources. Design and implement job scheduling and automation using scheduling tools. Optimize data processing workflows using managed services provided by cloud platforms. Identify and resolve performance bottlenecks, data quality issues, and other technical challenges that arise in large-scale data processing environments. Create and maintain documentation and best practices for data engineering processes and systems. Stay up-to-date with the latest trends and innovations in big data, cloud computing, and related technologies, and adapt these technologies to improve data processing and analytics capabilities. Build data models to support data visualization and analysis. Develop and maintain data pipelines to extract, transform, and load data from various sources into the data visualization tool. Build and maintain dashboards and reports to provide insights into business performance and trends. Develop and maintain data validation and testing procedures to ensure data accuracy.

Minimum education and experience required: Master’s degree or equivalent in Computer Science, Engineering (Any), Engineering Technology, or related field and 3 years of experience in large scale enterprise software development environment; OR Bachelor’s degree or equivalent in Computer Science, Engineering (Any), Engineering Technology, or related field and 6 years of experience in large scale enterprise software development environment.

Skills required: Experience with Spark Scala programming. Experience with Python programming. Experience with Big Query and GCP Platform, Hive, and Hudi. Experience with Unix Shell Scripting. Experience with SAP Hana. Experience with NoSQL database Cassandra. Experience with Data Lake. Experience with Event Streaming Platform Kafka. Experience with system design, ETL pipeline design, and data modeling. Experience with Schedulers including Automic and Airflow. Experience within Data Engineering. Employer will accept any amount of experience with the required skills.

Salary Range: $174,518/year to $286,000/year. Additional compensation includes annual or quarterly performance incentives.   Additional compensation for certain positions may also include: Regional Pay Zone (RPZ) (based on location) and Stock equity incentives.

Benefits: At Walmart, we offer competitive pay as well as performance-based incentive awards and other great benefits for a happier mind, body, and wallet. Health benefits include medical, vision and dental coverage. Financial benefits include 401(k), stock purchase and company-paid life insurance. Paid time off benefits include PTO (including sick leave), parental leave, family care leave, bereavement, jury duty and voting. Other benefits include short-term and long-term disability, education assistance with 100% company paid college degrees, company discounts, military service pay, adoption expense reimbursement, and more.

Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to a specific plan or program terms. For information about benefits and eligibility, see One.Walmart.com.

Wal-Mart is an Equal Opportunity Employer.

#LI-DNI #LI