Posted:
8/29/2024, 8:35:20 AM
Location(s):
Sunnyvale, California, United States ⋅ California, United States
Experience Level(s):
Senior
Field(s):
Data & Analytics
Position: Senior Data Engineer
Job Location: 640 W. California Avenue, Sunnyvale, CA 94086
Duties: Translate business problems into data related solutions that involve identifying methods (Batch, Streaming, SCD) and technologies (Spark, Hudi, Apache Kafka, Hive, SQL) to leverage the solutions. Provide recommendations to business stakeholders to solve complex business issues. Guide initiatives and translate requirements into projects, activities, and tasks using JIRA and Confluence that align to overall business and tech strategy and develop domain specific artifacts. Guide the cost optimization effort for the team that involves identifying options to reduce cloud cost for compute (GCP DataProc), storage (GCS and BQ), and platform services (DPaaS and WCNP) and work with team to achieve the goal. Drive the open-source Apache Druid migration for the team by migrating all team datasets without impacting the downstream consumers. Optimize batch and real time ETL pipelines (Yaml and Spark Scala) to reduce cloud cost and latency for downstream consumers. Mentor new team members and share best practices and recommendations on Spark, GCP, Apache Hudi, Python, SQL, Hive, Apache Druid, and Apache Kafka. Perform code reviews to ensure code quality and standards.
Minimum education and experience required: Master's degree or equivalent in Computer Science, Software Engineering, Information Technology or related field and 1 year of experience in data engineering, database engineering, business intelligence, or business analytics or related field; OR Bachelor’s degree or equivalent in Computer Science, Software Engineering, Information Technology or related field and 3 years of experience in data engineering, database engineering, business intelligence, or business analytics or related field.
Skills required: Experience with SQL. Experience coding in object-oriented programming languages Python and Scala. Experience with Google Cloud and Amazon Web Services. Experience designing and developing ETL batch processing pipelines. Experience with data warehouse design. Experience with Microsoft Azure cloud services. Experience with Relational database management using MySQL database. Experience developing applications using Apache Spark and Jupyter Notebook. Experience with Microsoft Azure Data Factory, Synapse, and Data Lake. Experience developing Power BI Reports. Experience with data analysis using statistical models. Employer will accept any amount of graduate coursework, graduate research experience or professional experience with the required skills.
Salary Range: $136,074/year to $234,000/year. Additional compensation includes annual or quarterly performance incentives. Additional compensation for certain positions may also include: Regional Pay Zone (RPZ) (based on location) and Stock equity incentives.
Benefits: At Walmart, we offer competitive pay as well as performance-based incentive awards and other great benefits for a happier mind, body, and wallet. Health benefits include medical, vision and dental coverage. Financial benefits include 401(k), stock purchase and company-paid life insurance. Paid time off benefits include PTO (including sick leave), parental leave, family care leave, bereavement, jury duty and voting. Other benefits include short-term and long-term disability, education assistance with 100% company paid college degrees, company discounts, military service pay, adoption expense reimbursement, and more.
Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to a specific plan or program terms. For information about benefits and eligibility, see One.Walmart.com.
Wal-Mart is an Equal Opportunity Employer.
#LI-DNI #LI
Website: http://www.walmart.com/
Headquarter Location: Bentonville, Arkansas, United States
Employee Count: 10001+
Year Founded: 1962
IPO Status: Public
Last Funding Type: Post-IPO Debt
Industries: E-Commerce ⋅ Grocery ⋅ Retail ⋅ Retail Technology ⋅ Shopping