Senior Data Engineer with Machine Learning

Walmart is seeking a highly skilled and experienced Senior Data Engineer with strong exposure to Machine Learning (ML) to support and optimize large-scale data processing pipelines,

build scalable data platforms, and contribute to the development of ML-driven products. The ideal candidate will bring over a decade of hands-on experience in data engineering, along with the ability to collaborate with data scientists and software engineers to deliver reliable, production-ready solutions.

Key Responsibilities:
Design, build, and maintain scalable data pipelines and ETL/ELT workflows to support machine learning initiatives.

Partner with Data Science and ML Engineering teams to prepare, process, and serve high-quality datasets for modeling and inference.

Work with big data technologies (e.g., Spark, Hadoop, Hive) to process structured and unstructured data at scale.

Develop and optimize data architectures for performance, reliability, and security.

Automate data workflows and support CI/CD for data and ML pipelines.

Identify data quality issues and implement solutions to ensure data integrity.

Contribute to model deployment workflows and integration into business applications.

Required Skills & Qualifications:
10+ years of professional experience in Data Engineering.

Strong programming skills in Python, Scala, or Java.

Hands-on experience with Apache Spark, Hadoop, Kafka, or similar big data technologies.

Solid experience in SQL and relational database systems.

Experience supporting Machine Learning workflows—including data preparation, feature engineering, and model integration.

Familiarity with cloud platforms such as GCP, AWS, or Azure.

Working knowledge of CI/CD, version control systems (e.g., Git), and infrastructure-as-code tools.

Strong understanding of data warehousing concepts and tools (e.g., BigQuery, Snowflake, Redshift).

Excellent problem-solving skills and ability to work in a fast-paced environment.

Preferred Skills:
Experience with MLflow, Kubeflow, or similar ML orchestration tools.

Familiarity with containerization and orchestration (Docker, Kubernetes).

Prior experience working in retail/eCommerce domains is a plus.

Knowledge of data privacy and compliance best practices