Senior Data Engineer (P3005)

Senior Data Engineer (P3005)

Who we are
As a full-stack data science subsidiary of The Kroger Company, we leverage over 10 petabytes of data to personalize the experience for 62 million households.  We are seeking a hands-on Senior Data Engineer (G2) to design, build, and operate our analytical lakehouse on a modern data stack. As a senior individual contributor on a hybrid scrum team, you will partner closely with Product, Analytics, and Engineering to deliver scalable, high-quality data products on Databricks and Azure. You will contribute to technical direction, uphold engineering best practices, and remain deeply involved in coding, testing, and production operations—without people management responsibilities.

Key Responsibilities

• Data engineering delivery: Design, develop, and optimize secure, scalable batch and near-real-time pipelines on Databricks (PySpark/SQL) with Delta Lake and Delta Live Tables (DLT).  Implement medallion architecture, Unity Catalog governance, and robust data quality checks (expectations/testing).  Build performant data models and tables to power analytics, ML, and downstream applications
• Product collaboration and agile execution: Translate business requirements into data contracts, schemas, and SLAs in partnership with Product and Analytics.  Participate in backlog refinement, estimation, sprint planning, and retros in a hybrid onshore/offshore environment.  Deliver clear documentation (designs, runbooks, data dictionaries) to enable self-serve and reuse
• Reliability, observability, and operations: Implement monitoring, alerting, lineage, and cost/performance telemetry; troubleshoot and tune Spark jobs and storage.  Participate in on-call/incident response rotations and drive post-incident improvements
• CI/CD, and infrastructure as code: Contribute to coding standards, code reviews, and reusable patterns/modules.  Build and maintain CI/CD pipelines (GitHub Actions) and manage infrastructure with Terraform (data, compute, secrets, policies)
• Continuous improvement and knowledge sharing: Mentor peers informally, share best practices, and help evaluate/introduce modern tools and patterns

Required Qualifications

• Experience: 4–6 years in data engineering; 1–2 years operating as a senior/lead individual contributor on delivery-critical projects.  Proven track record delivering production-grade pipelines and data products on cloud platforms.
• Core technical skills: Databricks: 2–3+ years with Spark (PySpark/SQL); experience building and operating DLT pipelines and Delta Lake.  Azure: Proficiency with ADLS Gen2, Entra ID (Azure AD), Key Vault, Databricks on Azure, and related services.  Languages and tools: Expert-level SQL and strong Python; Git/GitHub, unit/integration/data testing, and performance tuning.  Infrastructure as code: Hands-on Terraform for data platform resources and policies.  Architecture: Solid understanding of medallion and dimensional modeling, data warehousing concepts, and CI/CD best practices
• Collaboration and communication:  Excellent communicator with the ability to work across Product, Analytics, Security, and Platform teams in an agile setup

Preferred qualifications

• Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent experience)
• Azure or Databricks certifications (e.g., Data Engineer Associate/Professional)
• Experience with ELT tools (e.g., Fivetran), Snowflake, and streaming (Event Hubs, Kafka)
• Familiarity with AI-ready data practices and AI developer tools (e.g., GitHub Copilot)
• Exposure to FinOps concepts and cost/performance optimization on Databricks and Azure

The opportunity

• Build core data products that power personalization for millions of customers at enterprise scale
• Work with modern tooling (Databricks, Delta Lake/DLT, Unity Catalog, Terraform, GitHub Actions) in a collaborative, growth-minded culture
• Hybrid work, competitive compensation, comprehensive benefits, and clear paths for advancement

PLEASE NOTE: 

Applicants for employment in the US must have work authorization that does not now or in the future require sponsorship of a visa for employment authorization in the United Stated and with the Kroger Family of Companies (i.e. H1-B visa, F-1 visa (OPT), TN visa or any other non-immigrant status).

#LI-SSS