We are tech transformation specialists, uniting human expertise with AI to create scalable tech solutions.
With over 8,000 CI&Ters around the world, we’ve built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality.
We are looking for a highly skilled Data Tech Lead with focus on Databricks to lead the design, development, and implementation of a modern hub-and-spoke data platform for a leading retail company. This platform will serve as the foundation for advanced analytics and real-time personalization, enabling data-driven decision-making and customer engagement.
The role involves working closely with business stakeholders, data engineers, and product teams to design scalable, secure, and efficient data solutions on Databricks and the modern data stack. The architect will also drive the adoption of DataOps practices such as CI/CD pipelines, data contracts, quality checks, and observability.
Requirements
- Expertise in Databricks (Delta Lake, Spark, Databricks SQL, Unity Catalog, MLflow).
- Strong background in data architecture and design of large-scale, distributed systems.
- Proven experience building data pipelines (batch and streaming) with technologies like Delta Live Tables, Spark Structured Streaming, Kafka, Event Hubs, or Kinesis.
- Solid understanding of DataOps practices: CI/CD for data workflows, testing frameworks, monitoring, and observability tools.
- Proficiency in SQL and Python (PySpark).
- Hands-on experience with cloud platforms (AWS, Azure, or GCP) including storage, networking, IAM, and security best practices.
- Knowledge of data governance, lineage, and cataloging solutions (e.g., Unity Catalog, Collibra, Alation).
- Ability to integrate APIs, third-party systems, and retail platforms into the data ecosystem.
- Understanding of the entire business side.
- Advanced English is essential (speaking)!
#LI-GP1