Data Platform Architect

Overview

BitMEX is seeking a highly strategic and specialized Data Platform Architect to design, build, and maintain our next-generation, self-managed data platform within AWS. This critical role is centered on achieving digital sovereignty over our data assets by leading the implementation of a decentralized, Data Mesh-inspired architecture.

We are looking for an engineer who fundamentally avoids relying on black-box, vendor-managed, or proprietary platforms. You will architect and operate all core systems in-house, focusing on deploying and managing open-source data technologies to create a unified semantic layer. This role requires a strong preference for building and maintaining tailored open-source solutions to achieve end-to-end control—from infrastructure provisioning via Terraform to data consumption—directly enabling advanced analytical querying and cutting-edge AI agent applications.

Key Responsibilities

• AWS Platform Architecture: Design and build the foundational data infrastructure within AWS, utilizing core services (EC2, S3, VPC, EKS, etc.) to support high-throughput, fault-tolerant data product delivery.
• Open-Source Deployment: Be the subject matter expert in selecting, deploying, scaling, and managing open-source data technologies (e.g., Airflow, Superset, DBT, etc.) directly on our AWS infrastructure.
  Infrastructure as Code Mastery: Own the entire platform lifecycle using Terraform for reproducible, version-controlled provisioning of all AWS resources, networking, and security policies.
• Semantic Layer Architecture: Architect and implement the infrastructure to support a unified semantic layer (e.g., using technologies like Trino/Presto, Cube.js, or related OLAP engines) to ensure consistent definitions, metrics, and low-latency access for complex analytics and AI agent consumption.
• Decentralization & Governance: Establish the architectural patterns and tooling (e.g., decentralized metastores, standardized APIs) to enable domain teams to expose their data as secure, self-service data products.
• Security & Cost Optimization: Implement robust security controls, access management (IAM), and continuous monitoring to ensure compliance and optimize the cost-efficiency of the custom-built AWS data platform.

Qualifications

• Cloud Expertise: Deep, hands-on experience and architectural proficiency in Amazon Web Services (AWS), including networking (VPC), IAM, S3, EC2, and security services.
• Infrastructure as Code: Expert-level proficiency with Terraform for managing complex, stateful data infrastructure environments on AWS.
• Distributed Systems: Strong practical experience in deploying, configuring, and scaling core open-source data technologies like Apache Spark (on EKS/EC2/EMR) and Trino/Presto (and/or Athena) or similar distributed query/federation engines.
• Semantic Modeling: Solid understanding of semantic modeling, OLAP, and dimensional modeling concepts and direct experience implementing a consistent metrics layer or data consumption interface.
• Orchestration & Containers: Proven experience with Docker and Kubernetes (EKS) for packaging, deploying, and managing self-hosted data services.
• Programming: Strong skills in Python for building platform automation, internal tools, and APIs.

Preferred Skills

• Experience with query federation engines and implementing data virtualization techniques.
• Experience with open-source tools for data governance and metadata management (e.g., OpenMetadata, Amundsen).
• Understanding of Data Contract principles and schema management.
• AWS certifications (e.g., AWS Certified Data Analytics – Specialty or Solutions Architect – Professional).

Why BitMEX?

BitMEX offers a dynamic environment that blends intense work, a vibrant culture, and diversity. We actively recruit across time zones to meet growing demands and attract top global talent.

We're seeking determined, responsible, and collaborative individuals to join us in building a leading cryptocurrency ecosystem. We value meticulousness, agility, and simplicity. As a 24/7 global exchange, we look for adaptable team players who can excel in a diverse, cross-market environment.

In addition, we offer an industry leading benefits package to our permanent employees. Here’s a peek into what we offer:

• Work from home to help you find the perfect balance between work, family and personal life
• 25 days of annual leave, on top of public holidays, as well as maternity, paternity and childcare leave… etc to accommodate your growing responsibilities
• A top tier & comprehensive medical, dental and vision policy for you and your dependents
• Professional development allowance to support your career advancement
• Access to our annual wellness benefits to cultivate your physical and mental growth
• Don’t forget the advantage of our Beyond Border Remote Working policy, where you get to work away from your home country
• Team building & offsite events to bring our global team closer
• Life insurance coverage to provide a safety net for your family’s future
• Option to choose to be paid in fiat or crypto currency, providing the flexibility to shape your financial freedom

#LI-CH1