Sr. Software Engineer, Data Platform

ABOUT THE TEAM

As a Senior Data Engineer on the Analytics Team, you will be collaborating with stakeholders across the company to design, build and implement data pipelines and models that enable our next generation of technology to be deployed around the world. You will have a hand in helping shape the data platform vision at Anduril.

ABOUT THE JOB

We’re looking for software and data engineers who are seeking high impact collaborative roles focused on driving operational execution. Ideally you are looking to learn what it takes to build the next generation of defense technology.

WHAT YOU'LL DO

• Lead the design and roadmap for our data platform
• Partner with operations, product, and engineering to advocate best practices and build supporting systems and infrastructure for the various data needs
• Own the ingest and egress frameworks for data pipelines that stitch together various data sources in order to produce valuable data products that drive the business
• Palantir Foundry is our central hub for data driven applications, visualizations and large scale data analysis across the Anduril org. We manage a large user base and provide true data self service at scale.
• We use SQLMesh for data transformations, giving our engineers the ability to work with SQL while enjoying software engineering best practices like version control, testing, and CI/CD for data pipelines.
• For querying data, we utilize Athena, an aws serverless solution that allows our team to run analytics directly on our data lake without managing infrastructure.
• We've implemented Apache Iceberg as our table format, providing advanced data management capabilities like schema evolution and time travel queries.
• We use Flyte for orchestration. It is a highly scalable, kubernetes native modern orchestration platform similar to Airflow or Dagster.

REQUIRED QUALIFICATIONS

• 5+ years of experience in a data engineering role building products, ideally in a fast-paced environment
• You are motivated by our mission. We are working to solve the biggest problems in defense
• Good foundations in Python or another language
• Experience with Spark, PySpark, SQL and dbt
• Experience with Enterprise Data Systems like Palantir Foundry
• Experience with or interest in learning how to develop data services and data products
• Experience with AWS, Azure, or GCP security ecosystem, containerization, and associated tooling
• Knowledge of data & visualization tools, such as Tableau
• Understand the importance of engineering with security’s best practices in mind
• You are empathetic: you are eager to see the world from your users’ perspective
• You’re energized by business impact & a self-starter: you love to drive the direction of ambiguous projects
• Drive to take ownership of and debug complex data transformation pipelines and data models
• Must be a U.S. Person due to required access to U.S. export controlled information or facilities