Abacus insights

Senior Data Engineer

Remote Full Time

About Us

Abacus Insights is changing the way healthcare works for you. We’re on a mission to unlock the power of data so health plans can enable the right care at the right time—making life better for millions of people. No more data silos, no more inefficiencies. Just smarter care, lower costs, and better experiences.

Backed by $100M from top VCs, we’re tackling big challenges in an industry that’s ready for change. And while GenAI is still new for many, we’ve already mastered turning complex healthcare data into clear, actionable insights. That’s our superpower—and it’s why we’re leading the way.

Abacus, innovation starts with people. We’re bold, curious, and collaborative—because the best ideas come from working together. Ready to make an impact? Join us and let's build the future, together.

About the Role

We are seeking an accomplished Sr. Data Engineer to join our dynamic and rapidly expanding Tech Ops division. With significant projected growth, this is an opportunity to make a meaningful impact. In this role, you will collaborate with customers, data vendors, and internal teams to integrate data into a state-of-the-art platform built on scalable, flexible, and resilient cloud architectures. As a trusted advocate for our clients, you will drive the successful adoption of Abacus’s core data management solutions, ensuring seamless data ingestion and management through cutting-edge technologies and best practices.

Your day to day:

  • Partner with clients and implementation teams to understand data distribution requirements.
  • Design and develop data pipelines integrating with Databricks and Snowflake, ensuring accuracy and integrity.
  • Lead architecture and implementation of solutions for health plan clients, optimizing cloud-based technologies.
  • Translate business requirements into technical solutions in collaboration with cross-functional teams.
  • Implement robust data security measures and ensure compliance with healthcare regulations such as HIPAA.
  • Provide technical leadership, mentor junior engineers, and stay current with industry trends.
  • Optimize data processes for efficiency, review architectures regularly, and maintain detailed documentation.
  • Conduct training sessions for team members and clients to enhance understanding and utilization of data solutions.

What you bring to the team:

  • Bachelor’s degree in Computer Science, Computer Engineering, or related IT field.
  • 5+ years of experience in data engineering.
  • Basic knowledge of U.S. healthcare data (e.g., medical claims, member eligibility).
  • Strong communication skills with both technical and non-technical stakeholders.
  • Proficiency in Python and SQL.
  • Experience building and managing ETL pipelines using Databricks workflows or similar orchestration frameworks.
  • Familiarity with structured and semi-structured data, and processing using PySpark.
  • Working knowledge of AWS services (S3, SQS) or equivalent cloud services.
  • Experience with Terraform and GitLab CI/CD.
  • Skills in query tuning and performance optimization in SQL and/or SparkSQL.
  • Familiarity with data warehousing solutions such as Snowflake or similar platforms.

What we would like to see but not required:

  • Experience working for a cloud-based data services provider serving large healthcare clients.
  • Knowledge of DBT and Kafka.

Compensation: Compensation for this role is based on experience, skills, and location, and includes base salary plus eligibility for performance bonuses and equity grants.

What you’ll get in return:
  • Unlimited paid time off – recharge when you need it
  • Work from anywhere – flexibility to fit your life
  • Comprehensive health coverage – multiple plan options to choose from
  • Equity for every employee – share in our success
  • Growth-focused environment – your development matters here
  • Home office setup allowance – one-time support to get you started
  • Monthly cell phone allowance – stay connected with ease #LI-RF1

Our Commitment as an Equal Opportunity Employer

As a mission-led technology company helping to drive better healthcare outcomes, Abacus Insights believes that the best innovation and value we can bring to our customers comes from diverse ideas, thoughts, experiences, and perspectives. Therefore, we dedicate resources to building diverse teams and providing equal employment opportunities to all applicants. Abacus prohibits discrimination and harassment regarding race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws.

At the heart of who we are is a commitment to continuously and intentionally building an inclusive culture—one that empowers every team member across the globe to do their best work and bring their authentic selves. We carry that same commitment into our hiring process, aiming to create an interview experience where you feel comfortable and confident showcasing your strengths. If there’s anything we can do to support that—big or small—please let us know.