Senior Backend Engineer, Spark

Business Area:

Engineering

Seniority Level:

Mid-Senior level

Job Description: 

At Cloudera, we empower people to transform complex data into clear and actionable insights. With as much data under management as the hyperscalers, we're the preferred data partner for the top companies in almost every industry.  Powered by the relentless innovation of the open source community, Cloudera advances digital transformation for the world’s largest enterprises.

At Cloudera, we empower people to transform complex data into clear and actionable insights. With as much data under management as the hyperscalers, we are the preferred data partner for top companies in almost every industry. Powered by the relentless innovation of the open source community, Cloudera advances digital transformation for the world’s largest enterprises.

Cloudera Data Engineering is the next-generation cloud-native service that helps our customers run large-scale data engineering workflows made up of industry-standard big data processing frameworks like Apache Spark and Apache Airflow with just a few clicks, across both on-premises and public cloud environments.

We are seeking a Senior Engineer with a strong technical background in data infrastructure space to lead the Cloudera Data Engineering experience for all customers using Cloudera Data Engineering Spark with Iceberg. This high-impact IC role offers the opportunity to shape the future of Cloudera’s Data Engineering space across multiple cloud environments, impacting thousands of customers worldwide.

As a Senior Software Engineer you will:

• Gain deep technical knowledge across the Cloudera Data Engineering technical stack, with a focus on the runtimes of the stack like Apache Spark and Apache Iceberg, and apply this expertise in your daily work.
   

• Work with a team of talented infrastructure engineers. Help hire and mentor engineers while supporting their career growth.
   

• Drive architecture and design discussions, providing strong technical direction for the team.
   

• Collaborate with product, engineering, and cross-functional partners, leading the delivery of several large, critical features in Cloudera’s data engineering experience.
   

• Work on large-scale distributed systems, ranging from hundreds to thousands of nodes in production clusters.
   

• Bring passion for programming, clean coding practices, attention to detail, and a strong focus on quality.
   

We are excited about you if you have:

• Relevant studies / BS or MS in Computer Science or related field

• 3+ years experience as a Software Engineer in infrastructure space

• Strong understanding of at least one of the following languages: Java, Scala, C++, Python. And interested to learn the languages we’re using.

• Passionate about programming, clean coding habits, attention to detail, and focus on quality

• Strong understanding of distributed systems and building systems at scale.
   

• Excellent communication and collaboration skills

• Experience with containerization (Kubernetes, Docker).
   

• Experience with public cloud (AWS/Azure/GCP) and/or private cloud (OpenShift/Rancher)

• (Most importantly) Open-minded attitude, desire to learn new things and build great products

• It’s a big plus if you have solid experience with Apache Spark or Apache Iceberg 

What you can expect from us:

• Generous PTO Policy 

• Support work life balance with Unplugged Days

• Flexible WFH Policy 

• Mental & Physical Wellness programs 

• Phone and Internet Reimbursement program 

• Access to Continued Career Development 

• Comprehensive Benefits and Competitive Packages 

• Paid Volunteer Time

• Employee Resource Groups

EEO/VEVRAA

#LI-EO1

#LI-HYBRID