Our Purpose
Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.
Title and Summary
Senior Data Engineer
Job Overview
The Senior Software Engineer will do the design, development, and delivery of advanced big data solutions within the Hadoop ecosystem.
This role involves architecting and implementing scalable data processing frameworks, ensuring high performance and reliability across distributed systems.
The engineer will research and evaluate emerging technologies to optimize data workflows and meet evolving business needs.
Additionally, the position requires hands-on expertise in Cloudera distribution and related tools, ensuring seamless orchestration and integration of data pipelines.
The Senior Software Engineer will also be responsible for maintaining operational excellence, meeting SLA requirements, and mentoring team members to drive technical innovation and best practices.
Role
Contribute individually to the design, development, and implementation of large-scale data engineering solutions within the Hadoop ecosystem, ensuring high performance, scalability, and reliability.
Drive end-to-end technical delivery for projects involving Cloudera distribution, Apache Ozone, Apache Iceberg, Apache Airflow, Apache NiFi, and Apache Spark.
Collaborate with cross-functional teams to define architecture, technical standards, and best practices for big data platforms and workflows.
Perform rigorous performance benchmarking and optimization for newly developed distributed frameworks, ensuring efficient parallel processing and scalable storage solutions across large datasets.
Research and evaluate emerging technologies in distributed data storage, orchestration, and processing frameworks to optimize data pipelines and improve operational efficiency.
Develop strategic technical plans and create architecture proposals addressing solution gaps and business requirements.
Provide technical leadership in planning, design, and implementation phases, ensuring compliance with security, quality, and performance standards.
Ensure adherence to SLAs, manage production incidents, and drive root cause analysis and remediation for complex issues.
Conduct Proof of Concepts (PoCs) for new technologies and contribute to technology roadmaps for the organization.
Education
Bachelor's degree in Information Systems, Information Technology, Computer Science or Engineering or equivalent experience.
Knowledge / Experience:
6+ years of experience in related field, including 4-5 years of experience in delivering secure solutions in Financial Services Sector is preferred.
Advanced knowledge and understanding of Software Engineering Concepts and Methodologies is required.
Demonstrate MC Core Competencies.
About You
High-energy, detail-oriented, and proactive, with the ability to work independently under pressure while driving results with initiative and self-motivation.
Strong aptitude for quickly learning and implementing new big data technologies, frameworks, and tools, and performing Proof of Concepts (PoCs) to identify optimal solutions.
6+ years of overall experience in software engineering with 5+ years of hands-on experience in Hadoop ecosystem projects, including Cloudera distribution.
Proven expertise in building distributed data pipelines and frameworks using Apache Spark (Scala/Python/Java) for massive parallel processing.
Hands-on experience with Apache Ozone and Apache Iceberg for distributed storage and table formats.
Skilled in designing and managing orchestration workflows using Apache Airflow and Apache NiFi for complex data integration scenarios.
Strong analytical and problem-solving skills for debugging production issues, performing root cause analysis, and implementing mitigation plans.
Excellent communication skills—both verbal and written—with strong collaboration and organizational abilities to work in diverse, geographically distributed teams.
Ability to multitask across multiple projects, provide technical leadership, and mentor junior team members.
Flexible and adaptable to evolving technologies and business needs, with a passion for innovation in big data solutions.
Corporate Security Responsibility
All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
Abide by Mastercard’s security policies and practices;
Ensure the confidentiality and integrity of the information being accessed;
Report any suspected information security violation or breach, and
Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.