Join Mizuho as a Cloud Data Engineer!
In this role, you will support all aspects of data engineering activities, including data design, development, testing, debugging, documentation, deployment, and production support. The ideal candidate will have strong expertise in building and managing data pipelines using PySpark, Python, SQL, and Airflow.
Key Responsibilities:
·Design, develop, and optimize scalable data pipelines on Databricks using PySpark to process large volumes of financial data for real-time analytics and reporting.
-Implement ETL pipelines for structured and semi-structured financial data from batch and streaming processes using tools such as Apache Kafka, Airflow, and SQL.
·Implement Gold Layer transformations in Databricks for curated, high-quality datasets that support business intelligence and analytics.
·Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to deliver high-quality data solutions that meet business requirements.
·Implement DevOps best practices for data engineering workflows, including CI/CD pipelines, to ensure efficient and reliable data processing.
·Ensure data quality, governance, and compliance with financial regulations to support accurate and reliable financial reporting.
·Automate workflows using Airflow for scheduling and orchestration, improving operational efficiency.
·Optimize Spark jobs and SQL queries for performance and cost efficiency, ensuring timely and cost-effective data processing.
Requirements:
- At least 3 years of experience with Databricks and PySpark for big data processing in a financial services environment.
- 5+ years of strong programming experience in Python and advanced SQL.
- Hands-on experience with Airflow for workflow orchestration, including designing and managing complex DAGs.
- Knowledge of cloud platforms (Azure or AWS), including data lake architectures and related services such as Azure Data Lake Storage or AWS S3.
- Understanding of financial domain data and regulatory requirements, with experience in handling sensitive financial information.
- Excellent problem-solving and communication skills, with the ability to work effectively in a collaborative team environment.
Core Competencies:
- Proven experience with Databricks and PySpark for big data processing.
- Strong programming skills in Python and advanced SQL.
- Hands-on experience with Airflow for workflow orchestration.
- Knowledge of cloud platforms (Azure or AWS or GCP) and data lake architecture.
- Excellent problem-solving and communication skills.
Preferred Qualifications:
- Bachelors’ degree in Computer Science.
- Experience working in Agile/Scrum environments, with a strong understanding of Agile methodologies and practices.
- Familiarity with CI/CD pipelines for data engineering, including tools such as Jenkins, GitLab CI, or Azure DevOps.
- Background in financial services or investment banking, with experience in handling financial data and understanding industry-specific challenges.
The expected base salary ranges from $81,000-$145,000. Salary offers are based on a wide range of factors including relevant skills, training, experience, education, and, where applicable, certifications and licenses obtained. Market and organizational factors are also considered. In addition to salary and a generous employee benefits package, successful candidates are eligible to receive a discretionary bonus.
#LI-Hybrid
Other requirements
Mizuho has in place a hybrid working program, with varying opportunities for remote work depending on the nature of the role, needs of your department, as well as local laws and regulatory obligations. Roles in some of our departments have greater in-office requirements that will be communicated to you as part of the recruitment process.
Company Overview
Mizuho Financial Group, Inc. is the 15th largest bank in the world as measured by total assets of ~$2 trillion. Mizuho's 60,000 employees worldwide offer comprehensive financial services to clients in 35 countries and 800 offices throughout the Americas, EMEA and Asia. Mizuho Americas is a leading provider of corporate and investment banking services to clients in the US, Canada, and Latin America. Through its acquisition of Greenhill, Mizuho provides M&A, restructuring and private capital advisory capabilities across Americas, Europe and Asia. Mizuho Americas employs approximately 3,500 professionals, and its capabilities span corporate and investment banking, capital markets, equity and fixed income sales & trading, derivatives, FX, custody and research. Visit www.mizuhoamericas.com.
Mizuho Americas offers a competitive total rewards package.
We are an EEO/AA Employer - M/F/Disability/Veteran.
We participate in the E-Verify program.
We maintain a drug-free workplace and reserve the right to require pre- and post-hire drug testing as permitted by applicable law.
#LI-MIZUHO