Job Description
We are looking for a Senior hands-on Data Engineer for Cloud Data Lake design and development. The candidate should have Financial Services experience in design, architecture and development of large scale enterprise applications using Cloud based Data engineering platforms. This hands-on role will partner with senior-level development managers, architects and business leadership to develop and execute the technology product roadmap.
Main Duties and Responsibilities:
• End to end Cloud Data Lake design & development including data ingestion, data modeling and data distribution.
• Build data integrations, hand-offs between on-prem/cloud-based systems.
• Design and develop high volume data ingestion components and solutions to collect data from various sources.
• Manage and use appropriate tools in the cloud data lake development and deployment.
• Responsible for developing/implementing cloud infrastructure to support current and future business needs.
• Participating in technical design, application build, configuration, unit testing, and production deployment.
• Ensuring all cloud solutions exhibit higher level of cost efficiency, performance, security, scalability, and reliability
Required Skills:
• Development experience in designing, developing and deploying complex applications.
• Strong tech skillset/experience in PL/SQL, Java/J2EE, Python, Scala, PERL/scripting .
• Hands on experience with Cloud platforms, preferably using Databricks.
• Experience in building systems using modern, scalable, resilient, cloud native architectures.
• Experience in Data Modeling and database design with strong skills in performance tuning.
• Hands on experience in setting up data pipelines for ELT jobs across multiple data sources.
• Hands on experience in big-data processing, troubleshooting and resolving database performance issues.
• Strong knowledge of Cloud Security in AWS/Azure, specifically IAM Roles & Polices, Security Groups and Encryption keys.
• Experience with optimizing database performance, scalability, ensuring data security and compliance.
• Experience with event based, micro-batch and batched high volume and high velocity transaction and data processing system.
• Proficiency with CICD and DevOps.
Education & Qualifications
Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.
We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.
As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.
Discover more information on jobs at StateStreet.com/careers
Read our CEO Statement