Senior Engineer QA & Testing-AI, AVP

Job Title- Senior Engineer QA & Testing-AI, AVP

Location- Pune, India

Role Description

• The Deutsche India is seeking a talented Senior Engineer QA & Testing- AI to join our growing team. At the “Service Solutions and AI” Domain, our mission is to revolutionize our Private Bank process landscape by implementing holistic, front-to-back process automation. And being a Private Bank AI Centre of Excellence we are responsible for strategy building and execution of AI innovation, governance, and delivery across Private Bank, ensuring standardization, compliance, and accelerated adoption of AI solutions. We are dedicated to leveraging the power of data to drive innovation, optimize operations, and deliver exceptional value to our customers. We are committed to enhancing efficiency, agility, and innovation, with a keen focus on aligning every step of our process with the customer’s needs and expectations. Our dedication extends to driving innovative technologies, such as AI & workflow services, to foster continuous improvement. We aim to deliver “best in class” solutions across products, channels, brands, and regions, thereby transforming the way we serve our customers and setting new benchmarks in the industry.
• As a Senior QA & Testing Engineer (AI), you will be in a leadership role, instrumental in architecting and guaranteeing the superior quality and unwavering reliability of our cutting-edge AI-driven automation solutions. Your expertise will span the entire software development lifecycle, encompassing the meticulous analysis of requirements, the strategic design of comprehensive test cases, the development of sophisticated automation frameworks, and the precise execution of tests across diverse environments. Your direct influence will be critical in delivering robust, scalable, and customer-centric solutions for Private Bank, establishing new benchmarks in technological excellence and user satisfaction. Join us in shaping the future of banking through visionary technology and an unwavering commitment to quality and customer-centric design.

What we’ll offer you

As part of our flexible scheme, here are just some of the benefits that you’ll enjoy

• Best in class leave policy
• Gender neutral parental leaves
• 100% reimbursement under childcare assistance benefit (gender neutral)
• Sponsorship for Industry relevant certifications and education
• Employee Assistance Program for you and your family members
• Comprehensive Hospitalization Insurance for you and your dependents
• Accident and Term life Insurance
• Complementary Health screening for 35 yrs. and above

Your key responsibilities

• Test Strategy & Leadership:
  • Strategy Definition: Define and champion sophisticated test strategies, developing comprehensive test concepts that are meticulously aligned with ambitious sprint goals and long-term product vision.
  • Test Artifact Management: Architect, develop, and meticulously maintain complex test cases, detailed test plans, robust automation scripts, and curated datasets, ensuring alignment with evolving business and intricate AI model requirements.
  • Documentation & Traceability: Oversee and ensure the integrity of QA-related documentation, guaranteeing end-to-end traceability and auditability within JIRA and Confluence.
• Advanced Automation & Execution Excellence:
  • Framework Development: Lead the design, development, and continuous enhancement of advanced automation frameworks leveraging Python, Pytest, Behave, and UnitTest.
  • Code Quality Integration: Implement and enforce rigorous code quality checks using Black, seamlessly integrating them into robust CI/CD pipelines to ensure continuous quality.
  • API & Performance Testing: Drive advanced API automation testing and conduct impactful load/performance testing utilizing tools like Locust.
  • AI Model Validation: Strategically validate the precision, performance, and ethical compliance of AI models and complex workflows using cutting-edge metrics such as RAGAS, AgentEval, and BLEU score.
  • AI Observability & Analytics Integration: Champion the integration of LangFuse for advanced AI evaluation, real-time observability, and actionable analytics, providing deep insights into model behavior.
• Collaborative Leadership & Agile Stewardship:
  • Agile Participation: Actively lead and contribute to all Agile ceremonies, including sprint planning, daily stand-ups, retrospectives, and refinements, driving efficiency, accountability, and continuous improvement within the squad.
  • Cross-functional Collaboration: Foster profound collaboration with cross-functional teams, including developers, analysts, product owners, and deployment managers, to consistently achieve and exceed sprint and release objectives.
  • Quality Advocacy: Serve as a vocal advocate for quality across the organization, continuously refining and pioneering testing processes and best practices within the squad and beyond.

Your skills and experience

• Educational Foundation:
  • A Bachelor’s or Master’s degree in Computer Science, IT, or an equivalent field.
• Professional Experience:
  • Proven experience (8+ years) in a QA & Testing Engineer role, demonstrating successful application of QA & Testing techniques to solve real-world problems.
• Core QA Leadership:
  • Demonstrated extensive experience in leading meticulous requirements analysis, strategic test case creation, and efficient, high-volume test execution.
  • Proven, advanced expertise in architecting, building, scaling, and maintaining robust Python-based automation frameworks.
• Technical Automation Acumen:
  • Programming & Scripting: Expert-level proficiency in Python, Pytest, Behave, and UnitTest for comprehensive test automation and code quality enforcement with Black.
  • API & Performance Testing: Extensive hands-on experience with API automation testing and conducting impactful load/performance testing utilizing tools like Locust.
  • AI Model Validation: Deep familiarity with cutting-edge AI evaluation frameworks such as RAGAS and AgentEval, and a strong understanding of NLP metrics like BLEU for validating AI models and workflows.
  • AI Observability & Analytics: Advanced knowledge of LangFuse for comprehensive AI observability, real-time analytics, and actionable insights into model behavior.
  • Version Control & CI/CD: Expert understanding of CI/CD pipelines and Git for effective version control, collaborative development, and continuous quality integration.
• Desirable AI & Domain Knowledge:
  • AI/ML Workflow Exposure: Significant exposure to complex AI/ML workflows and advanced prompt engineering techniques.
  • Banking Domain Expertise: Valuable and in-depth knowledge of the banking domain, including business-specific testing methodologies and regulatory compliance.
• Leadership & Professional Competencies:
  • Leadership & Communication: Exceptional leadership, communication, and collaboration skills, with the ability to mentor junior engineers, influence cross-functional teams, and articulate complex technical concepts.
  • Analytical Problem-Solving: Superior analytical and critical problem-solving abilities, capable of navigating complex technical challenges and providing strategic solutions.
  • Proactive & Improvement-Oriented: A proactive, results-oriented, and team-centric mindset with an unwavering commitment to continuous improvement, innovation, and technical excellence.

How we’ll support you

• Training and development to help you excel in your career
• Coaching and support from experts in your team
• A culture of continuous learning to aid progression
• A range of flexible benefits that you can tailor to suit your needs

About us and our teams

Please visit our company website for further information:

https://www.db.com/company/company.html

We strive for a culture in which we are empowered to excel together every day. This includes acting responsibly, thinking commercially, taking initiative and working collaboratively.