Senior QA Engineer

Job Description:

Job Title: Senior Quality Engineer
Experience: 5- 7 years

Requirements: 

• Bachelor's/Master's degree in Computer Science or related field. 
• 5-6 years of experience in Quality Engineering (QE) domain. 
• Good understanding of Generative AI tools and platforms - especially LLMs. 
• Foundation Knowledge of Gen-AI concepts, technologies, tools and frameworks
• Basic understanding of LLM models, prompt engineering, and some exposure to AI Art models and tools
• Detailed understanding and solid hands-on working knowledge of LLM evaluations, and using evaluators to validate the quality of LLM outputs.
• Solid knowledge of software testing methodologies, tools, and processes. 
• Excellent analytical and problem-solving skills. 
• Effective communication and collaboration skills. 
• Proven ability to lead and mentor team members. 
• Ability to lead quality assurance for data-driven and data-intensive apps and solutions
• Ability to prepare and organize test data sets and manage large amounts of test data
• Performing thorough data validation and verification to ensure accuracy and consistency of data. This includes developing and executing test plans, scripts, and tools for data verification. 
• Build and execute test plans for workflow driven apps and solutions, and pipeline automation solutions
• Developing and implementing automated testing tools and frameworks to streamline QA processes. Optimize testing procedures for efficiency and effectiveness. 

  

Responsibilities: 
>Take ownership of solution quality for a digital product or platform

>Collaborate closely with the Dev team and Product team to drive quality engineering and assurance for an existing digital product

>Ensure successful client adoption and client onboarding as new clients are onboarded onto a digital product/platform.

>Lead and execute comprehensive automated testing strategies for cloud applications, ensuring high quality and reliability. 
>Hands-on experience with API test tools (ex. Postman, SOAP UI, etc.) , API test automation

>Hands-on experience with Test Automation overall – and the ability to automate all aspects of testing, from UE to Back-End Testing
>Proficient in designing, implementing, and maintaining automated test scripts. 
>Thorough understanding of Gen AI automation principles and implementation. 

>Solid understanding of using LLM Evaluation frameworks and libraries (such as RAGAS and others) to perform automated evaluation of LLM Outputs

>Solid understanding of LLM Quality metrics and validating AI generated outputs

> Proven experience on testing of creative apps  . 
> Experience with testing mobile apps is an advantage (nice-to-have)

> Collaborate with cross-functional teams to define testing requirements and ensure effective test coverage. 
>Conduct test case reviews, identify gaps, and provide constructive feedback to improve overall test quality. 
>Analyze and troubleshoot complex issues in a timely manner, documenting and communicating findings. 
>Stay updated with industry best practices and emerging technologies in QA and automation. 
>Mentor and guide junior QA engineers, fostering a collaborative and knowledge-sharing environment. 
>Continuously improve testing processes and methodologies to enhance efficiency and effectiveness. 

Location:

Pune

Brand:

Dentsu Creative

Time Type:

Full time

Contract Type:

Permanent