Senior Quality Assurance Analyst

Position Overview:

We’re looking for a Senior QA Automation Analyst who is passionate about building reliable software through automation-first testing. In this role, you’ll design, create, manage, execute, and automate test suites across web and mobile applications, partnering closely with product, design, and engineering. You’ll leverage Playwright and modern CI/CD practices in Azure DevOps/GitHub, with deployments and environments spanning AWS and Azure. We are initiating AI-assisted test automation on the team so experience in AI tools is a plus.  You’ll be part of a fast-paced, collaborative team driven by a startup mindset and focused on delivering innovative solutions.

What You’ll Do

• Design, build, and maintain automated test suites for web and mobile using Playwright (or alternatives like: Cypress or Puppeteer) and Appium (mobile), emphasizing reliability, maintainability, and speed.
• Create comprehensive test strategies (functional, regression, integration, end-to-end, cross-browser/device, accessibility, performance).
• Shift-left testing: Collaborate with developers on unit & API test strategies; participate in story grooming, acceptance criteria refinement, and testability reviews.
• Build CI/CD quality gates in Azure DevOps and/or GitHub Actions; integrate test results, flaky-test detection, and quality metrics dashboards.
• Manage test environments and data across AWS & Azure, including test fixtures, mocking, and service virtualization.
• Execute and triage automated and exploratory tests; isolate defects with clear repro steps, logs, video, and screenshots.
• Continuously improve UX quality: Validate usability, accessibility (WCAG), responsiveness, and visual consistency; partner with design for testable UI patterns.
• Contribute to standards: Coding style, page object models, fixtures, test data strategies, reliability practices, and documentation.
• Leverage modern tooling (e.g., BrowserStack/Sauce Labs) for cross-device coverage; use AI-assisted tools for generating test cases, locators, and flakiness analysis where appropriate.
• Metrics & reporting: Track and communicate coverage, defect leakage, mean time to detect/resolve (MTTD/MTTR), flaky-test rate, and release readiness.

Must-Have Qualifications

• 4 + years of QA/Quality Engineering experience focused on test automation.
• Strong hands-on experience with Playwright (TypeScript/JavaScript preferred) for web UI, API, and component testing.
• Solid experience with Azure DevOps (pipelines, test plans) and/or GitHub (Actions, pull request checks), including integrating automated tests into CI/CD.
• Practical knowledge of cloud environments: provisioning test environments, secrets management, and pipelines in AWS and Azure.
• Experience automating tests for mobile apps (at least one: Appium, Detox, Espresso, or XCTest).
• Proficiency with API testing (e.g., Playwright API, Postman/Newman, REST/GraphQL) and contract testing (e.g., Pact).
• Familiarity with cross-browser/device testing using BrowserStack or Sauce Labs.
• Strong debugging skills: network tab, HARs, logs, tracing, screenshots/videos, and root-cause analysis.
• Attention to UX: usability, visual consistency, and responsive behavior.
• Experience with agile practices (Scrum/Kanban), story refinement, acceptance criteria, and defect lifecycle.

Nice-to-Have / Preferred

• AI-assisted testing exposure (e.g., AI-generated test cases, locator resilience, self-healing tests, or ML-based flakiness detection).
• Performance testing (e.g., k6, Lighthouse, WebPageTest) and basic security testing familiarity (OWASP Top 10 awareness).
• Component-level testing (e.g., Playwright component testing, React Testing Library).
• Experience with observability/telemetry (CloudWatch, Application Insights), using logs/metrics/traces to drive quality.
• Basic scripting in Python/Node for test utilities; MongoDB and SQL for test data setup/validation.
• Experience with Android Automotive OS application testing a plus

Success Indicators (First 90–180 Days)

• Establish stable, fast Playwright suites integrated into CI with clear pass/fail gates.
• Reduce flaky tests and improve signal-to-noise in pipelines; measure and report trends.
• Achieve reliable coverage for critical user journeys across web and mobile.
• Implement accessibility checks and baseline performance thresholds in the pipeline.
• Partner with design/product to improve acceptance criteria and testability of UX flows.
• Demonstrate impact via metrics: reduced defect leakage, faster release cycles, confident rollback/roll-forward patterns.

 

Education

• BS in Computer Science/Engineering or equivalent experience.