QA Triage And Execution Analyst

Key responsibilities

Owns the stability, accuracy, and signal quality of automated test execution by systematically analyzing, debugging, and resolving failing scripts across pipelines.

• Execute and monitor pipelines in Azure DevOps
• Categorize failures:
  • Test defect vs environment vs data vs code
• Script-level debugging and root cause analysis in Playwright / Selenium
• Identify root causes such as:
  • Flaky selectors (dynamic DOM changes)
  • Synchronization/timing issues (wait conditions)
  • Assertion mismatches
  • Data dependency failures
• Validate API failures using Postman or GraphQL tools
• Inspect logs and telemetry (App Insights, pipeline logs)
• Track trends and provide triage reporting

Requirements

Required skills

• Strong debugging and analytical skills
• Experience with logs, APIs, and UI troubleshooting
• Familiarity with test automation lifecycle
• Experience with observability tools (App Insights, Azure monitoring)

Nice to have

• Mortgage/FinTech experience