4 publicaciones de empleo destacadas de qa engineer en coyoacán, dif (¡Están contratando!)

AI Automation QA#
WTW —Ciudad de México, CDMX
- Tiempo completo
- DevOps
- Análisis de datos
- Python
Automation Tester in JS
EPAM Systems, Inc. —Ciudad de México, CDMX
- Inglés
- JavaScript
- Vacaciones adicionales o permisos con goce de sueldo
10d
Lead Automation Tester in Java
EPAM Systems, Inc. —Ciudad de México, CDMX
- Inglés
- Java
- JavaScript
- Vacaciones adicionales o permisos con goce de sueldo
10d
Automation Tester in Java
EPAM Systems, Inc. —Ciudad de México, CDMX
- Inglés
- Java
- JavaScript
- Vacaciones adicionales o permisos con goce de sueldo
10d

More jobs to discover

Find similar jobs that you might be interested in.

Automation Tester in JS
EPAM Systems, Inc. —Ciudad de México, CDMX
Translate manual test cases and user stories into scalable, reliable, and maintainable automation scripts. Hands-on experience with modern automation frameworks…
10d

Quiero recibir la alerta de empleo más reciente para qa engineer en coyoacán, dif

Al ingresar a tu cuenta, aceptas las Condiciones del servicio de SimplyHired y das tu consentimiento a nuestra Política de privacidad y Cookies.

Explorar empleos en más ubicaciones

qa engineer jobs near coyoacán, dif

Empleos de Hardware Engineer en Ciudad De México

Empleos de Automation Engineer en Chihuahua

Empleos de Automation Engineer en Puebla, PUE.

Empleos de Quality Engineer en Monterrey, N. L.

Empleos de Automation Engineer en Mérida, YUC.

Empleos de Automation Engineer en Tijuana, B.c.

Empleos de Controls Engineer en Monterrey, N. L.

Empleos de Network Engineer en Monterrey, N. L.

Empleos de Automation Engineer en San Luis Potosí, S. L. P.

Empleos de Design Engineer en Ciudad De México

Empleos de Automation Engineer en Querétaro, QRO.

Empleos de Automation Engineer en Ciudad De México

Empleos de Automation Engineer en Guadalajara, JAL.

Empleos de Quality Assurance Analyst en Zacatecas

Empleos de Quality Global en Monterrey, N. L.

Empleos de Quality Assurance Analyst en Monterrey, N. L.

Empleos de Quality Assurance Analyst en Ciudad De México

Empleos de Quality Assurance Analyst en Colonia Polanco, CDMX

AI Automation QA#

WTW -
Ciudad de México, CDMX

Postúlate ahora

Información del empleo

Tiempo completo

Cualificaciones

Derecho
DevOps
Análisis de datos
Respuesta a incidentes
Garantía de calidad
Python

Descripción completa del empleo

Description

The Automation QA Engineer defines, implements, and continuously improves quality assurance practices for AI enabled and agent based solutions. The role ensures systems meet agreed standards for accuracy, reliability, performance, safety, and compliance, and supports operational readiness through automated evaluation and monitoring.

The role:

Definition and execution of testing and quality assurance strategies for AI enabled workflows
Continuous evaluation and monitoring of system behavior in production environments
Contribution to auditability, risk management, and continuous quality improvement
Define quality criteria and testing strategies for agent workflows, covering accuracy, latency, safety, compliance, and operational risk
Build automated evaluation harnesses to assess agent performance, including hallucination rates, tool misuse, policy violations, and task success
Implement continuous production monitoring to detect anomalies, quality degradation, and emerging safety concerns
Develop and maintain automated test suites using Playwright for UI testing and custom scripts for API and workflow validation
Apply LLM evaluation frameworks to assess output quality, regression, and system drift over time
Produce and maintain dashboards and reports that communicate quality metrics and trends to engineering and stakeholders
Develop and maintain runbooks for common failure modes and contribute to incident response activities
Collaborate closely with developers to improve prompts, tool definitions, and workflow designs based on test results
Ensure testing, logging, and monitoring practices align with data privacy, audit, and regulatory requirements

Qualifications

Minimum 3 years’ experience in QA, test automation, or DevOps roles (or 2 years with direct experience testing AI or ML enabled systems)
Strong Python skills for test automation, evaluation harnesses, and basic data analysis
High attention to detail, with a focus on issues that materially impact reliability and user trust
Comfort working with evolving tools, frameworks, and testing practices
Collaborative mindset, using evidence based insights to influence product and engineering decisions
Programming: Python (test automation, evaluation harnesses, data analysis)
UI Automation: Playwright (end‑to‑end workflow testing)
AI Evaluation: Deepeval, RAGAS, Evidently.AI (LLM quality, drift, and regression analysis)
Workflow Testing: API and agent workflow validation using custom scripts
Monitoring: Production quality monitoring and anomaly detection

WTW is an Equal Opportunity Employer

Postúlate ahora

Refina tu búsqueda

qa engineer empleos en coyoacán, dif

AI Automation QA#

Automation Tester in JS

Lead Automation Tester in Java

Automation Tester in Java

More jobs to discover

Quiero recibir la alerta de empleo más reciente para qa engineer en coyoacán, dif

Related Searches

Explorar empleos en más ubicaciones

Description

Qualifications

Herramientas para candidatos

Herramientas para empresas

Explorar

Mantente conectado