*what you will do*
- architect and oversee end-to-end test strategies across different layers in the testing pyramid;
- define, evaluate, and monitor model validation criteria, including accuracy threshold, confidence scoring, fallback behaviors, etc.;
- drive the automation of qa processes, ensuring robust, scalable processes for data ingestion, extraction, and classification;
- lead the validation integration points between ai components and business logic, identifying risks and ensuring seamless operation;
- own, maintain, and evolve the test infrastructure, specifically the ci/cd quality gates, data generation, and automated validation scripts;
- establish and monitor key quality metrics aligned with the business goals, including turnaround time, confidence scores, and user corrections;
- act as a strategic partner to product and engineering, and advocate for quality from design through delivery;
- sense of ownership, take ownership of code quality through exploratory and automated tests.
*must haves*
- bachelor’s degree in computer science, information systems, engineering, or a related field experience;
- 5+ years in aqa, software test engineering, or related roles, including leadership responsibilities;
- experience in aqa javascript;
- solid knowledge of software development life cycle (sdlc), agile methodologies, and quality assurance or quality engineering methodologies;
- proven experience building and scaling test automation frameworks (e.g. Pytest, cypress, selenium, postman, etc.). Strong technical skills with rest apis, data, pipelines, and backend services;
- strong technical background with apis, ci/cd pipelines, backend services, and cloud environments (aws, azure);
- exceptional attention to detail, with a mindset for building robust systems that catch issues early and protect the customer experience;
- demonstrated fast, proactive learning skills, especially crucial in the rapidly changing field of ai;
- uppper-intermediate english level.
*nice to haves*
- experience testing ai/ml in production environments;
- experience with genai model evaluation metrics;
- experience setting up proactive monitoring and alerting systems to catch issues like model drift, performance degradation, or workflow failures.
*the benefits of joining us*
- *professional growth*:accelerate your professional journey with mentorship, techtalks, and personalized growth roadmaps.
- *competitive compensation*:we match your ever-growing skills, talent, and contributions with competitive usd-based compensation and budgets for education, fitness, and team activities.
- *a selection of exciting projects*:join projects with modern solutions development and top-tier clients that include fortune 500 enterprises and leading product brands.
- *flextime*:tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office, whatever makes you the happiest and most productive.
- good luck! We're rooting for you! _
work location: remote