Lead Quality Engineer - R01573517 at Brillio 2, Bengaluru
Open. Posted .
AI-agent quality engineering across safety evaluations, adversarial testing and CI/CD pipelines, with automated test suites and risk analysis for product applications and microservices.
Applying opens the employer's page. Want jobs like this sent to you each morning? Open Elip.
| Location | Bengaluru, Karnataka |
|---|---|
| Work mode | On-site |
| Experience | 4–6 years |
| Pay | Not stated by the employer |
| Role | QA Engineer |
| Skills asked for | Python, PyTest, DeepEval, Ragas, Giskard, LangSmith, Google Agent Development Kit (ADK), Vertex AI |
| Posted | 13 Nov 2026 |
Elip's summary
Quality engineer at a technology services company. Evaluates AI agents and product applications for safety, bias, toxicity, and robustness, applying safety evaluations (red teaming, adversarial testing), Prompt injection testing, and Python. Integrates evaluation pipelines into CI/CD workflows and analyzes results with Pandas and SQL.
The job, in the employer's words
The Role
Lead Quality Engineer
Primary Skills
Test Data Management, Jenkins, Regression Testing, Postman, Selenium, Functional Testing, BDD - Behavior Driven Development, SoapUI, System Integration testing, Application Testing, Pixel Testing, Cross Browser Testing, Zephyr, TDD - Test Driven Development, Accessibility Testing (JAWS), Visual Testing, Cucumber
Specialization
Quality Engineering - Product Applications & Microservices: Lead Quality Engineer
Job requirements
Experience Range: with at least 4 to 6 years of experience in quality engineering, including hands-on testing and evaluation of AI-powered product applications and microservices Key Responsibilities: 1. Develop and execute robust evaluation frameworks for AI agents, focusing on Responsible AI and safety metrics such as bias, toxicity, and alignment failures 2. Design synthetic testing environments and simulation strategies to stress-test agents under diverse real-world conditions 3. Implement adversarial testing, red-teaming, and prompt injection methodologies to identify vulnerabilities and ensure agent robustness 4. Integrate evaluation pipelines into CI/CD workflows for continuous quality assurance and rapid iteration 5. Collaborate with policy and legal teams to ensure agent evaluations meet regulatory compliance and ethical standards 6. Analyze evaluation results and provide actionable insights to development teams, prioritizing safety and risk mitigation 7. Configure and execute automated test suites using Python and relevant AI/ML testing libraries (e.g., PyTest, DeepEval, Ragas, Giskard) 8. Manage bug detection, documentation, and tracking using Jira, focusing on performance degradations and alignment failures Required Skills: 1. Python programming 2. PyTest 3. DeepEval 4. Ragas 5. Giskard 6. Langsmith 7. Google Agent Development Kit (ADK) 8. Vertex AI 9. Safety evaluations (red teaming, adversarial testing) 10. Prompt injection testing 11. API testing for AI/ML systems 12. Data analysis with Pandas and SQL Preferred Skills: 1. Gemini models 2. Hugging Face 3. Garbage-in/Garbage-out (GIGO) testing tools 4. Data poisoning techniques 5. AI ethics principles and policy background 6. Visualization tools for evaluation results Desired Qualifications: 1. Bachelor's degree in Computer Science, Artificial Intelligence, Information Technology, or Software Engineering 2. ISTQB Foundation Level certification or Certified Software Tester (CST) 3. Certification in AI/ML testing or Responsible AI (e.g., Google Cloud Certified - Professional Machine Learning Engineer)
About Brillio 2
Headquartered in Dallas, founded in 2014.
- People in Elip's index who work here
- 5,197
- Typical time at Brillio 2
- 2.9 years
- Typical career length so far
- 8.7 years
Largest teams
- Engineering1,925 people
- Information Technology798 people
- Quality Assurance346 people
- Leadership227 people
Where people here worked before
- Cognizant134 people
- Infosys87 people
- Tata Consultancy Services87 people
- Wipro85 people
- Accenture77 people
Where people went next, since 2025
- Cognizant36 people
- Capgemini35 people
- Deloitte32 people
- Wipro32 people
- Accenture26 people
Totals from public professional profiles in Elip's index; any group under ten people is left out.
Similar open jobs
About this page
Elip lists jobs that employers publish on their own careers sites, never copies from job boards. This one comes from Brillio 2's listing on Lever, posted 13 Nov 2026. The summary is Elip's; the description is the employer's. When the job closes, this page says so.