Lead Quality Engineer - R01573517 at Brillio 2, Bengaluru

Open. Posted .

AI-agent quality engineering across safety evaluations, adversarial testing and CI/CD pipelines, with automated test suites and risk analysis for product applications and microservices.

Apply on Brillio 2's site for Lead Quality Engineer - R01573517

Applying opens the employer's page. Want jobs like this sent to you each morning? Open Elip.

Key facts
LocationBengaluru, Karnataka
Work modeOn-site
Experience4–6 years
PayNot stated by the employer
RoleQA Engineer
Skills asked forPython, PyTest, DeepEval, Ragas, Giskard, LangSmith, Google Agent Development Kit (ADK), Vertex AI
Posted13 Nov 2026

Elip's summary

Quality engineer at a technology services company. Evaluates AI agents and product applications for safety, bias, toxicity, and robustness, applying safety evaluations (red teaming, adversarial testing), Prompt injection testing, and Python. Integrates evaluation pipelines into CI/CD workflows and analyzes results with Pandas and SQL.

The job, in the employer's words

The Role

Lead Quality Engineer

Primary Skills

Test Data Management, Jenkins, Regression Testing, Postman, Selenium, Functional Testing, BDD - Behavior Driven Development, SoapUI, System Integration testing, Application Testing, Pixel Testing, Cross Browser Testing, Zephyr, TDD - Test Driven Development, Accessibility Testing (JAWS), Visual Testing, Cucumber

Specialization

Quality Engineering - Product Applications & Microservices: Lead Quality Engineer

Job requirements

Experience Range: with at least 4 to 6 years of experience in quality engineering, including hands-on testing and evaluation of AI-powered product applications and microservices Key Responsibilities: 1. Develop and execute robust evaluation frameworks for AI agents, focusing on Responsible AI and safety metrics such as bias, toxicity, and alignment failures 2. Design synthetic testing environments and simulation strategies to stress-test agents under diverse real-world conditions 3. Implement adversarial testing, red-teaming, and prompt injection methodologies to identify vulnerabilities and ensure agent robustness 4. Integrate evaluation pipelines into CI/CD workflows for continuous quality assurance and rapid iteration 5. Collaborate with policy and legal teams to ensure agent evaluations meet regulatory compliance and ethical standards 6. Analyze evaluation results and provide actionable insights to development teams, prioritizing safety and risk mitigation 7. Configure and execute automated test suites using Python and relevant AI/ML testing libraries (e.g., PyTest, DeepEval, Ragas, Giskard) 8. Manage bug detection, documentation, and tracking using Jira, focusing on performance degradations and alignment failures Required Skills: 1. Python programming 2. PyTest 3. DeepEval 4. Ragas 5. Giskard 6. Langsmith 7. Google Agent Development Kit (ADK) 8. Vertex AI 9. Safety evaluations (red teaming, adversarial testing) 10. Prompt injection testing 11. API testing for AI/ML systems 12. Data analysis with Pandas and SQL Preferred Skills: 1. Gemini models 2. Hugging Face 3. Garbage-in/Garbage-out (GIGO) testing tools 4. Data poisoning techniques 5. AI ethics principles and policy background 6. Visualization tools for evaluation results Desired Qualifications: 1. Bachelor's degree in Computer Science, Artificial Intelligence, Information Technology, or Software Engineering 2. ISTQB Foundation Level certification or Certified Software Tester (CST) 3. Certification in AI/ML testing or Responsible AI (e.g., Google Cloud Certified - Professional Machine Learning Engineer)

About Brillio 2

Headquartered in Dallas, founded in 2014.

People in Elip's index who work here
5,197
Typical time at Brillio 2
2.9 years
Typical career length so far
8.7 years

Largest teams

  • Engineering1,925 people
  • Information Technology798 people
  • Quality Assurance346 people
  • Leadership227 people

Where people here worked before

  • Cognizant134 people
  • Infosys87 people
  • Tata Consultancy Services87 people
  • Wipro85 people
  • Accenture77 people

Where people went next, since 2025

  • Cognizant36 people
  • Capgemini35 people
  • Deloitte32 people
  • Wipro32 people
  • Accenture26 people

Totals from public professional profiles in Elip's index; any group under ten people is left out.

All open jobs at Brillio 2

Similar open jobs

More jobs in Bengaluru or all jobs on Elip

About this page

Elip lists jobs that employers publish on their own careers sites, never copies from job boards. This one comes from Brillio 2's listing on Lever, posted 13 Nov 2026. The summary is Elip's; the description is the employer's. When the job closes, this page says so.