Principal GenAI & Agentic AI Engineer

The Principal GenAI & Agentic AI Engineer is the technical leader responsible for designing, building, and scaling AI systems that combine LLM-powered GenAI and ADK-based agentic workflows on Google Cloud Platform. This role also requires leading and developing data pipelines for necessary data layer for AI/ML. This role sets architecture standards, leads multi-team delivery, and governs safety, reliability, and cost at enterprise scale—accelerating product teams to achieve monetization of AI based products through reusable patterns, platforms, and guardrails.

Key Responsibilities

Strategy & Architecture

Define reference architectures for GenAI apps, RAG systems, and agent ecosystems (single/multi-agent) on GCP using ADK. Leverage capabilities of Gemini Enterprise Agent Platform in the Agentic AI Product development. Establish domain and platform standards: model selection, RAG/generation patterns, memory architectures, security baselines, observability, and LLMOps. Lead portfolio-wide technical decisions (build/buy, vendor selection, SLAs, quotas) with a focus on reliability, safety, and cost control. Define the data pipeline development for lakehouse, delta lake or feature engineering.

Solution Design & Delivery

Architect and lead implementation of production-grade GenAI solutions (Vertex AI models, Grounding, Pipelines, Evaluation) and agentic services (planning, tools, memory, HIL). Design multi-tenant and hub-and-spoke patterns with Okta/IAP/Apigee for secure API exposure and tenant isolation. Drive end-to-end delivery across teams: data ingestion (Dataflow/Composer), indexing (BigQuery vectors/Vertex Vector Search), services (Cloud Run/Workflows), events (Pub/Sub). Data Pipeline both near real time and batch.

Platformization & Reuse

Build and maintain prompt libraries, tool catalogs, agent templates, and evaluation harnesses for organization-wide reuse. Standardize LLMOps: CI/CD for prompts/models/agents, model registry, traceability, rollback, canaries, cost/performance scorecards. Enable a marketplace of agents/services with productized APIs, documentation, chargeback, and KPIs.

Responsible AI, Security & Compliance

Implement multi-layer guardrails: policy prompts, filters, memory governance, tool whitelisting, audit logs; ensure regulator-ready posture. Codify privacy, PII handling, data residency, and per-tenant isolation using VPC-SC, Secret Manager, IAM, and Apigee policies.

Leadership & Enablement

Mentor senior engineers and team leads; run architecture reviews, design clinics, and red-team exercises. Drive continuous evaluation programs and publish org scorecards for quality, safety, and cost. Partner with Product, Security, and SRE to align roadmaps, SLOs, and operational playbooks.

Required Technical Competencies

Dataflow and Apache Beam for data pipeline development. Strong on using SQL for data analysis. LLM & GenAI: Model selection (Gemini & Model Garden), prompt engineering, RAG/grounding, multimodal pipelines, fine-tuning/adapter methods. Agentic AI (ADK): Agent loops, planners, tool/function design, memory (episodic/semantic/long-term), HIL, policy enforcement. Data & Retrieval: BigQuery (including vector functions), Vertex Vector Search, Document AI, Dataplex for lineage and governance. Orchestration & Services: Cloud Run, Workflows, Pub/Sub, Dataflow/Composer; HA/DR, backpressure, circuit breakers. LLMOps/MLOps: Vertex AI Pipelines, registry, CI/CD, trace correlation, cost/performance monitoring. Security & Compliance: IAM, Secret Manager, VPC-SC, private service connect, DLP, Okta/IAP, Apigee API policies. Observability & Cost: Central telemetry, user feedback loops, drift/outlier detection, quota/capacity planning.

Qualifications

12–15+ years in software/data/ML engineering; 1+ years hands-on with LLMs/GenAI and agentic systems. Proven delivery of enterprise-scale GenAI/agent platforms on GCP (Vertex AI, BigQuery, Cloud Run, Pub/Sub, Workflows). Demonstrated impact in platformization, governance, and multi-team technical leadership. Strong proficiency in Java. Strong proficiency in Python/TypeScript (or equivalent) and infrastructure-as-code (Terraform/GCP Deployment Manager). Experience in security-by-design, privacy, and compliance audits. Proven delivery in building data pipeline using distributed computing frameworks such as Dataflow, Spark.