Principal AI Software Engineer, Agent Harness
EnCharge AI · Greater Delhi Area
- Experience10–11 yrs
- SalaryNot disclosed
- Work modehybrid
- Posted27 Sept 2026
About EnCharge AI
EnCharge AI is hiring in Greater Delhi Area in semiconductors electronics. This role looks for around 10+ years of experience.
Skills
- Python
- Go
- Rust
- C/C++
- RAG
- context management
- memory for LLM applications
- sandboxing
- isolation
- permission models
- quantization
- model serving
- agent loops
- tool calling
- observability
The role
A generative AI engineer at an artificial intelligence platform company builds agent systems using Python, RAG, and model evaluation. The role develops reliable tool use, memory, permissions, orchestration, and production interfaces.
Full job description
Principal AI Software Engineer, Agent Harnesswww.enchargeai.com
Job Description:Location: Remote (India)/Bangalore /Delhi ( Hybrid- 2 days office/3 days home)Principal Research Engineer, Applied AI
Principl AI Software Engineer, Agent HarnessLocation: Bengaluru, Karnataka (or throughout India remote-friendly with travel)About EnCharge AIEnCharge AI is building the next generation AI platform. Our novel in-memory-computing architecture delivers a 10x step-function improvement in compute energy efficiency and performance for AI inference workloads. As the demands of artificial intelligence move beyond today's models, we believe fundamental underlying infrastructure must evolve. We are an experienced team of AI researchers, silicon & systems engineers, and architects backed by leading investors, poised to become the essential platform for the next wave of AI innovation.The OpportunityWe serve open-weight models and our own bespoke checkpoints on EnCharge hardware. The models change often, and the harness around them needs to keep up. You own this layer that runs agents against files, tools, documents with permissions, memory, unattended execution, and real outputs. It will be assembled from a combination of open-source and bespoke code.Key ResponsibilitiesOwn the harness architecture end to end — agent loop, safe execution, context management, knowledge base, memory, permissions, orchestration, outputs, interfaces, observability — one component per layer, with clear interfaces so layers can be swapped.Build the pieces with no open-source equivalent e.g. session semantics, enforced permissions, memory in a human-editable file, orchestrator, and outputs.Keep pace with the models: adapters, prompt formats, tool-call schemas, stop conditions, benchmarking and evaluation.Make tool use reliable across models of uneven tool-calling quality — validation, repair, retries, fallbacks.Develop agents, tools, and MCP servers for internal and customer use cases, and review them for security before they ship.Build the evaluation harness: task suites, regression runs on every model or harness change, cost and latency per task alongside quality.Define the interfaces: session API, CLI, GUI, and an endpoint existing tools can point at.Qualifications10+ years of software engineering experience in backend systems or ML infrastructureStrong Python and at least one systems language (e.g., Go, Rust, C++)Have shipped and operated an agent loop in production — tool use, multi-step workflows, unattended runsHands-on with RAG, context management, and memory for LLM applicationsExperience with sandboxing, isolation, and permission models for automated systemsHave run open-weight models yourself and understand how quantization and serving choices change model behaviourComfort in fast-moving, ambiguous environments where you define the roadmap; strong product instinctsNice to HaveContributions to open-source agent harnesses or coding agentsExperience with agent benchmarks (e.g., SWE-bench, Terminal-Bench) and building internal task suitesMoE serving familiarity e.g. expert placement, tensor parallelism, quantization etc.Observability for LLM systemsDocument parsing and indexing pipelinesDesktop or GUI application experience
Contact:UdayMulya Technologiesmuday_bhaskar@yahoo.com"Mining The Knowledge Community"