Gen AI Contractor

About EarnInAs one of the first pioneers of earned wage access, our passion at EarnIn is building products that deliver real-time financial flexibility for those with the unique needs of living paycheck to paycheck. Our community members access their earnings as they earn them, with options to spend, save, and grow their money without mandatory fees, interest rates, or credit checks.We’re fortunate to have an incredibly experienced leadership team, combined with world-class funding partners like A16Z, Matrix Partners, DST, Ribbit Capital, and a very healthy core business with a tremendous runway. We’re growing fast and are excited to continue bringing world-class talent onboard to help shape the next chapter of our growth journey. POSITION SUMMARYEarnIn's Gen AI Team is on a mission to deliver the best agentic experience for our customers — accurate, fast, and set up for success. At the heart of that mission is Evaluation-Driven Development (EDD): a closed loop of human judgment and calibrated LLM scorers that lets us ship new chatbot capabilities with confidence, measure performance in real time, and tie every change to business outcomes.To help us execute on this vision, we are hiring a Gen AI Contractor for the Analytics Engineering Team. This position is based in Bengaluru, India, requires two days a week in-office as part of our expanding site location, and is a 6-month contract engagement starting in January 2027. WHAT YOU'LL DOHelp build and run evaluations for our LLM-powered chatbot systems, contributing to our goal of making evals a standard practice across all teams at EarnInSupport the design and calibration of LLM-as-judge scorers, working closely with subject matter experts (SMEs) to align automated scoring with human ground truthContribute to conversation simulation and replay infrastructure — a core building block of our automated research loopAssist with real-time observability tooling to detect chatbot performance degradation before customers feel itHelp analyze production conversations and surface insights that drive chatbot improvementsWork alongside ML engineers and analysts to iterate on prompt mutations, model changes, and evaluation pipelinesWHAT WE'RE LOOKING FORCurrently pursuing a Bachelor's or Master's degree (B.E., B.Tech, M.Tech, or equivalent) in Computer Science, Software Engineering, or a related field from an Indian universityGenuine curiosity about large language models, AI evaluation, and building reliable Gen AI systemsFamiliarity with Python and comfort working with APIs, data pipelines, or scriptingBasic understanding of NLP concepts or hands-on experience with LLMs (even through personal projects or coursework) is a plusStrong understanding of probability theory and stochastic systems is a significant plusStrong analytical thinking — you ask "how do we know this works?" before shippingClear written and verbal communication; you can translate findings for both technical and non-technical audiencesSelf-directed and thorough — you take ownership, follow through, and don't leave things half-done At EarnIn, we believe that the best way to build a financial system that works for everyday people is by hiring a team that represents our diverse community. Our team is diverse not only in background and experience but also in perspective. We celebrate our diversity and strive to create a culture of belonging. EarnIn does not unlawfully discriminate based on race, color, religion, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), gender identity, gender expression, national origin, ancestry, citizenship, age, physical or mental disability, legally protected medical condition, family care status, military or veteran status, marital status, registered domestic partner status, sexual orientation, genetic information, or any other basis protected by local, state, or federal laws. EarnIn is an E-Verify participant. EarnIn does not accept unsolicited resumes from individual recruiters or third-party recruiting agencies in response to job postings. No fee will be paid to third parties who submit unsolicited candidates directly to our hiring managers or HR team.