Sagar Gupta

AI Engineer with over 10 years building production mobile and streaming systems, now focused on on-device AI — open-source infrastructure for running LLMs and RAG directly on edge devices.

Open to full-time & contract — on-device, self-hosted & cloud AI, plus Android.

About & résumé GitHub

Selected Projects

ScholarMind

The AI library in your pocket — free offline NCERT books that read beautifully, an AI that answers from the book with the exact page, plus quizzes, flashcards and games. Coming to Google Play as a closed pilot.

On-device AIEducationAndroidOffline
ScholarMind

litertlm-kmp

A Kotlin Multiplatform engine for running Gemma LLMs fully on-device.

Kotlin MultiplatformLLMsAIAndroidiOS
litertlm-kmp

NativeLM

A private local-AI chat app built on top of litertlm-kmp to prove the whole stack.

Android AppLocal AIPrivacy
NativeLM

Latest Writing

What on-device LLMs actually cost on mid-range Android

June 23, 2026

Reproducible benchmark numbers from a Snapdragon 7 Gen 1 phone and a Snapdragon 870 tablet — measured from inside the app, on the CPU, fully offline. Decode tok/s, time-to-first-token, peak RAM, and RAG latency.

What's new in NativeLM v0.10.0: answering from the right document

June 9, 2026

v0.10 is a retrieval release — an optional EmbeddingGemma embedder tiered to your device, hybrid dense + lexical search, a flagship reranker, and a set of grounding fixes that stop the model answering from the wrong file. Still fully local, no account, no upload, no telemetry.

View all writing →