Projects

Things I've built end to end — each one links out to the code, a write-up, or a deeper page.

LLM Serving Stack

LLM Serving Stack

An OpenAI-compatible inference gateway in front of Ollama: admission control, streaming, prompt-based routing, auth and rate limiting, with Prometheus, Grafana and Jaeger behind it. It speaks the protocol vLLM and TGI use; a real vLLM has not yet run behind it.

Edge Agent Ops

Edge Agent Ops

A guardrailed LLM agent that monitors a fleet of edge AI inference nodes, diagnoses faults, and remediates them only within hard policy limits. Ships an evaluation harness and a live Prometheus + Grafana observability stack.

Grafana dashboard during the served evaluation: control rate at 30 Hz, zero deadline misses, action queue refilling, chunk round trip about 70 to 87 ms

Gurukul: A robot learning stack on a real arm

One low-cost SO-ARM101 arm, built up one project at a time with Hugging Face LeRobot: imitation learning, serving and observability, and data curation at scale.

Ray Multimodal Pipeline

A distributed multimodal pipeline on Ray that ingests autonomous-driving sensor data (camera + lidar + metadata), preprocesses it, and runs pretrained-model batch inference at scale — writing structured Parquet. An exercise in ML-infra orchestration: stateless Ray Data tasks for preprocessing, an actor pool for inference.