Now · Oct 2026
What I'm up to right now.
A snapshot of the projects, ideas, and rabbit holes I'm in. Inspired by /now pages. Updated monthly.
Shipping
- Self-hosted LLM inference & training platformServing open-source LLMs on H100/H200 with vLLM, speculative decoding and MIG at Publicis Sapient
- Dossier v2 — async agent orchestrationMoving from ThreadPoolExecutor to a proper DAG runner
- This portfolio site — adding more interactive piecesshivangsingh.dev
Reading
- Anthropic's recent papers on constitutional AI + agentic eval
- Designing ML Systems — Chip Huyen
- Daily: Hacker News, /r/MachineLearning, AI papers feed
Learning
- TODO: what I'm learning right now
Thinking about
- TODO: what I'm thinking about
Listening
- Lo-fi · The xx · Bonobo for deep work
- Podcasts: Latent Space, Practical AI, Lex Fridman on systems
Life
- Bengaluru, IN · IST
- Open to Machine Learning Engineer / LLM inference roles — full-time or contract
- Always up for a chat about making LLMs fast and cheap to serve