Saarth Kishore

Deployed LLMs don’t fail loudly — they drift. Tone is a three-layer reliability stack: catch behavioral regressions before merge, monitor production, and diagnose a single chat when it goes off-goal.

15

Runtime probes · 5 tone / 5 fact / 5 persona

≤5 min

Scheduled sample cadence

3

Drift signals · MMD + KL + cosine

7+

LLM presets · any OpenAI-compatible

3

llmtest assertion types

0.35–0.40

Category alert thresholds

• Runtime monitor — 15 curated probes on a ≤5 min cycle; MiniLM + ChromaDB; MMD / KL / cosine heatmap alerts (category floors 0.35–0.40); detector unit tests separate identical vs shifted corpora
• Chat review — paste a transcript or upload a ChatGPT export; per-turn goal-drift timeline, peak/first-alert, and steering tips from the connected LLM or Tone heuristics
• llmtest — “pytest for AI behavior”: semantic equals / tone / excludes assertions, snapshot baselines, example 3-test suite, and a GitHub Action that fails PRs on drift
• Generate llmtest — from a drifted chat, emit distinct probes with claim-level baselines (style personas + adversarial excludes), then copy-paste into CI — production signal → prevention
• Connectors — presets for OpenAI, OpenRouter, Groq, Together, DeepSeek, Fireworks, Ollama, plus any OpenAI-compatible /v1 endpoint; JWT / Google auth; live at tonehq.xyz

• FastAPI
• React
• TypeScript
• ChromaDB
• GitHub Actions
• llmtest
• Railway

Shoppers can’t tell if reviews are human or AI-generated. Built a niche detector for short, informal product reviews — with a high-precision threshold so real customers aren’t falsely flagged.

13

Supported review sites

1.00 / 0.90

Precision / recall (AI) · held-out test

0.00

False-positive rate on humans

400

Reviews evaluated · 280 / 60 / 60 split

2

Chrome Web Store installs

0.72

Production AI threshold

• Manifest V3 extension — per-site adapters across 13 shopping / review sites; listing trust card, per-review badges, hover signals
• FastAPI on Render — calibrated sklearn hybrid + listing analysis: template clusters, posting bursts, adjusted ratings, visit history sparklines
• Held-out hybrid test (n=60): precision 1.00, recall 0.90, FPR 0.00 at threshold 0.72; trained on 400 matched human/AI reviews
• Production API at ai-comment-checker.onrender.com; live on the Chrome Web Store

• Chrome Extension
• FastAPI
• scikit-learn
• JavaScript
• Python
• Docker
• Render

Cloud assistants train on your screen data. Omnitrix keeps perception, reasoning, and memory on-device — always available, never uploading pixels.

• Screen capture → OCR/CV → local Ollama LLM → Mem0 + ChromaDB → tray overlay
• Active-window context, streaming responses, vector memory for habits across sessions
• Global hotkeys and non-blocking overlay; offline-capable once models are pulled

• Python
• Ollama
• OpenCV
• OCR
• ChromaDB
• Mem0

Players sketch weapons, body parts, and tools that become playable gear. Sketch quality maps to stats — the better you draw, the better it works.

1→3

Forge categories

2→15+

Object classes

10–90s→<1s

Score latency

1 PC→Public

itch.io Windows

• In-game forge → PNG export → cloud Judge Bridge (validate + hybrid ink/AI score) → equip
• Mode B: game on itch.io, judge on Render — gameplay and AI update independently
• Melee, ranged, and body forges shipped; fairness floors/ceilings and anti-exploit guards

• Unreal Engine 5
• Python
• Computer Vision
• Render
• Game Design

Controllers break immersion when you want to play standing up. Built a full dual-hand gesture pipeline so walk, combat, inventory, and a God of War–style camera all run from a laptop webcam.

• MediaPipe Hands → static + dynamic classifiers → priority dispatcher → JSON WebSocket → Unity 6
• Left hand: walk, jump, slash, punch, blast · Right hand: fist orbit look, inventory, pointer, accept/deny
• Simultaneous two-hand input; grounded jump, attack feedback, and camera-relative locomotion shipped

• Unity 6
• MediaPipe
• OpenCV
• Python
• WebSockets
• C#
• Computer Vision

Grow crops, hatch pets, and unlock a private estate. Full farm loop with rebirths, automation, world shops, and same-server estate visits — published on Roblox.

• Server-authoritative plant / harvest, weather, mutations, and DataStore progression
• Pets, gear tiers, auto systems, decor, and estate expansion up to 64 fields
• Cohesive client UI — hotbar, shops, settings, SFX, and sell feedback

• Roblox
• Luau
• DataStores
• Gameplay Systems
• Economy Design