Hello

Selected projects by Ankit Kaushik

Cost-Aware Model Routing Gateway for LLM Applications

LLMRouter

A routing gateway that scores query complexity with local embeddings and dispatches each request to the cheapest capable model in a tiered pool, escalating only ambiguous queries to an LLM-based judge so classification stays off the hot path. Hardened for production with per-request budget ceilings, automatic failover on provider timeouts and rate limits, and structured logging of every routing decision.

  • Python
  • LLM Routing
  • Embeddings
  • FAISS
  • Evaluation Harness
  • Cost Benchmarking
  • Structured Logging
  • Failover
github.com/DeveloperAnkitKaushik/LLMRouter
Screenshot pending
My Journey

Work
Experience

A timeline of my professional experience shipping production LLM features — AI agents, retrieval pipelines, and workflow automation — alongside the platform work that keeps them fast and reliable.

  1. Software Engineer

    WallmantraNew Delhi

    • Built and shipped "Grace AI", an AI-assisted shopping layer that lets customers find products in natural language and get personalised recommendations across the catalog.
    • Added LLM-powered customer support workflows that handle common queries automatically and keep responses consistent, reducing manual support load.
    • Improved storefront performance, cutting page load times by ~25% through caching and query optimisation.
    • Set up a modular, reusable service architecture with onboarding docs that helped new developers get productive faster.
    • Worked with product, design, and growth teams to ship AI features that made products easier to discover and improved checkout.
  2. Software Engineer Intern

    Amantya TechnologiesOnsite, Gurugram

    • Designed multi-step agent workflows that automated client request handling and reduced manual work for the operations team by ~40%.
    • Built a structured logging and monitoring setup with automatic file rotation that significantly cut log storage and made issues easier to trace.
    • Standardised log formats and error-tracing across services, making debugging and deployments faster and more reliable.

Get in
Touch

Profile Background

Ankit Kaushik

Full-Stack & Gen AI Engineer

Ankit Kaushik

LLMRouter

Cost-Aware Model Routing Gateway

SemCache

Semantic Caching Layer for LLMs

Portfolio

Developer Portfolio Website

Grace AI

AI-Assisted Shopping Layer

Grace AI

AI-Assisted Shopping Layer

Portfolio

Developer Portfolio Website

SemCache

Semantic Caching Layer for LLMs

LLMRouter

Cost-Aware Model Routing Gateway

Let's connect and build something amazing together.

© 2026 Ankit Kaushik