Kshitij Thakkar PRO
kshitijthakkar
P(doom) 1%
AI & ML interests
Building the evaluation and observability layer for AI.
Creator of TraceVerse—turning real-world LLM interactions into datasets, benchmarks, and cost-efficient model insights.
Recent Activity
updated a collection about 18 hours ago
OpenEnv Arena: GenAI OTel Trace Lab updated a dataset about 18 hours ago
kshitijthakkar/OpenEnv-Arena-MultiDomain-RL-Mix-v1 published a dataset about 18 hours ago
kshitijthakkar/OpenEnv-Arena-MultiDomain-RL-Mix-v1Organizations
Shlokartha fine-tuned model, Vāgartha-derived dataset, and CPU/ZeroGPU Sanskrit interpretation playground.
Qwen3.6-35B-A3B carved by expert importance to fit one consumer GPU. No training, no calibration. 800 tok/s on a laptop 5090.
-
kshitijthakkar/Kirigami-Qwen3.6-20B-A3B-NVFP4
Text Generation • 14B • Updated • 31 • 1 -
kshitijthakkar/Kirigami-Qwen3.6-24B-A3B-NVFP4
Text Generation • 16B • Updated • 35 -
kshitijthakkar/Kirigami-Qwen3.6-28B-A3B-NVFP4
Text Generation • 19B • Updated • 23 • 1 -
Kirigami Journey
🪷How we carved a 35B MoE to fit a 24GB GPU — zero training
This is a collection of Benchmarking results between Gradio and FastMCP
Systematic search for 1B-2B MoE models. Best: bs=1, ctx=2048 achieves 0.32 loss. Top-8 routing beats top-2.
-
kshitijthakkar/moe-1083m-781m-16x8-8L-large-moe-1.3b-bs4-ctx1024
1B • Updated -
kshitijthakkar/moe-1083m-781m-16x8-8L-large-moe-1.3b-bs2-ctx2048
1B • Updated -
kshitijthakkar/moe-1083m-781m-16x8-8L-large-moe-1.3b-bs2-ctx1024
1B • Updated -
kshitijthakkar/moe-1083m-781m-16x8-8L-large-moe-1.3b-bs1-ctx2048
1B • Updated
My submission to Agents-MCP-Hackathon
Collection of Loggenix Models, Eval Dataset, Demo Playground. Soon will add the training dataset.
-
Loggenix Moe 0.3B A0.1B Demo
🏢2Demo Space for my model loggenix-moe-0.3B-A0.1B
-
kshitijthakkar/loggenix-synthetic-ai-tasks-eval-with-outputs
Viewer • Updated • 28 • 15 -
kshitijthakkar/loggenix-synthetic-ai-tasks-eval_v6-with-outputs
Viewer • Updated • 170 • 16 -
kshitijthakkar/loggenix-synthetic-ai-tasks-eval_v5-with-outputs-v7-sft-v1
Viewer • Updated • 170 • 9
Nirnaya model and its Apache-only typed-decision training dataset.
-
kshitijthakkar/nirnaya-0.4b-0.2a-decision
Text Generation • 0.4B • Updated • 1.12k -
kshitijthakkar/nirnaya-jevstyle-tasksource-v2
Viewer • Updated • 456k • 116 -
kshitijthakkar/nirnaya-probability-distill-v1
Viewer • Updated • 1.53M • 97 -
kshitijthakkar/nirnaya-probability-distill-v2
Viewer • Updated • 1.95M • 100
Trackio logbooks: claim-by-claim reproductions of ICML 2026 papers for the Agent Reproducibility Challenge.
-
Repro - MemEvolve: Meta-Evolution of Agent Memory Systems
🧬Collaborate with an AI agent to manage a shared experiment logbook
-
Repro - TruthRL: Incentivizing Truthful LLMs via Reinforcement Learning
🎯Explore experiment logs and sync findings with a coding agent
-
Repro - How to Correctly Report LLM-as-a-Judge Evaluations
🎯Log and share LLM evaluation findings in a collaborative notebook
-
Repro - Dependence-Aware Label Aggregation via Ising Models
🧲Explore and edit experiment logbooks with AI agent help
Small-scale faithful replicas of the DeepSeek-V4 architecture for ablation and weight-transfer research.
-
kshitijthakkar/deepseek-v4-mini-300M-init
Text Generation • 0.3B • Updated • 56 -
kshitijthakkar/deepseek-v4-mini-1B-init
Text Generation • 1B • Updated • 59 • 1 -
kshitijthakkar/deepseek-v4-mini-3B-init
Text Generation • 3B • Updated • 177 • 3 -
kshitijthakkar/deepseek-v4-mini-6B-init
Text Generation • 8B • Updated • 134 • 6
Qwen3.5 MoE models from dual-source weight transfer (dense backbone + 35B-A3B experts). Hybrid DeltaNet + GQA attention.
-
kshitijthakkar/qwen3.5-moe-0.87B-d0.8B
Image-Text-to-Text • 1B • Updated • 68 • 1 -
kshitijthakkar/qwen3.5-moe-2.3B-d2B
Image-Text-to-Text • 3B • Updated • 30 -
kshitijthakkar/qwen3.5-moe-4.7B-d4B
Image-Text-to-Text • 5B • Updated • 38 -
kshitijthakkar/qwen3.5-tiny-test
Image-Text-to-Text • 0.1B • Updated • 13
32 MoE models from 41 experiments exploring expert count, routing, and learning rates for mobile deployment.
Collection of my submissions to MCP-1st-Birthday:- TraceMind Agent and MCP Server and smoltrace datasets generated for running evals using smoltrace.
Nirnaya model and its Apache-only typed-decision training dataset.
-
kshitijthakkar/nirnaya-0.4b-0.2a-decision
Text Generation • 0.4B • Updated • 1.12k -
kshitijthakkar/nirnaya-jevstyle-tasksource-v2
Viewer • Updated • 456k • 116 -
kshitijthakkar/nirnaya-probability-distill-v1
Viewer • Updated • 1.53M • 97 -
kshitijthakkar/nirnaya-probability-distill-v2
Viewer • Updated • 1.95M • 100
Shlokartha fine-tuned model, Vāgartha-derived dataset, and CPU/ZeroGPU Sanskrit interpretation playground.
Trackio logbooks: claim-by-claim reproductions of ICML 2026 papers for the Agent Reproducibility Challenge.
-
Repro - MemEvolve: Meta-Evolution of Agent Memory Systems
🧬Collaborate with an AI agent to manage a shared experiment logbook
-
Repro - TruthRL: Incentivizing Truthful LLMs via Reinforcement Learning
🎯Explore experiment logs and sync findings with a coding agent
-
Repro - How to Correctly Report LLM-as-a-Judge Evaluations
🎯Log and share LLM evaluation findings in a collaborative notebook
-
Repro - Dependence-Aware Label Aggregation via Ising Models
🧲Explore and edit experiment logbooks with AI agent help
Qwen3.6-35B-A3B carved by expert importance to fit one consumer GPU. No training, no calibration. 800 tok/s on a laptop 5090.
-
kshitijthakkar/Kirigami-Qwen3.6-20B-A3B-NVFP4
Text Generation • 14B • Updated • 31 • 1 -
kshitijthakkar/Kirigami-Qwen3.6-24B-A3B-NVFP4
Text Generation • 16B • Updated • 35 -
kshitijthakkar/Kirigami-Qwen3.6-28B-A3B-NVFP4
Text Generation • 19B • Updated • 23 • 1 -
Kirigami Journey
🪷How we carved a 35B MoE to fit a 24GB GPU — zero training
Small-scale faithful replicas of the DeepSeek-V4 architecture for ablation and weight-transfer research.
-
kshitijthakkar/deepseek-v4-mini-300M-init
Text Generation • 0.3B • Updated • 56 -
kshitijthakkar/deepseek-v4-mini-1B-init
Text Generation • 1B • Updated • 59 • 1 -
kshitijthakkar/deepseek-v4-mini-3B-init
Text Generation • 3B • Updated • 177 • 3 -
kshitijthakkar/deepseek-v4-mini-6B-init
Text Generation • 8B • Updated • 134 • 6
This is a collection of Benchmarking results between Gradio and FastMCP
Qwen3.5 MoE models from dual-source weight transfer (dense backbone + 35B-A3B experts). Hybrid DeltaNet + GQA attention.
-
kshitijthakkar/qwen3.5-moe-0.87B-d0.8B
Image-Text-to-Text • 1B • Updated • 68 • 1 -
kshitijthakkar/qwen3.5-moe-2.3B-d2B
Image-Text-to-Text • 3B • Updated • 30 -
kshitijthakkar/qwen3.5-moe-4.7B-d4B
Image-Text-to-Text • 5B • Updated • 38 -
kshitijthakkar/qwen3.5-tiny-test
Image-Text-to-Text • 0.1B • Updated • 13
Systematic search for 1B-2B MoE models. Best: bs=1, ctx=2048 achieves 0.32 loss. Top-8 routing beats top-2.
-
kshitijthakkar/moe-1083m-781m-16x8-8L-large-moe-1.3b-bs4-ctx1024
1B • Updated -
kshitijthakkar/moe-1083m-781m-16x8-8L-large-moe-1.3b-bs2-ctx2048
1B • Updated -
kshitijthakkar/moe-1083m-781m-16x8-8L-large-moe-1.3b-bs2-ctx1024
1B • Updated -
kshitijthakkar/moe-1083m-781m-16x8-8L-large-moe-1.3b-bs1-ctx2048
1B • Updated
32 MoE models from 41 experiments exploring expert count, routing, and learning rates for mobile deployment.
My submission to Agents-MCP-Hackathon
Collection of my submissions to MCP-1st-Birthday:- TraceMind Agent and MCP Server and smoltrace datasets generated for running evals using smoltrace.
Collection of Loggenix Models, Eval Dataset, Demo Playground. Soon will add the training dataset.
-
Loggenix Moe 0.3B A0.1B Demo
🏢2Demo Space for my model loggenix-moe-0.3B-A0.1B
-
kshitijthakkar/loggenix-synthetic-ai-tasks-eval-with-outputs
Viewer • Updated • 28 • 15 -
kshitijthakkar/loggenix-synthetic-ai-tasks-eval_v6-with-outputs
Viewer • Updated • 170 • 16 -
kshitijthakkar/loggenix-synthetic-ai-tasks-eval_v5-with-outputs-v7-sft-v1
Viewer • Updated • 170 • 9