M.Tech student at NIT Karnataka (NITK Surathkal) · Graduating June 2026
I train large language models from scratch and build the systems around them.
I spent the last several months going deep on LLM training — not using APIs, but actually training models on H100 hardware. Here's what that produced:
Implemented the full reasoning training pipeline from the DeepSeek-R1 paper.
SFT cold start on 27K math CoT examples → GRPO reinforcement learning with verifiable reward functions.
The most interesting finding: diagnosed reward saturation from training curves — frac_reward_zero_std averaged 0.63, meaning 63% of batches produced near-zero gradient signal. Replicates the curriculum selection problem DeepSeek documented.
- 📊 MATH-500: +3.6% over instruct baseline (out-of-distribution generalization)
- 🤗 Model on HuggingFace
- 💻 Code + benchmarks
Extended Mistral-7B context from 8K → 32K tokens using YaRN RoPE scaling + LongLoRA finetuning.
Evaluated with needle-in-a-haystack tests across context lengths.
LLM Training
GRPO SFT Full Finetuning LoRA Reward Function Design BF16 FlashAttention-2 Gradient Checkpointing
Frameworks
PyTorch HuggingFace TRL Transformers DeepSpeed lm-evaluation-harness Weights & Biases
Inference & Evaluation
Speculative Decoding YaRN RoPE Scaling GSM8K MATH ARC benchmarks
Application Layer
LangChain LangGraph FastAPI Streamlit RAG FAISS
Infrastructure
H100 NVL CUDA Linux Docker Git HuggingFace Hub
| Project | What it does |
|---|---|
| VoicePaper | Converts research papers into podcast audio — PyMuPDF → GPT-4 → ElevenLabs |
| LawyerLens | RAG pipeline for legal document Q&A — FAISS + OpenAI embeddings |
| FinancialAgent | LLM agent with conversational SQL, data viz, Plaid API integration |
- 🎓 M.Tech Computational and Data Science — NIT Karnataka (Surathkal) (GATE CS 2024)
- 🎓 B.Tech Computer Science Engineering — SAGE University
- 💡 500+ LeetCode problems · Kaggle Contributor · Python Gold @ HackerRank
I'm open to LLM Engineer, ML Engineer, and AI Engineer roles — India and remote international.
📧 thawaitrohan@gmail.com
🤗 huggingface.co/thawait
💼 LinkedIn]