TIME: Short Context-Triggered Thinking for Qwen3
Train Qwen3 models with QLoRA and Unsloth on a 7950X3D/128GB/RTX Pro 6000 to create TIME models that think in short bursts, and publish the repo and paper.
Clone the TIME repo, run the training scripts on your own hardware, and evaluate the model on TIMEBench to validate short-context thinking.
Summary
The author presents TIME, a method that trains Qwen3 models to think in short bursts, reducing overthinking and improving efficiency. TIME uses QLoRA on Qwen3 4B/8B/14B/32B models, trained with a four‑phase curriculum and Unsloth, and evaluated with vLLM. Training was performed on a 7950X3D CPU, 128 GB RAM, and an RTX Pro 6000 96 GB GPU, with notebooks and data available for replication. The paper, available on arXiv (2601.05300v2), introduces TIMEBench, a benchmark for short‑context thinking. The author plans to extend the approach to Qwen3.5 and Qwen3.6 to further reduce overthinking. Model checkpoints are large, but datasets, scripts, and training curriculum are shared on GitHub. The project demonstrates that temporal context cues can help LLMs decide when to re‑think mid‑response. The author invites the community to replicate and evaluate the method on their own hardware.
Key changes
- Introduces TIME for short context‑triggered thinking in Qwen3 models
- Uses QLoRA on Qwen3 4B/8B/14B/32B with four‑phase curriculum
- Trained on 7950X3D CPU, 128 GB RAM, RTX Pro 6000 96 GB GPU
- Uses Unsloth and vLLM for training and evaluation
- Provides TIMEBench benchmark for short‑context thinking
- Paper available on arXiv 2601.05300v2
- Repo at github.com/The-Coherence-Initiative/TIME and TIMEBench
- Aims to reduce overthinking in Qwen models