◆ What
Oncology multimodal AI models at three scales
92.4%accuracy
4B, 1.7B, 500Mmodels
◆ How
GemmaPaliGemmaLoRADistillationPyTorch
Built on: Nanochat Experiments
◆ Why
The Lab + Pioneer
Hero: Flagship projects with major impact
Overview
Family of oncology-specific multimodal models at 4B, 1.7B, and 500M parameters. Trained using multi-teacher knowledge distillation from MedGemma, GPT-OSS-20B, and Qwen-3-30B. Achieved 92.4% on PubMedQA.
Key Metrics
92.4%
accuracy
4B, 1.7B, 500M
models
Technologies
GemmaPaliGemmaLoRADistillationPyTorch