Cactus Engineering Blog·· 26 天前评分46
Needle 3 微调指南：本地 LoRA 或平台全量，DroidCall 提升 18-36 分
Fine-tuning NeedleTwo ways to fine-tune Needle 3 from one package: LoRA on your machine, or the full model on the Cactus Platform with every depth trained and scored. The data format, the commands, how to read the loss, how much data a task needs, and what each path changes.Jakub Mroz, Roman Shemet · September 18, 2026 · 9 min read
导读
两条微调路径：本地 needle finetune 对注意力投影训练 LoRA（基础冻结、导出时合并），或平台全量训练 2-20 层每个深度；DroidCall 微调使所有子网络提升 18-36 个百分点，四层以上微调子网络超过 DeepSeek V4 Flash。
来源：Cactus Engineering Blog · cactuscompute.com