LLaMA-Factory
Apache-2.0 toolkit to fine-tune 100+ LLMs and VLMs via zero-code CLI and the LLaMA Board Gradio web UI.
Tags
Description
Established project (hiyouga/LlamaFactory; ACL 2024; not archived; not a 2026 launch). PyPI package llamafactory 0.9.5 verified 2026-11-10. Docs at https://llamafactory.readthedocs.io/en/latest/. Apache-2.0 (LICENSE). Model weights, GPUs and any third-party hosting are separate from the open-source toolkit.
Agent access
Related
- Unsloth: Open-source LLM fine-tuning library and desktop app for running and training models locally, with a dual Apache-2.0 / AGPL-3.0 license split.
- Axolotl: Apache-2.0 post-training / fine-tuning framework for a wide range of LLMs, with CLI, YAML configs, Docker and distributed-training options.
Guides & comparisons
- Fine-tuning frameworks compared — Axolotl, LLaMA-Factory and Unsloth (Comparison): Compare Axolotl, LLaMA-Factory and Unsloth as SFT, LoRA/QLoRA and preference-tuning frameworks for tool-use models: documented methods, config style, chat/tool datasets, hardware backends, licences and current versions. Cross-links the agent RL stacks comparison.
- Post-training a tool-use model — TRL, PEFT, and scale-out RL (Stack): A recommended post-training stack for chat and tool-use models: TRL and PEFT for SFT, LoRA/QLoRA, DPO and GRPO, with OpenRLHF and AReaL as the distributed and asynchronous RL options. Cross-links the fine-tuning frameworks and agent RL stacks comparisons.
Sources
- https://github.com/hiyouga/LlamaFactory
- https://github.com/hiyouga/LlamaFactory/blob/main/LICENSE
- https://pypi.org/project/llamafactory/
- https://llamafactory.readthedocs.io/en/latest/
Machine-readable
- JSON
- Markdown
- Source file on GitHub (edit via pull request)