Latest Articles

Dive deep into the world of Artificial Intelligence with our curated collection of articles, covering the latest breakthroughs and insights from leading researchers and engineers.

Filtering by tag:

LLM fine-tuning

(4 articles)

September 23, 2025Technology

How to Add Special Tokens to LLMs Safely

Learn how to add special tokens to LLMs during fine-tuning without causing catastrophic forgetting. Our guide covers smart initialization and PEFT/LoRA.

Bao Bao Suan Fa Bi Ji

add special tokens to LLM LLM fine-tuning catastrophic forgetting+1 more

August 6, 2025Technology

LLaMA Factory: Easy LLM Fine-Tuning Guide

Learn to install and use LLaMA Factory to fine-tune hundreds of LLMs on your local machine. This guide covers CUDA setup, installation, and WebUI usage.

Number in the Moutain

LLaMA Factory LLM fine-tuning fine-tune LLM+1 more

July 27, 2025Technology

SFT Flaw: A Learning Rate Tweak Unlocks LLM Potential

Discover a critical flaw in Supervised Fine-Tuning (SFT) that limits LLM performance. Learn how a simple learning rate tweak unifies SFT and DPO for a 25% gain.

Alex

Supervised Fine-Tuning (SFT)Direct Preference Optimization (DPO)LLM fine-tuning+1 more

July 16, 2025Technology

Supervised Fine-Tuning (SFT) for LLMs: A Practical Guide

Learn how Supervised Fine-Tuning (SFT) transforms LLMs from base models to chat assistants. Step-by-step guide to SFT workflow, datasets, and best practices.

Alex

Supervised Fine-Tuning LLM fine-tuning instruction-tuned model+1 more