Search Articles

Search results for “Model Training”

Found 11 articles

Document Chunking for RAG: A Practical Guide

2025/10/11By Ai Yun Shuin Technology

Boost your RAG system's performance with our guide to document chunking. Explore strategies from recursive to semantic chunking with Python & LangChain code.

document chunking RAG chunking chunking strategies text chunking RAG Retrieval-Augmented Generation

30x Faster LLM RL Training: The Checkpoint-Engine Story

2025/9/15By Qing Ke Aiin Technology

Discover how the Checkpoint-Engine achieves a 30x speedup in LLM RL training. Learn about its innovative approach to parameter updates for large-scale RL.

LLM RL training parameter update checkpoint-engine large-scale RL

Build a Llama-Style MoE Model From Scratch (Part 2)

2025/9/9By Zheng Liin Technology

Learn how to train a language model with this PyTorch training loop guide. Explore text generation, the AdamW optimizer, and Mixture of Experts models.

train language model pytorch training loop text generation AdamW optimizer

GRPO Training Pipeline: SFT to RL for Better Reasoning

2025/9/5By Ning Si Aiin Technology

Learn to implement a full GRPO training pipeline. This guide covers Supervised Fine-Tuning (SFT) with cold-start data, CoT prompting, and the GRPOTrainer.

GRPO training pipeline Supervised Fine-Tuning (SFT)model reasoning Reinforcement Learning (RL)

What is Knowledge Distillation in AI?

2025/9/1By Chen Jin Shi Xue Aiin Technology

Learn how knowledge distillation and model temperature work to train smaller, more efficient AI models. A key technique for LLM model compression.

knowledge distillation model temperature ai model compression large language models (LLMs)

AI Infrastructure: The Real Engine Behind AI Agents

2025/8/20By Pingxingjiluin Technology

Struggling with AI projects? The problem isn't your models, it's your AI infrastructure. Learn why data silos & lag hold you back and how to build a better f...

AI infrastructure AI agents data-to-AI pipeline AI implementation

LLaMA Factory: Easy LLM Fine-Tuning Guide

2025/8/6By Number in the Moutainin Technology

Learn to install and use LLaMA Factory to fine-tune hundreds of LLMs on your local machine. This guide covers CUDA setup, installation, and WebUI usage.

LLaMA Factory LLM fine-tuning fine-tune LLM CUDA installation

PyTorch Memory Snapshot: A Guide to GPU Usage Analysis

2025/7/28By Pandain Technology

Monitoring **PyTorch GPU memory usage** during model training can be perplexing. To demystify this, we'll dive into the **PyTorch memory snapshot** tool, a powerful utility for detailed **GPU memory ...

PyTorch memory snapshot GPU memory analysis PyTorch memory usage mixed-precision training

Baidu ERNIE 4.5: Multimodal Model Training & Fine-Tuning

2025/7/18By Alexin Technology

# Baidu ERNIE 4.5: Advancements in Multimodal Large Language Models Baidu's ERNIE 4.5 marks a major leap in artificial intelligence, especially in the development of **multimodal large language mode...

ERNIE 4.5 multimodal large language models Baidu fine-tuning

Training a 671B LLM with Reinforcement Learning: Key...

2025/7/9By Alexin Technology

Discover the technical challenges and solutions in training a 671B parameter LLM with Reinforcement Learning, covering frameworks, memory, and efficiency.

671B parameter LLM Reinforcement Learning large language model training Megatron

Bridging Traditional and AI Infrastructure: Key Differences

2025/7/8By Alexin Technology

Discover how traditional infrastructure skills translate to AI infrastructure. Learn key concepts, differences, and engineering fundamentals for LLM systems.

AI infrastructure traditional infrastructure distributed systems GPU