Technology
LLM Inference on H800: A Disaggregated Architecture Guide
Explore LLM inference optimization on H800 SuperPods. Learn how a disaggregated architecture with SGLang tackles the prefill bottleneck to boost throughput.
yiakwy
Latest Articles
Dive deep into the world of Artificial Intelligence with our curated collection of articles, covering the latest breakthroughs and insights from leading researchers and engineers.
Technology
GPU Performance: Compute vs Memory-Bound (90% vs 20% Utilization - 2025)
Master GPU performance optimization: Matrix multiplication achieves 90%+ FLOPS on A100, while CNNs get only 20% due to memory bandwidth bottleneck. Learn compute-bound vs memory-bound operations, fused kernels, Tensor Cores, and H100 FP8 improvements.
xiaodong gong
Technology
AI vs Traditional Infrastructure: 5 Key Differences (2025 Migration Guide)
Migrating from traditional to AI infrastructure? Master 5 critical differences: GPU vs CPU scaling, KV Cache vs web caching, 3D parallelism vs load balancing. Real migration strategies for LLM systems in 2025.
Alex