Category: AI & 机器学习 (AI & Machine Learning)
-
Distributed Training Parallelism: TP, PP, DP & DeepSpeed ZeRO 1/2/3
> **Core Executive Summary**: Single GPU VRAM cannot host 100B+ LLM training parameters, gradients, and optimizer states (a 70B FP16 model requires 1.12TB train
-
Vision Architectures Evolution: 2D Conv, Receptive Field Calculus, Depthwise Separable Conv, ResNet Identity Mapping & Vision Transformer (ViT) Guide
> **Summary**: Computer vision architectures evolved from handcrafted local inductive biases (CNNs) to data-driven global self-attention (ViT). This 100% exhaus
-
LLM Hallucination & Factuality: Taxonomies, FActScore, RAGAS, SAFE & Context Extension (PI/NTK/YaRN)
> **Core Executive Summary**: LLMs often generate plausible-sounding but unfactual or logically contradictory text, known as **Hallucination**. Hallucinations r
-
Transformer Architecture Breakdown: Self-Attention, MHA/GQA/MQA, RoPE & FlashAttention 1/2/3 Operator Fusion
> **Core Executive Summary**: Since its introduction in 2017, the Transformer architecture has fundamentally reshaped artificial intelligence, serving as the un
-
Linear Algebra Core for AI: Vector Spaces, Four Subspaces, EVD/SVD, Projection & Least Squares, Jacobian/Hessian
> **Core Executive Summary**: Linear algebra is the substrate of machine learning and deep learning: every tensor is a matrix, every layer is a matrix multiplic
-
Vision-Language Models (VLM): ViT, Projectors, LLaVA 2-Stage & DeepSeek-Janus Pro
> **Core Executive Summary**: Vision-Language Models (VLMs) empower LLMs to perceive visual scenes. Rather than training multimodal models from scratch, VLMs ut
-
Production LLM RAG & Agent System Design: Multi-Tenancy, SSE & High Availability
> **Core Executive Summary**: Moving RAG knowledge bases and agentic systems from demo to enterprise production is a distributed-systems problem as much as an M
-
AIE 大模型系统工程师核心地图:SFT/LoRA/RAG/Agent 面试必考
> **核心摘要**:大模型系统工程师(AI / LLM Systems Engineer, AIE)是当前 AI 工业界最火热的工程岗位。AIE 的技术栈横跨算法微调、系统架构、检索工程与推理基础设施。本核心地图全景拆解 AIE 岗位最高频的六大知识模块:AIE vs MLE 能力矩阵、SFT 数据工程与 Loss
-
MLE 机器学习工程师核心地图:高频八股、竞赛经验与 Pinterest 案例
> **核心摘要**:MLE 面试核心是一套高频复现的知识点闭环——**正则化与偏差方差权衡、过拟合诊断、特征工程、评估指标 (AUC / PR / F1)、类别不平衡、梯度消失、交叉验证、模型选型与集成方法**。在生产落地(如 Pinterest 规模推荐系统)中,它们汇成一条流水线:过滤万亿级原始日志 → 以无穿越
-