LLM

194 posts on this topic

Posts about LLM

Kimi K3.1 Pro Unveiled: A 2.8 Trillion Parameter Open-Weight Agent and Coding Model - LLM article image

Kimi K3.1 Pro Unveiled: A 2.8 Trillion Parameter Open-Weight Agent and Coding Model

Moonshot AI has unveiled Kimi K3.1 Pro, its flagship open-weight multimodal reasoning model. Built on a Sparse Mixture-of-Experts (MoE) architecture with 2.8 trillion total parameters (104 billion active per token) and a 1 million token context window, the model performs on par with closed-source rivals in long-horizon software engineering, parametric 3D/CAD modeling and financial analysis tasks while offering 33% lower API costs.

KimiAILLM
NVIDIA Unveils Nemotron 3.5 Bolt E4B: An AI Model That Runs Offline With Just 4 GB of Memory - LLM article image

NVIDIA Unveils Nemotron 3.5 Bolt E4B: An AI Model That Runs Offline With Just 4 GB of Memory

NVIDIA has unveiled Nemotron 3.5 Bolt E4B, a new open-weight model built for edge devices, robotic systems and personal computers. Built on Google's Gemma 4 E4B architecture and running with 8 billion total and 4 billion active parameters, the model offers high-speed inference fully offline, support for 35 languages and multi-turn tool-calling capabilities with a requirement of just 4 GB of VRAM.

AILLMTechnology
DeepSeek Open-Sources DeepInfer: What Developers Need to Know for a Production-Grade Inference Stack - LLM article image

DeepSeek Open-Sources DeepInfer: What Developers Need to Know for a Production-Grade Inference Stack

DeepSeek has released DeepInfer, the high-performance inference framework it built to run massive production workloads, to the open-source world under the Apache 2.0 license. We take a close look at the architecture of the engine, which supports NVIDIA SM100 GPUs and Huawei Ascend 950 NPUs, its DSpark speculative decoding capabilities, and the missing pieces developers need to build to set up a full live serving stack.

DeepSeekAILLM

About LLM

194 articles about LLM, often together with AI, Technology, MCP. The newest one is "Anthropic Unveils Claude Fable 5.2 and Mythos 5.2: Frontier AI for Coding, Science, and Cybersecurity".

All topics · Reading series · All posts