Hardware

19 posts on this topic

Posts about Hardware

NVIDIA Unveils Nemotron 3.5 Bolt E4B: An AI Model That Runs Offline With Just 4 GB of Memory - Hardware article image

NVIDIA Unveils Nemotron 3.5 Bolt E4B: An AI Model That Runs Offline With Just 4 GB of Memory

NVIDIA has unveiled Nemotron 3.5 Bolt E4B, a new open-weight model built for edge devices, robotic systems and personal computers. Built on Google's Gemma 4 E4B architecture and running with 8 billion total and 4 billion active parameters, the model offers high-speed inference fully offline, support for 35 languages and multi-turn tool-calling capabilities with a requirement of just 4 GB of VRAM.

AILLMTechnology
DeepSeek Open-Sources DeepInfer: What Developers Need to Know for a Production-Grade Inference Stack - Hardware article image

DeepSeek Open-Sources DeepInfer: What Developers Need to Know for a Production-Grade Inference Stack

DeepSeek has released DeepInfer, the high-performance inference framework it built to run massive production workloads, to the open-source world under the Apache 2.0 license. We take a close look at the architecture of the engine, which supports NVIDIA SM100 GPUs and Huawei Ascend 950 NPUs, its DSpark speculative decoding capabilities, and the missing pieces developers need to build to set up a full live serving stack.

DeepSeekAILLM

About Hardware

19 articles about Hardware, often together with AI, Technology, LLM. The newest one is "Idle GPUs Could Soon Pay Off: Inside Microsoft's Patent for Crowd-Sourced AI Training".

All topics · Reading series · All posts