요약
NVIDIA's Groq 3 LPX is now in full production, offering big token generation speedups for Vera Rubin platforms in the Agentic AI space. NVIDIA Dials Up Vera Rubin NVL72 Token Generation Capabilities, Recording 3,400 TPS With Groq 3 LPX AI Inference Accelerato…
본문
AI Hardware Hot Chips Industry NVIDIA Enters Full Production of Groq 3 LPX AI Inference Accelerator Chips, Supercharging Vera Rubin With The Fastest Token Generation Speeds Ever Recorded Hassan Mujtaba • Aug 24, 2026 at 11:00am EDT Add Wccftech on Google Comments
NVIDIA's Groq 3 LPX is now in full production, offering big token generation speedups for Vera Rubin platforms in the Agentic AI space.
NVIDIA Dials Up Vera Rubin NVL72 Token Generation Capabilities, Recording 3,400 TPS With Groq 3 LPX AI Inference Accelerators
As part of its Hot Chips 2026 announcements, NVIDIA today announced that its Groq 3 LPX AI inference accelerator chip is in full production. This announcement follows the mass production announcements of Vera CPUs and Vera Rubin servers, marking the robust execution of NVIDIA's AI roadmap.
Related Story SpaceXAI Will Use NVIDIA Vera CPUs To Power Its Next-Gen Agentic AI Workloads, Also Bringing Vera Rubin Acceleration To Grok & Starmind AI Satellite
The Groq 3 LPX racks serve as an extension to the NVIDIA Vera Rubin platform, delivering boosted AI inference capabilities that enable ultra-fast token generation for response-sensitive agentic workloads, as these systems can generate a massive amount of tokens across hundreds or even thousands of inference steps, making fast token generation a critical step for AI factories.
While NVIDIA's Vera Rubin NVL72 is the bleeding-edge solution for Agentic AI, its capabilities can be further bolstered by the Groq 3 LPX solution.
In one demonstration, NVIDIA showcases its Vera Rubin NVL72 platform with Groq 3 LPX pushing out a record 3,400 tokens per second in Artificial Analysis running the Gemma 4 31B open model. With a context window of 100,000 tokens, this was the fastest performance ever recorded on the model.
NVIDIA Rubin GPUs handle large-scale context processing while LPX accelerates latency-sensitive decode workloads. The result is faster, more predictable token generation that helps AI factories deliver responsive reasoning, smoother agent interactions, and greater infrastructure efficiency.
With Groq 3 LPX, NVIDIA also enables agentic AI tasks such as coding to be done within minutes versus hours, offering a 4x boost in response times versus the nearest alternative platform. Big words right there!
“Inference is the growth engine of AI. NVIDIA Grace Blackwell and NVL72 revolutionized large language model inference with an unprecedented leap in performance and efficiency,” said Jensen Huang, founder and CEO of NVIDIA.
“Vera Rubin extends that vision with workload-optimized AI factory configurations designed for the era of agentic AI, advancing the performance frontier with LPX for ultrafast token generation. This transforms how intelligence is produced, delivering another giant leap in AI throughput, efficiency and responsiveness, just as demand for AI computation is accelerating worldwide.”
The NVIDIA Groq 3 LPX solution is also being eyed by AI cloud providers as a solution to the growing needs, giving enterprises and developers access to advanced infrastructure for training, reasoning, and inference at scale. As such, Nebius plans to utilize Groq 3 LPX in its Nebius Token Factory.
“Generation is the phase of inference that determines how responsive an AI system actually is, and that’s exactly what NVIDIA Groq 3 LPX is built to accelerate,” said Danila Shtan, chief technology officer of Nebius. “As the first AI cloud bringing it to production via Nebius Token Factory, we’re making sure every step of an agent’s loop feels instant — through the same API developers are already using, with no migration to a new stack.”
Groq 3 LPX and Vera Rubin, as a combo, are designed for the Agentic AI era, bringing a purpose-built inference architecture designed to maximize responsiveness, throughput, and efficiency, helping power the next generation of AI factories.
About the author: A Software Engineer by training and a PC enthusiast by passion, Hassan Mujtaba serves as Wccftech's Senior Editor for hardware section. With years of experience in the industry, he specializes in deep-dive technical analysis of next-generation CPU and GPU architectures, motherboards, and cooling solutions. His work involves not only breaking news on upcoming technologies but also extensive hands-on reviews and benchmarking.
Follow Wccftech on Google to get more of our news coverage in your feeds.
Further Reading
Intel Diamond Rapids “Xeon 7” CPUs Feature 256 P-Cores, The Same Number of Cores As Top EPYC Venice, Also Pack 1.28 GB of Cache And 12,800 MT/s Memory Support
Arm Dissects Its AGI CPU Which Is Tailor-Made For AI: Dual Chiplets With >100B Transistors, 136 Neoverse V3 Cores, Driving A $2B Demand In 2027-2028
IBM Details The World’s First Dual-Architecture Processor As It Builds Its Next-Gen Dual ISA Core That Natively Executes Z & Arm Software On The Same Chip
Micron Says AI’s Memory Wall is Worsening as Compute outruns HBM Bandwidth by 3x every Two Years, Advanced Packaging & Process To Tackle Rising Thermal Constraints
Read all comments on NVIDIA Enters Full Production of Groq 3 LPX AI Inference Accelerator Chips, Supercharging Vera Rubin With The Fastest Token Generation Speeds Ever RecordedTrending Stories
-
An RTX 4090 Suffering From “Memory Corruption” With 1.5GB Reduced VRAM Is Getting No Warranty Replacement From GIGABYTE; Company Says GPU Boots And Runs Fine
145 Active Readers -
Elon Musk Says He Has Memorized The Design Of His AI Chip That Is Three Times Better Than NVIDIA’s AI Products
64 Active Readers -
Western Digital Wins Customer’s Heart After Extending SSD Warranty For Free While Also Shipping A 2 TB Drive Instead Of 480 GB SSD
50 Active Readers -
An Old Laptop’s Only M.2 Slot Was Used To Hook Up An RX 7900 XT, Achieving 60 Tokens/s In Qwen3.6 27B & 100K Context Window; External Drive Was Used For The OS
46 Active Readers -
Apple Unveils Its New Flagship SoC, The M5 Ultra And Mac Studio Refresh; Quad-Die Architecture To Offer 4.4TB/s Interconnect Bandwidth, Up To 80-Core GPU & More
34 Active Readers
Popular Discussions
-
Intel’s 28-Core bLLC Nova Lake-S Reportedly Draws 296 W PL2, 18% Higher Than Core Ultra 9 285K
1113 Comments -
Intel’s Razor Lake Will Reportedly Tap TSMC’s 2nm N2X Process, Squeezing AMD Out of Already-Constrained Fab Capacity
575 Comments -
Intel’s Market Share Of The x86 CPU Market Falls To 1995-Levels, As AMD Now Controls An Adjusted 46.4% Of The Market For Server CPUs Vs. Intel’s 53.6% Share, Claims Mercury Research
571 Comments -
Intel Core Ultra 9 4950K Points To New Naming Scheme For Nova Lake-S Desktop CPUs, Alleged ES Chip Faster Than All Current-Gen Chips
560 Comments -
AMD’s AM4 CPUs Like The Re-Launched Ryzen 7 5800X3D Deliver Negligible Gaming Improvements In Newer Motherboards, Making Older Hardware Relevant During DRAM Crisis
406 Comments