NVIDIAs $20B chip could make ChatGPT look slow

Chip giant is preparing to unveil a powerful new artificial intelligence processor designed to speed up how chatbots and other AI tools generate responses, potentially making todays systems like appear sluggish by comparison.

The new platform, expected to debut at NVIDIAs annual GTC developer conference, is optimized for AI inference, the stage when trained models produce answers to user prompts. Unlike traditional GPUs built to handle both training and inference, the upcoming processor focuses specifically on delivering responses faster and more efficiently.

The product, if launched, will mark the first tangible result of December‘s deal that brought Groq’s founders into the fold, whose company specializes in high-speed AI processing hardware.