NVIDIA has announced the introduction of its GeForce Ray Tracing Texel eXtreme (RTX) desktop general processing units (GPUs) for “supercharging” GenAI performance on computers.
The chipmaker has also announced a suite of new AI software and tools supported by the RTX GPU for developers and consumers.
New software from the company includes AI Workbench, a unified toolkit for AI developers which will be available in beta later this month.
TensorRT-LLM, an open-source library that accelerates and optimises inference performance of the latest large language models, has now been expanded to support more pre-optimised models for PCs.
NVIDIA said that running GenAI locally on a PC is “critical for privacy, latency and cost-sensitive applications” and requires a large installed base of AI-ready systems, as well as the right developer tools to tune and optimise AI models for the PC platform.
To meet these needs, it said it would continue to deliver innovations across its full technology stack to drive new experiences and build on more than 500 AI-enabled PC applications and games its RTX technology already helps facilitate.
“Generative AI is the single most significant platform transition in computing history and will transform every industry, including gaming,” said Jensen Huang, founder and chief executive of NVIDIA. “With over 100 million RTX AI PCs and workstations, NVIDIA is a massive installed base for developers and gamers to enjoy the magic of generative AI.”
Recent Stories