NVIDIA introduces new GPU and tools for GenAI

NVIDIA has announced the introduction of its GeForce Ray Tracing Texel eXtreme (RTX) desktop general processing units (GPUs) for “supercharging” GenAI performance on computers.

The chipmaker has also announced a suite of new AI software and tools supported by the RTX GPU for developers and consumers.

New software from the company includes AI Workbench, a unified toolkit for AI developers which will be available in beta later this month.

TensorRT-LLM, an open-source library that accelerates and optimises inference performance of the latest large language models, has now been expanded to support more pre-optimised models for PCs.

NVIDIA said that running GenAI locally on a PC is “critical for privacy, latency and cost-sensitive applications” and requires a large installed base of AI-ready systems, as well as the right developer tools to tune and optimise AI models for the PC platform.

To meet these needs, it said it would continue to deliver innovations across its full technology stack to drive new experiences and build on more than 500 AI-enabled PC applications and games its RTX technology already helps facilitate.

“Generative AI is the single most significant platform transition in computing history and will transform every industry, including gaming,” said Jensen Huang, founder and chief executive of NVIDIA. “With over 100 million RTX AI PCs and workstations, NVIDIA is a massive installed base for developers and gamers to enjoy the magic of generative AI.”



Share Story:

Recent Stories


Bringing Teams to the table – Adding value by integrating Microsoft Teams with business applications
A decade ago, the idea of digital collaboration started and ended with sending documents over email. Some organisations would have portals for sharing content or simplistic IM apps, but the ways that we communicated online were still largely primitive.

Automating CX: How are businesses using AI to meet customer expectations?
Virtual agents are set to supplant the traditional chatbot and their use cases are evolving at pace, with many organisations deploying new AI technologies to meet rising customer demand for self-service and real-time interactions.