AI Rotation TensorRT-LLM Authority RTX Windows 11 PCs!
The TensorRT-LLM wrapper for OpenAI Chat API and RTX-powered performance enhancements to DirectML for Llama 2, among other well-known LLMs, are among the new tools and resources that were unveiled at Microsoft Ignite
Windows 11 PCs with artificial intelligence represent a turning point in computing history, transforming experiences for office workers, students, broadcasters, artists, gamers, and even casual PC users
For owners of the more than 100 million Windows PCs and workstations powered by RTX GPUs, it presents previously unheard-of chances to boost productivity
New big language models will be supported by a future upgrade to the open-source TensorRT-LLM software, which improves AI inference performance
This would let customers to save confidential and proprietary data on Windows 11 PCs by enabling hundreds of developer projects and programs to operate locally on a PC with RTX rather than on the cloud
With the help of AI Workbench, developers can easily construct, test, and modify pretrained generative AI models and LLMs on a PC or workstation
NVIDIA and Microsoft will provide DirectML upgrades to speed up Llama 2, one of the most well-liked basic AI models, in order to benefit AI developers