Ryzen AI Chatbot Magic Increases Conversations

AMD Ryzen AI CPUs and software open up a whole new level of efficiency for work, collaboration, and creativity by bringing the power of personal computing closer to you on an AI PC

[{"selector":"#anim-be260abb-c513-4588-ba0a-17fb423f6fb6 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate(-3.552713678800501e-15%, 0%) scale(1.5)","translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"forwards"}] [{"selector":"#anim-1b1effdf-a039-4631-9866-31dad49c83c8","keyframes":[{"offset":0,"transform":"translate3d(0, -147.11979%, 0)","easing":"cubic-bezier(.5, 0, 1, 1)"},{"offset":0.29,"transform":"translate3d(0, 0%, 0)","easing":"cubic-bezier(0, 0, .5, 1)"},{"offset":0.45,"transform":"translate3d(0, -41.370084948%, 0)","easing":"cubic-bezier(.5, 0, 1, 1)"},{"offset":0.61,"transform":"translate3d(0, 0%, 0)","easing":"cubic-bezier(0, 0, .5, 1)"},{"offset":0.71,"transform":"translate3d(0, -14.064651924%, 0)","easing":"cubic-bezier(.5, 0, 1, 1)"},{"offset":0.8,"transform":"translate3d(0, 0%, 0)","easing":"cubic-bezier(0, 0, .5, 1)"},{"offset":0.85,"transform":"translate3d(0, -5.281600461%, 0)","easing":"cubic-bezier(.5, 0, 1, 1)"},{"offset":0.92,"transform":"translate3d(0, 0%, 0)","easing":"cubic-bezier(0, 0, .5, 1)"},{"offset":0.96,"transform":"translate3d(0, -2.2950687239999996%, 0)","easing":"cubic-bezier(.5, 0, 1, 1)"},{"offset":1,"transform":"translate3d(0, 0%, 0)","easing":"cubic-bezier(0, 0, .5, 1)"}],"delay":0,"duration":600,"fill":"both"}]

They will go over the fundamentals of Ryzen AI technology in this blog and show you how to use it to create an AI chatbot that performs at its best on a Ryzen AI laptop alone

[{"selector":"#anim-3bd27d74-e611-4e58-b0d4-f0ee02d889df [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(35.937499914669296%, 0, 0)","translate3d(0%, 0, 0)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"both"}] [{"selector":"#anim-99a0fbff-1ec4-4b8f-9cfe-72aed4b91879","keyframes":{"transform":["rotate(-540deg) scale(0.1)","none"],"opacity":[0,1]},"delay":0,"duration":1000,"fill":"both","iterations":1}]

A separate Neural Processing Unit (NPU) for AI acceleration is incorporated on-chip with the CPU cores in Ryzen AI

[{"selector":"#anim-cc830383-33a7-49e2-aacf-c851d20641ba [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(-34.78483597324875%, 0, 0) translate(-25%, 0%) scale(1.5)","translate3d(0%, 0, 0) translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"fill":"forwards"}] [{"selector":"#anim-fc01bf20-4834-4c40-ba9d-54e052f17bc0","keyframes":{"transform":["rotate(-540deg) scale(0.1)","none"],"opacity":[0,1]},"delay":0,"duration":1000,"fill":"both","iterations":1}]

The kit comes with a variety of pre-quantized, ready-to-deploy models on the Hugging Face AMD model zoo, and installation is easy

[{"selector":"#anim-6b3af236-2d3c-4045-8377-fb3e8cf8aa69 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(38.42857135835645%, 0, 0)","translate3d(0%, 0, 0)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"both"}] [{"selector":"#anim-590c1815-eeda-406d-b34d-6eb84bb3a9dd","keyframes":{"opacity":[1,1]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"both"}] [{"selector":"#anim-9dac240a-3bdb-4102-995b-6a058e7621e6","keyframes":{"transform":["scale(3)","scale(1)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"forwards"}]

An open-source, pre-trained OPT1.3B model can be downloaded from Hugging Face and used on a Ryzen AI laptop

[{"selector":"#anim-816a9f1e-3e36-414d-8d68-c0ae760ba676 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(35.937499914669296%, 0, 0)","translate3d(0%, 0, 0)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"both"}] [{"selector":"#anim-ecdc0fc6-a59e-46f0-8319-bc49575765ef","keyframes":{"transform":["translate3d(129.72973%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-d14b450b-9179-42d5-a480-26d452ede4ed","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-a789cd2f-1f7c-4a4e-8dcd-c3511537a8fd","keyframes":{"transform":["scale(0.15)","scale(1)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"forwards"}]

Ryzen AI processors include an AMD XDNA-powered on-die AI co-processor

[{"selector":"#anim-1f433229-3989-4db3-843b-6380712b2f3b [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(-34.249999904429615%, 0, 0) translate(-25%, 0%) scale(1.5)","translate3d(0%, 0, 0) translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"fill":"forwards"}] [{"selector":"#anim-e43dcba7-5821-41ad-962e-3db5598cc7bc","keyframes":{"transform":["scale(1)","scale(1.5)","scale(0.95)","scale(1)"],"offset":[0,0.33,0.66,1]},"delay":0,"duration":1450,"easing":"ease-in-out","fill":"both","iterations":1}]

This hardware is specifically designed to speed up AI processes, which makes it appropriate for use as a local chatbot

[{"selector":"#anim-d9a08745-d35c-4e1d-988e-dced72f7e001 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(-34.249999904429615%, 0, 0) translate(-25%, 0%) scale(1.5)","translate3d(0%, 0, 0) translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"fill":"forwards"}] [{"selector":"#anim-3b32b95c-2f93-4a5b-92b6-ba9002bcf8cb","keyframes":{"transform":["scale(1)","scale(1.5)","scale(0.95)","scale(1)"],"offset":[0,0.33,0.66,1]},"delay":0,"duration":1450,"easing":"ease-in-out","fill":"both","iterations":1}]

A substantial amount of computing power is needed to run massive LLMs For more details govindhtech.com

[{"selector":"#anim-d54b8e0d-f890-43e3-8428-aa3fc1f36ff7 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(-21.874999829338588%, 0, 0) translate(-25%, 0%) scale(1.5)","translate3d(0%, 0, 0) translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"fill":"forwards"}] [{"selector":"#anim-1d4f2c59-7a07-4588-9767-55e4d6eda458","keyframes":{"transform":["translate3d(117.25352%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-3f3ea736-3a2c-48f7-a7f0-fae32d5bb1c8","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-106e5228-1515-4c03-afb0-0abd6b3d0bc1","keyframes":{"transform":["scale(0.15)","scale(1)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"forwards"}]