KNOWLEDGE is POWER / REAL NEWS is KEY
New York: Friday, April 19, 2024
© 2024 U-S-NEWS.COM
Online Readers: 314
New York: Friday, April 19, 2024
Online: 309
Join our "Free Speech Social Platform ONGO247.COM" Click Here
Visitors look at a Go1 quadruped robot by Unitree Robotics during the World Artificial Intelligence Cannes Festival (WAICF) in Cannes, France, February 10, 2023. REUTERS/Eric Gaillard/File photo

SCIENCE & TECH: New AI benchmark tests speed of responses to user queries – One America News Network

🔴 Website 👉 https://u-s-news.com/
Telegram 👉 https://t.me/usnewscom_channel

March 27, 2024 – 8:03 AM PDT

Visitors look at a Go1 quadruped robot by Unitree Robotics during the World Artificial Intelligence Cannes Festival (WAICF) in Cannes, France, February 10, 2023. REUTERS/Eric Gaillard/File photo

SAN FRANCISCO (Reuters) – Artificial intelligence benchmarking group MLCommons on Wednesday released a fresh set of tests and results that rate the speed at which top-of-the-line hardware can run AI applications and respond to users.

Advertisement

The two new benchmarks added by MLCommons measure the speed at which the AI chips and systems can generate responses from the powerful AI models packed with data. The results roughly demonstrate to how quickly an AI application such as ChatGPT can deliver a response to a user query.

One of the new benchmarks added the capability to measure the speediness of a question-and-answer scenario for large language models. Called Llama 2, it includes 70 billion parameters and was developed by Meta Platforms (META.O).

MLCommons officials also added a second text-to-image generator to the suite of benchmarking tools, called MLPerf, based on Stability AI’s Stable Diffusion XL model.

Servers powered by Nvidia’s H100 chips built by the likes of Alphabet’s Google (GOOGL.O), Supermicro (SMCI.O) and Nvidia (NVDA.O) itself handily won both new benchmarks on raw performance. Several server builders submitted designs based on the company’s less powerful L40S chip.

Server builder Krai submitted a design for the image generation benchmark with a Qualcomm (QCOM.O) AI chip that draws significant less power than Nvidia’s cutting edge processors.

Intel (INTC.O) also submitted a design based on its Gaudi2 accelerator chips. The company described the results as “solid.”

Raw performance is not the only measure that is critical when deploying AI applications. Advanced AI chips suck up enormous amounts of energy and one of the most significant challenges for AI companies is deploying chip that deliver an optimal amount of performance for a minimal amount of energy.

MLCommons has a separate benchmark category for measuring power consumption.

Reporting by Max A. Cherney in San Francisco; Editing by Jamie Freed

Share this post!





Source link

OnGo247
New 100% Free
Social Platform
ONGO247.COM
Give it a spin!
Sign Up Today
OnGo247
New 100% Free
Social Platform
ONGO247.COM
Give it a spin!
Sign Up Today