Pliops expands AI's context windows with 3D NAND-based accelerator – can accelerate certain inference workflows by up to eight times

Pliops claims its XDP LightningAI card and FusIOnX software accelerate large language model inference by offloading context data to SSDs, reducing redundant computation, and boosting vLLM throughput by up to eight times while avoiding the need for additional GPUs.

https://www.tomshardware.com/pc-components/ssds/pliops-expands-ais-context-windows-with-3d-nand-based-accelerator-can-accelerate-certain-inference-workflows-by-up-to-eight-times

Creată 4d | 16 mai 2025, 11:20:03


Autentifică-te pentru a adăuga comentarii

Alte posturi din acest grup

 Where to buy Nvidia's RTX 5060 8GB GPU

After some strange preview reviews, the Nvidia 5060 is now available to buy.

19 mai 2025, 22:40:04 | tomshardware.com
 Crucial announces T710 SSD with 14.9 GB/s of performance, X10 portable SSD up to 8TB

Crucial launched its new T710 SSD here in Taipei, Taiwan, at Computex 2025, touting speeds of up to a blistering 14.9 GB/s and 2.2 million IOPS.

19 mai 2025, 22:40:04 | tomshardware.com
 Asus RTX 5080 ProArt comes with a wood grain finish and M.2 slot option

Asus has brought the joy of wood grain to its graphics card lineup with four new ProArt GeForce RTX 5080 models.

19 mai 2025, 18:10:06 | tomshardware.com
 How To Add, Remove and Update Software in Debian and Ubuntu Using Apt

Debian-based Linux distributions such as Ubuntu, Mint and Raspberry Pi OS use the Apt packaging application to manage software installations.

19 mai 2025, 18:10:05 | tomshardware.com
 Asus debuts 24-inch 610 Hz Full HD gaming monitor with a Super TN panel

The ROG Strix Ace XG248QSG has a native refresh rate of 600 Hz, but can overclock to 610 Hz

19 mai 2025, 18:10:04 | tomshardware.com