Pliops claims its XDP LightningAI card and FusIOnX software accelerate large language model inference by offloading context data to SSDs, reducing redundant computation, and boosting vLLM throughput by up to eight times while avoiding the need for additional GPUs.
Login to add comment
Other posts in this group

Prodaft said the Steam Early Access game contains the Fickle Stealer, Vidar Stealer, and HijackLoader malware.

While aimed at AI accelerators, new 3GB GDDR7 chips could help deliver 18GB and 24GB VRAM GPUs more efficiently

LG joins the race between fast OLEDs with its 27GX790A. It’s a 27-inch screen with 480 Hz, Adaptive-Sync, HDR10 and wide gamut color. It’s blindingly quick, with record-s

A new factory tour video reveals how Chinese firm CT converts retail RTX 5090 gaming GPUs into dual-slot blower-style cards for AI servers. Using full-power chips, indust

A thriving underground repair industry in China has emerged to service smuggled Nvidia A100 and H100 GPUs, driven by limited supply, lack of warranties, and rising profit

The Intel Core i5-13600KF, once one of our favorite CPUs, matches the lowest price we've ever seen.

Dipping to its lowest-ever price on Amazon, WD Black's SN7100 power-efficient 4TB SSD could be yours for just $229