Pliops expands AI's context windows with 3D NAND-based accelerator – can accelerate certain inference workflows by up to eight times

Pliops claims its XDP LightningAI card and FusIOnX software accelerate large language model inference by offloading context data to SSDs, reducing redundant computation, and boosting vLLM throughput by up to eight times while avoiding the need for additional GPUs.

https://www.tomshardware.com/pc-components/ssds/pliops-expands-ais-context-windows-with-3d-nand-based-accelerator-can-accelerate-certain-inference-workflows-by-up-to-eight-times

Creado 1mo | 16 may 2025, 11:20:03


Inicia sesión para agregar comentarios

Otros mensajes en este grupo.

 Imec's next-gen high-speed chip transistor addresses manufacturing concerns — outer wall forksheet design simplifies production, but may sacrifice density

Imec has introduced a more manufacturable version of its forksheet transistor, named the outer wall forksheet, intended to extend gate-all-around (GAA) technology through

18 jun 2025, 16:30:10 | tomshardware.com
 Expert asserts Mario Kart World is a 'fake HDR' Nintendo Switch 2 title — ‘Mario Kart World reveals that even the highest caliber of developers aren’t taking HDR seriously’

Mario Kart World appears to have been developed using 'an SDR-first content pipeline with a last-minute HDR tonemap.'

18 jun 2025, 14:20:06 | tomshardware.com
 After 10 years, we're past peak RGB — but don't celebrate yet, stealth PC purists

It's hard to say when RGB lighting in PCs, components, and peripherals hit its peak. But after a decade of RGB everything, it's nice to see lights in fewer cases, compone

18 jun 2025, 14:20:06 | tomshardware.com
 MIT researchers crack 3D printing with glass — new technique enables inorganic composite glass printed at low temperatures

Researchers at MIT's Lincoln Laboratory have successfully 3D printed using a special type of glass-based filament they developed.

18 jun 2025, 14:20:05 | tomshardware.com
 Corsair says audible clicking noise from its PSU is completely safe — will give you a new one anyway

Corsair has confirmed it has fixed a clicking issue with its RMe PSUs and will replace any affected units.

18 jun 2025, 11:50:07 | tomshardware.com