Phison's new software uses SSDs and DRAM to boost effective memory for AI training — demos a single workstation running a massive 70 billion parameter model at GTC 2024

Phison demos a single workstation training a massive 70-billion-parameter AI model at GTC 2024. Such models normally require 24 GPUs to train, but Phison's aiDaptiv+ allowed them to accomplish the same task with only four GPUs.

https://www.tomshardware.com/pc-components/cpus/phisons-new-software-uses-ssds-and-dram-to-boost-effective-memory-for-ai-training-demos-a-single-workstation-running-a-massive-70-billion-parameter-model-at-gtc-2024

Vytvořeno 2mo | 26. 3. 2024 13:10:03


Chcete-li přidat komentář, přihlaste se

Ostatní příspěvky v této skupině

 Samsung and SK hynix abandon DDR3 production to focus on unrelenting demand for HBM3

Samsung and SK hynix are reportedly finally halting DDR3 production this year. The extreme demand for HBM3 memory has memory manufacturers closing down old fabs to focus

14. 5. 2024 21:30:04 | tomshardware.com
 Rockstar's original Red Dead Redemption and its expansion spotted in launcher files — Windows gamers may finally get a remastered release

It looks like Rockstar is gearing up Red Dead Redemption for another round on PC. Files for the original game and its expansion have shown up in the latest launcher updat

14. 5. 2024 19:10:06 | tomshardware.com
 Nvidia's next-gen Blackwell AI Superchips could cost up to $70,000 — fully-equipped server racks reportedly range up to $3,000,000 or more

HSBC analysts estimate that Nvidia will significantly increase pricing on the next-generation Blackwell processors for AI and HPC. That shouldn't be too surprising, given

14. 5. 2024 16:50:08 | tomshardware.com
 Qualcomm goes where Apple won't, readies official Linux support for Snapdragon X Elite

Qualcomm is working on official Linux support for the Snapdragon X Elite. Baseline support is already available but many of the SoC's features are inaccessible right now,

14. 5. 2024 16:50:07 | tomshardware.com
 Thermalright's Peerless Assassin 120 SE is the best CPU air cooler, now only $33

One of our favorite reviewed air coolers, thanks to its impressive performance and superb value, the Thermalright Peerless Assassin 120 SE is only $33 on sale at Amazon.

14. 5. 2024 16:50:07 | tomshardware.com
 OLED monitor momentum expected to continue — analysts expect 1.34 million units shipped by year end

Shipments of OLED monitors have significantly increased in 2024, and continued momentum means that over 1.3 million units are expected to have shipped by year end.

14. 5. 2024 14:30:07 | tomshardware.com
 Homegrown European processor for supercomputers delayed by a year — chip upgraded to 80 cores, but timeline gets downgraded

SiPearl upgrades its Rhea processor with more cores, but then delays it to 2025.

14. 5. 2024 14:30:06 | tomshardware.com