niftycent.com
NiftyCent
US
Login
Marketplace
Discounts

What is currently the best LLM model for consumer grade hardware? Is it phi-4?

I have a 5060ti with 16GB VRAM. I’m looking for a model that can hold basic conversations, no physics or advanced math required. Ideally something that can run reasonably fast, near real time.

Comments URL: https://news.ycombinator.com/item?id=44134896

Points: 23

# Comments: 10

https://news.ycombinator.com/item?id=44134896

Created 22d | May 30, 2025, 12:50:06 PM


Login to add comment

Other posts in this group

Record DDoS pummels site with once-unimaginable 7.3Tbps of junk traffic
Record DDoS pummels site with once-unimaginable 7.3Tbps of junk traffic

Article URL: https://arstechnica.com/security/2025/06/record-ddos-pummel

Jun 21, 2025, 1:30:04 PM | Hacker news
A new blood type discovered in France: "Gwada negative", a global exception
A new blood type discovered in France: "Gwada negative", a global exception

Article URL: https://entrevue.fr/en/un-groupe-sanguin-inedit-decouvert-en-france

Jun 21, 2025, 11:10:10 AM | Hacker news
Agentic Misalignment: How LLMs could be insider threats
Agentic Misalignment: How LLMs could be insider threats

Article URL: https://www.anthropic.com/research/agentic-misalignment

Comments URL:

Jun 21, 2025, 11:10:09 AM | Hacker news
uBlock Origin Lite Beta for Safari iOS
uBlock Origin Lite Beta for Safari iOS

Article URL: https://testflight.apple.com/join/JjTcThrV

Comments URL: https:

Jun 21, 2025, 11:10:09 AM | Hacker news
Cosmoe: BeOS Class Library on Top of Wayland
Cosmoe: BeOS Class Library on Top of Wayland

Article URL: https://cosmoe.org/index.html

Comments URL: https://news.ycombinator.com/ite

Jun 21, 2025, 11:10:08 AM | Hacker news
Show HN: We moved from AWS to Hetzner, saved 90%, kept ISO 27001 with Ansible
Show HN: We moved from AWS to Hetzner, saved 90%, kept ISO 27001 with Ansible

Earlier this year I led our migration off AWS to European cloud (Hetzner + OVHcloud), driven by cost (we cut 90%) and data sovereignty (GDPR + CLOUD Act concerns).

We rebuilt key AWS features ou

Jun 21, 2025, 11:10:07 AM | Hacker news
ClickHouse scales beyond 100 petabytes of logs
ClickHouse scales beyond 100 petabytes of logs

Article URL: https://clickhouse.com/blog/scaling-observability-beyond-100pb-wide-events-replacin

Jun 21, 2025, 11:10:07 AM | Hacker news
Techie
Techie