What is currently the best LLM model for consumer grade hardware? Is it phi-4?

I have a 5060ti with 16GB VRAM. I’m looking for a model that can hold basic conversations, no physics or advanced math required. Ideally something that can run reasonably fast, near real time.

Comments URL: https://news.ycombinator.com/item?id=44134896

Points: 23

# Comments: 10

https://news.ycombinator.com/item?id=44134896

Creato 8d | 30 mag 2025, 12:50:06

Accedi per aggiungere un commento

Altri post in questo gruppo

A leaderless NASA faces its biggest-ever cuts

Article URL: https://www.economist.com/science-and-technology/2025/06/04/a-leade

6 giu 2025, 23:20:20 | Hacker news

The Illusion of Thinking: Understanding the Limitations of Reasoning LLMs [pdf]

Article URL: https://ml-site.cdn-apple.com/papers/the-illusion-of-thinking.pdf

Comments URL:

6 giu 2025, 23:20:19 | Hacker news

Workhorse LLMs: Why Open Source Models Dominate Closed Source for Batch Tasks

Article URL: https://sutro.sh/blog/workhorse-llms-why-open-source-models-win-for-batch-tasks

6 giu 2025, 23:20:19 | Hacker news

A Rippling Townhouse Facade by Alex Chinneck Takes a Seat in a London Square

Article URL: https://www.thisiscolossal.com/2025/05/alex-chinneck-a-week-at-the-knees/

Comments URL:

6 giu 2025, 23:20:18 | Hacker news

How many trees are there in the North American boreal forest?

Article URL: https://nsojournals.onlinelibrary.wiley.com/doi/10.1002/ecog.07677

Comments URL:

6 giu 2025, 23:20:17 | Hacker news

Supreme Court Gives Doge Access to Social Security Data

Article URL: https://www.bloomberg.com/news/articles/2025-06-06/supreme-court-g

6 giu 2025, 23:20:17 | Hacker news

Smalltalk, Haskell and Lisp

Article URL: https://storytotell.org/smalltalk-haskell-and-lisp

Comments URL:

6 giu 2025, 23:20:15 | Hacker news

Techie