Hacker News users discuss hardware for running local LLMs
Community shares Mac Studios, RTX 3090 systems, and GPU clusters for models like DeepSeek-V4-Flash
Stories per day · 30 days
3 RSS
Relatedhardware2inference2open-source2qwen2benchmarks1coding-agents1gpu1granite1llmspeed1mac1nemotron1offline-ai1ollama1opencode1
10 stories, newest first · one card per story
Stories tagged #local-llm
Survival LLM runs an offline emergency assistant on a local PC
It picks among Nemotron, Qwen and Granite models by memory and cites FEMA, CDC and other local sources.
1
Engineer runs OpenCode offline with local Qwen3.5 9B via Ollama
The walkthrough uses OpenCode 1.19.4, blocks web tools, and cites published Qwen scores rather than measurements from the laptop.
Show HN: Llmspeed – feel how fast a local LLM runs before you buy the hardware
Llmspeed estimates how fast a local LLM runs on specific hardware before buyers purchase it.
A Local Agentic AI Framework to Generate Edge Case Scenarios for Safety Assurance
A laptop-based local agentic framework generates and critiques edge-case scenarios for autonomous-system safety assurance.
I'm not paying $20 for ChatGPT or Claude because a free local LLM does
A writer says a local Qwen model on llama.cpp replaced paid ChatGPT and Claude for everyday tasks.
Can You Check That? The Checkability Boundary for Local LLM Network Automation
Touchstone keeps most network-automation LLM inference local, escalating only outputs that fail cheap checks.
ukisai/Swift-1.5-Qwen3.8-27B-GSQ-RCO-GGUF — new model trending #30 on Hugging Face
UkisAI published GSQ-RCO GGUF quantizations of Swift 1.5 Qwen3.8-27B, from 8.42 GB to 11.77 GB.
12
The Illusion of Local Privacy: Confidentiality Boundary Failures in Consumer LLM Serving Systems
Researchers show local LLM serving systems leak prompts via memory residue, plaintext persistence, a llama.cpp tenant-isolation flaw, and timing oracles.
Show HN: Sunk Cost – How long until a local LLM rig pays for itself?
Show HN tool 'Sunk Cost' calculates when a local LLM rig breaks even versus falling API prices, factoring electricity cost and inference speed.