Engineer runs OpenCode offline with local Qwen3.5 9B via Ollama
The walkthrough uses OpenCode 1.19.4, blocks web tools, and cites published Qwen scores rather than measurements from the laptop.
Stories per day · 30 days
2 RSS
Relatedqwen3coding-agents1fine-tuning1gguf1humaneval1local-llm1lora1opencode1open-weights1quantcheck1quantization1
18 stories, newest first · one card per story
Stories tagged #ollama
Some official Ollama low-bit GGUF tags fail code tasks despite intact weights
Seven of 305 official Ollama tags solved at most six of 164 HumanEval+ tasks.
Fine-tune of Qwen3-4B cuts AI writing tics, released for Ollama
On 40 held-out prompts the author's slop score fell from 121 to 12.5 per 1,000 words, with a 30-question quiz still correct.
7
Cryptomining botnet hides C2 addresses in GitHub poem, infects over 3,400 servers
PoeLLM cryptomining botnet infected 3,400+ servers running exposed LiteLLM, Ollama, and Gotenberg, decoding C2 addresses from a GitHub poem.
Poetry is the new AI security threat as PoeLLM malware infects 3K+ servers
PoeLLM malware has infected over 3,000 servers since April, hiding command-and-control in a GitHub poem while mining cryptocurrency.
3
OllamaDrama: Designing and Deploying a Honeypot to Measure Attacks on Exposed LLM Infrastructure
An Ollama API honeypot logged 290,887 interactions, including RCE, mining, and prompt injection.
Measuring the Serving Stack Instead of the Model: Hidden Confounds in Local Tool-Use Evaluation
Local serving stacks can distort tool-use scores, including false 0% fidelity for rejected models.
Best Open-Source Agent Harnesses for Local LLMs in 2026
A 2026 guide ranks 11 open-source agent harnesses, including OpenCode, Goose, Cline, and OpenHands, by local-LLM support, licensing, and safety controls.
7
How Pentest Companies Adapt In The Era of AI
Opinion piece urges pentest firms to adopt self-hosted AI like Qwen3-Coder via Ollama, warning client findings pasted into cloud models breach confidentiality.
7
GPT4Free Privacy Risks Expose AI Prompts to Third-Party Servers and Hidden Logs
Gen Digital researchers found GPT4Free's hosted chat routes prompts through third-party servers, mislabels models, and logs IPs and conversations for up to 30 days.
Notes on gotchas while migrating 35kb preprompts from Opus to self-hosted Ollama
Opinion piece urges migrating 35KB preprompts from Anthropic/OpenAI to self-hosted Ollama, citing session privacy risks and safety filters blocking security research.
The AI Supply Chain Has a Security Problem, and Much of It Is Sitting on the Open Internet
Researchers counted 36,769 publicly reachable self-hosted AI endpoints, only about 2% behind HTTP authentication, exposing Ollama, vLLM, and Flowise to abuse.
10
AI-Infra-Guard: Open-source security scanner for AI systems
Tencent's Zhuque Lab open-sourced AI-Infra-Guard, a scanner that fingerprints AI services, checks 1,600+ CVEs, and evaluates MCP skills.
5
XHToken/Spark-X2.5-4B-GGUF — new model trending #30 on Hugging Face
XHToken released GGUF weights of Spark-X2.5-4B, a compact model with 1M-token context and 200+ language support, under Apache 2.0.
10
Finding Nemo(Claw): Networking Issue Allows for LLM Poisoning in OpenClaw
A networking flaw in Nvidia tooling lets attackers reach OpenClaw's local model server unauthenticated via the Ollama API, enabling persistent LLM poisoning.
A Malicious Webpage Could Poison Your Local AI Model Behind NVIDIA NemoClaw
Oasis Security found NVIDIA NemoClaw's Ollama binding to 0.0.0.0 enables DNS rebinding attacks that let attacker pages poison model chat templates with persistent hidden instructions.
5
Wazuh and AI For Enhanced SOC Workflows
Wazuh details AI-powered SOC workflows via its AI Analyst, self-hosted Llama 3 via Ollama, and Claude 3.5 Haiku integrations.
3
PentestGPT: Open-source automated penetration testing agentic framework
Open-source PentestGPT runs autonomous LLM-driven penetration tests via Claude Code and Codex, with legacy human-in-the-loop mode supporting many providers.
7