Latest coverage
- Community aggregator
- Country: United States
Title: Running Claude Code, Codex, Grok and Ollama side by side on one machine If you use more than one coding agent, you probably have a few terminals open, each with its own session and no idea what the others are doing. An hour in, you're piecing together which one did what. I built JunctionBox…
- Community aggregator
- Country: United States
description: Step-by-step guide to self-host Ollama and Open WebUI on a Linux server, secure it, and start chatting with a local LLM. tags: ollama, openwebui, docker, selfhosted You want a ChatGPT-like assistant that never leaves your network. Ollama provides the LLM inference engine, while Open…
- Community aggregator
- Country: United States
Use Ollama to run a model on your own laptop or workstation for yourself, and use vLLM when many users or programs hit the same GPU at once. Nodus covers the production side: it serves open models such as GPT-OSS through an OpenAI-compatible API, or runs vLLM with your own weights on GPUs such as…
- Community aggregator
- Country: United States
Everyone has the same week with Ollama. On Monday you run ollama run llama3.2 and it feels like magic: a real model on your own hardware, no API bill, nothing leaving the machine. By Wednesday you want the model to answer questions about your own documents. By Friday your "local AI" is five pieces…
- Community aggregator
- Country: United States
- Community aggregator
- Country: United States
"Runs locally" is easy to claim. We wanted to prove it. The project is Hearth, a private assistant for a household. It answers questions from a library of manuals and papers, citing the source and page. It listens and speaks, keeps notes, and reads due reminders aloud to whoever asks, and gives…
- Community aggregator
- Country: United States
On a machine without a GPU, Ollama 0.40.14 loaded qwen3-embedding:0.6b with a 4,096-token context, and /api/embed cut my 7,510-token document down to 4,095 tokens with no error, no warning and no flag in the response. Send "truncate": false so an overlong input fails with HTTP 400, and split…
- Community aggregator
- Country: United States
Originally published on hexisteme notes . On November 8 an overnight run on my local Qwen3.8 27B GGUF finished, and before looking at the score I checked one number per task: how many prompt tokens the server reported beyond the tokens of the message body. The pre-registration said that number…
- Community aggregator
- Country: United States
You install Ollama, pull a 7B model, run it, and get 1.8 tokens/sec . Fans barely spin. nvidia-smi shows almost no VRAM used. Nothing errors out. That's the most common local-LLM failure mode, and it isn't a broken install. Ollama decided the model didn't fit and quietly moved layers to the CPU. It…
- Community aggregator
- Country: United States
A model running on your own machine is private, cheap and fast. It also stops learning the day its training data was frozen. Ask it about this week's news, a library released last month or today's price of anything, and it will guess. The fix is tool calling. You give the model a few functions it…