#Llama News.

Fourier Analysis: Drawing Llamas with Circles

Hacker News discussion about "Fourier Analysis: Drawing Llamas with Circles".

Transformers now runs llama.cpp quants

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Notes on gotchas while migrating 35kb preprompts from Opus to self-hosted Ollama

Hacker News discussion about "Notes on gotchas while migrating 35kb preprompts from Opus to self-hosted Ollama".

OpenArch – PyTorch implementations of modern LLM architectures

PyTorch implementations of modern open-source LLM architectures (Llama, Qwen, DeepSeek, Gemma, GPT-OSS, Kimi, and more) — written from scratch for readability and learning, based on Sebastian Raschka's LLM Architecture Gallery. - anuj0456/OpenArc...

Setting up OpenCode with Ollama and sbx on Mac

How to get started with running Ollama local models with Opencode and Docker Sandboxes.

Reduce LLM latency with prefix-aware routing on Amazon SageMaker Inference

Amazon SageMaker Inference now offers prefix-aware routing, a routing strategy that sends requests sharing the same prompt prefix to the same instance so the KV cache stays warm. In benchmarks on Llama 3.1 70B, it reduced P50 time-to-first-token by up to 77% and raised KV cache hit rates from about 25% to over 80%.

Benchmarking Qwen3.8 27B quantizations: 4-bit holds up, 1-bit collapses

I test Unsloth GGUFs of Qwen3.8 27B (Q4_K_M, UD-Q2_K_XL, UD-IQ1_S) with llama.cpp on GPQA Diamond, IFBench, Terminal-Bench 2.1. Q4_K_M matches BF16 abd fits an RTX 4090.

Georgi Gerganov on llama.cpp/ggml future after Nvidia acquisition of HuggingFace

Hugging Face has been acquired by NVIDIA It is quite exciting to be a part of this journey! NVIDIA has been an active supporter of the llama.cpp project. For more than a year now, their engineers have actively contributed to the codebase, collaborat...

Nvidia launches free tool that links idle computers into a personal AI data center

Nvidia is announcing its new Personal AI Router (PAIR), a free tool that syncs up your home computers for tackling local AI inference tasks with tools like Ollama and LM Studio. Let's get the obvious thing out of the way, despite what its name might imply: PAIR is not a hardware router. It's open-source software devel...

Run Qwen3.8 27B locally: real numbers from my Mac Studio

Qwen3.8 27B benchmarked on a Mac Studio M3 Ultra: Ollama and llama.cpp numbers, the 1-bit quant tested, RAM math, and the hardware that actually fits.

Evaluate any agent framework with Amazon Bedrock AgentCore Evaluations

Amazon Bedrock AgentCore Evaluations decouples agent evaluation from the framework you build on. As long as your agent emits OpenTelemetry telemetry, the service can score it, whether you use LangGraph, LlamaIndex, the OpenAI Agents SDK, Google ADK, the Claude Agent SDK, or Strands Agents. This post explains how the fr...

Llama.cpp v0.1.0

LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.

llama.cpp

Official website for the llama.cpp project

Apple Silicon and macOS VMs: 11–16× Faster LLM Inference with Llama.cpp

Scale computer-use 2.0 with open-source drivers, cross-OS fleets, and benchmarks for training, evaluation, and data generation. - cua/blog/gpu-passthrough-macos-vms.md at main · trycua/cua

Introducing Muse Glimmer

Meta are back in the open weights game! Muse Glimmer is a brand new 30B model under a clean Apache 2.0 license (a step up from the janky Llama licenses …

Ollama: All Aboard Open Models

Serving 8.9 million developers, Ollama has raised $88M from Benchmark, Theory Ventures, 8VC, Y Combinator, and many incredible angel investors.

GGML and llama.cpp join HF to ensure the long-term progress of Local AI

New in llama.cpp: Model Management

Diff Risk Score: AI-driven risk-aware software development

The state of the research Diff Risk Score (DRS) is an AI-powered technology built at Meta that predicts the likelihood of a code change causing a production incident, also known as a SEV. Built on a fine-tuned Llama LLM, DRS evaluates code changes and metadata to produce a risk score and highlight potentially risky cod...