Bazaroid

Étiquette: LocalLLaMA

110 éléments avec cette étiquette.

10 mars 2026
I built "Gloss" -- A local-first, privacy-focused NotebookLM alternative in Rust. Features hybrid search, local model support, and explicit RAG control.
10 mars 2026
Qwen 3.5 0.8B - small enough to run on a watch. Cool enough to play DOOM.
04 mars 2026
Massive speed gap with Qwen3.5-35B-A3B: 16 tok/s on LM Studio vs 40 tok/s on bare llama.cpp?
01 mars 2026
Breaking : Today Qwen 3.5 small
28 févr. 2026
ShunyaNet Sentinel: A Self-Hosted RSS Aggregator for Local LLM Analysis (with a not-so-subtle 90s cyberpunk theme...)
21 févr. 2026
[Release] LocalAgent v0.1.1: Local-first agent runtime (LM Studio / Ollama / llama.cpp + Playwright MCP + eval/replay)
18 févr. 2026
Gemma 27B/12B/4B/1B finetunes from DavidAU (20 models)
17 févr. 2026
I gave 12 LLMs $2,000 and a food truck. Only 4 survived.
05 févr. 2026
We built an 8B world model that beats 402B Llama 4 by generating web code instead of pixels — open weights on HF
19 janv. 2026
New in llama.cpp: Anthropic Messages API
18 janv. 2026
Orchestra - Multi-model AI orchestration system with intelligent routing (100% local, 18+ expert models)
17 janv. 2026
Analysis of running local LLMs on Blackwell GPUs. TLDR: cheaper to run than cloud api services
17 janv. 2026
MCP server that gives local LLMs memory, file access, and a 'conscience' - 100% offline on Apple Silicon
23 déc. 2025
Best free “uncensored” local LLM for RTX 3060 12GB (Portuguese, up to 13B 4-bit)?
22 déc. 2025
CUTIA - compress prompts without degrading eval scores
10 déc. 2025
Mistral AI drops 3x as many LLMs in a single week as OpenAI did in 6 years
02 déc. 2025
Ministral WebGPU: Run Mistral's new multimodal models 100% locally in your browser.
24 nov. 2025
From Microsoft, Fara-7B: An Efficient Agentic Model for Computer Use
17 nov. 2025
20,000 Epstein Files in a single text file available to download (~100 MB)
11 nov. 2025
A startup Olares is attempting to launch a small 3.5L MiniPC dedicated to local AI, with RTX 5090 Mobile (24GB VRAM) and 96GB of DDR5 RAM for $3K
25 oct. 2025
Highly-customizable Github AI Reviewer Workflow using Open Router
24 oct. 2025
MoonshotAI/kimi-cli - CLI coding agent from MoonshotAI
24 oct. 2025
You can turn off the cloud, this + solar panel will suffice:
19 oct. 2025
Stanford just dropped 5.5hrs worth of lectures on foundational LLM knowledge
06 sept. 2025
Renting GPUs is hilariously cheap
31 août 2025
Open-Sourcing Medical LLM which Scores 85.8% on USMLE-Style Questions, Beating Similar Models - 𝙽𝙴𝙴𝚃𝙾–𝟷.𝟶–𝟾𝙱 🚀
22 août 2025
Anyone experimenting with fine-tuning tiny LLMs (like Gemma3:270M) for specific workflows?
18 août 2025
Olla v0.0.16 - Lightweight LLM Proxy for Homelab & OnPrem AI Inference (Failover, Model-Aware Routing, Model unification & monitoring)
06 août 2025
KittenTTS received ~2500 stars within 24 hours yet not in trending
05 août 2025
Kitten TTS : SOTA Super-tiny TTS Model (Less than 25 MB)
02 août 2025
100+ AI Benchmarks list
02 août 2025
Local or die
24 juil. 2025
[AutoBE] We made AI-friendly Compilers for Vibe Coding, achieving zero-fail Backend Application Generation (open-source)
23 juil. 2025
nvidia/audio-flamingo-3
22 juil. 2025
Qwen3-Coder is here!
21 juil. 2025
Exhausted man defeats AI model in world coding championship
19 juil. 2025
WordPecker: Open Source Personalized Duolingo
15 juil. 2025
Kimi K2: cheap and fast API access for those who can't run locally
15 juil. 2025
XSched: Preemptive Scheduling for Diverse XPUs
27 juin 2025
Fine-Tuning Apple's New Foundation Model
27 juin 2025
Inconsistent responses between OpenRouter API and native OpenAI API
25 juin 2025
We built runtime API discovery for LLM agents using a simple agents.json
22 juin 2025
50 days building a tiny language model from scratch, what I’ve learned so far
24 mai 2025
MCP server to connect LLM agents to any database
16 mai 2025
I built a tiny Linux OS to make your LLMs actually useful on your machine
16 mai 2025
LLM on a Walkie Talkie
11 mai 2025
We made an open source agent builder and framework designed to work with local llms!
29 avr. 2025
"I want a representation of yourself using matplotlib."
29 avr. 2025
Running Qwen3-30B-A3B on ARM CPU of Single-board computer
29 avr. 2025
VRAM Requirements Reference - What can you run with your VRAM? (Contributions welcome)
25 avr. 2025
SOTA Spatial Reasoning in 2025
23 avr. 2025
Created a calculator for modelling GPT token-generation throughput
19 avr. 2025
Everything about AI Function Calling and MCP, the keyword to Agentic AI
18 avr. 2025
I created an interactive tool to visualize *every* attention weight matrix within GPT-2!
08 avr. 2025
Excited to present Vector Companion: A %100 local, cross-platform, open source multimodal AI companion that can see, hear, speak and switch modes on the fly to assist you as a general purpose companion with search and deep search features enabled on your PC. More to come later! Repo in the comments!
29 mars 2025
Moondream 2025-03-27 Release
26 mars 2025
Qwen 2.5 Omni 7B is out
26 mars 2025
Qwen releases Qwen/Qwen2.5-Omni-7B
21 mars 2025
SpatialLM: A large language model designed for spatial understanding
08 mars 2025
Real-time token graph in Open WebUI
24 févr. 2025
I made an Open WebUI function to use with Etherpad to more easily/directly work with context documents
06 févr. 2025
How I Built an Open Source AI Tool to Find My Autoimmune Disease (After $100k and 30+ Hospital Visits) - Now Available for Anyone to Use
26 janv. 2025
AI models outperformed the champion of TUS (Medical Specialization Exam of Turkey)
08 déc. 2024
TTS WebGPU: The first ever text-to-speech web app built with WebGPU acceleration (powered by OuteTTS and Transformers.js)
31 oct. 2024
More Models, More ProbLLMs: New Vulnerabilities in Ollama
25 oct. 2024
gptme v0.21.0 released - your agent in your terminal, with local tools (shell, coding, browser, vision, and soon "computer use")
25 oct. 2024
How do i run Llama3.2-3B-Instruct-int4-qlora-eo8 in my local pc using CPU?
17 oct. 2024
Can someone explain why LLMs do this operation so well and it never make a mistake?
17 oct. 2024
Meta AI's hidden prompt
03 oct. 2024
🧬 OSS Synthetic Data Generator - Build datasets using natural language
29 août 2024
Jan finally supports Llama 3.1 and Gemma 2 (with stability improvements)
12 mai 2024
I asked Mistral 7B instruct v 0.2 to create a extremely detailed knowledge graph of the Industrial Military Complex with 40 nodes. I created it with help of my framework llama-cpp-agent, which uses guided sampling and now supports llama.cpp server, llama-cpp-python, vllm server and the TGI server.
08 mai 2024
Phi-3 WebGPU: a private and powerful AI chatbot that runs 100% locally in your browser
04 mai 2024
How to feed any pdf, url, or video into LLaVa (and other vision-langauge models)
02 mai 2024
Llama-3-IMPACTS-2x8B-64k ( Astrobiology, Biomimicry, and Ecosystem Simulation)
01 mai 2024
KobbleTinyV2-1.1B
01 mai 2024
tutorial ideas for an OSS dev tool I built
30 avr. 2024
ExecuTorch Alpha Release: Taking LLMs and AI to the Edge 🎉🎉🎉
30 avr. 2024
RTX 3090 efficiency curve
28 avr. 2024
Clipboard Conqueror now supports instant complex naming, and has working chain of thought scripting you can adjust on the fly.
28 avr. 2024
Frankenstaining an LLM-first, VISUAL Studio Code: LMS (inference api), TreeSitter (AST Parsing), 3d-Force-Graph (rendering), Whisper.cpp (transcription api) + Flask.
27 avr. 2024
Llama 3 70B Q4_K_S is noticeably lobotomized
26 avr. 2024
Llama 3 downloaded over 1.2M times, over 600+ derivative models on @HuggingFace
26 avr. 2024
Running Phi-3-mini on UHD770 iGPU of Intel Core desktop
25 avr. 2024
Building a Local Chat Agent with Speech Recognition and Text-To-Speech
25 avr. 2024
Easiest LLM (and other tasks) finetuner
25 avr. 2024
How do you evaluate an LLM? Try an LLM.
25 avr. 2024
LLama-3-8B-Instruct with a 262k context length landed on HuggingFace
25 avr. 2024
Multi-modal Phi-3-mini is here!
25 avr. 2024
My attempt on making Phi-3 less robotic
25 avr. 2024
Open vs. Commercial Models on LMSYS Leaderboard
25 avr. 2024
Open WebUI + Ollama + OpenVPN Server = Secure and private self-hosted LLMs with RAG, accessible from your phone.
25 avr. 2024
Phi3-Mini Scores 68.07 on Open LLM Leaderboard - Outperforms LLama3 8B, Llama2 70B, Falcon 180B, Mistral 7B, Solar 11B and Qwen 14B - Is this model contaminated?
24 avr. 2024
Llama-3 8b finetuning 2x faster + fixed endless generations
24 avr. 2024
Microsoft phi-3 finetuning on macbook 💻 🚀
22 avr. 2024
Anthropic Releases a Library of Optimized Prompts
22 avr. 2024
Create Llama 3 quants through a Hugging Face space
22 avr. 2024
Voice chatting with llama 3 8B
21 avr. 2024
Llama 3 42b
21 avr. 2024
What are you missing in chat interfaces?
21 avr. 2024
What's the fastest local inference engine right now (exllamav2, vllm, etc.)?
19 avr. 2024
Complete Beginner’s tutorial to Local Large Language Models’ Installations (Llama3, Gemma, Mistral, Phi) in four easy steps. (Please review and check if you find any missteps or too difficult passages for a beginner.)
19 avr. 2024
llama-3-70b on Groq with code interpreting
19 avr. 2024
LLaMa3-8B already tuned to different languages
19 avr. 2024
My first MoE of Llama-3-8b. Introducing Aplite-Instruct-4x8B-Llama-3
18 avr. 2024
Meta-Llama-3-8B-GGUF
05 avr. 2024
Wingman - Zero-Config Open Source Desktop App to Find, Download and Run Llama Models Locally
04 avr. 2024
RTX A6000 vs RTX 6000 ADA for LLM inference, is paying 2x worth it?
16 mars 2024
Local LLM matters: AI services can arbitrarily block my access
28 févr. 2024
This is pretty revolutionary for the local LLM scene!

Créé avec Quartz v4.5.2 © 2026

GitHub
Discord Community