Community Strips Qwen-Image 2.1's Refusals to Run Locally on 16GB Laptops
A community-quantized, refusal-ablated text encoder for Qwen-Image-2.1 drops the refusal rate from 100% to 5% while running locally in ComfyUI.
20 stories
A community-quantized, refusal-ablated text encoder for Qwen-Image-2.1 drops the refusal rate from 100% to 5% while running locally in ComfyUI.
A new open-weight 320B Mixture-of-Experts model from IQuest Lab targets agentic coding in the terminal, activating 15B parameters per token with a 524K context window.
Two community LoRAs give MiniMax-H3 a full 360-degree camera orbit from a single photo, using opposite tricks with very different geometry results.
InclusionAI open-sourced Ming-Image-0.1-Design, a 6B text-to-image model built for UIs, posters, and infographics with native transparent-background output.
A 180B security-focused Mixture of Experts model is now available in eight local-friendly GGUF quants, with speeds up to 2.4 tokens per second on a single GPU.
LG AI Research's 4-bit quantized 7.8B bilingual model shrinks a strong Korean-English instruction follower into roughly 5GB of weights with a 32K context window.
Lightricks dropped a new in-context LoRA for LTX-2.5 that rebuilds fine detail in soft or upscaled video and tiles its way to 4K on a single GPU.
Jina AI's 0.6B multilingual reranker beats models 10x its size on BEIR by scoring documents jointly in one context window.
A 1B ternary language model built on redesigned DeepSeek R1 and Llama-3.2 blocks brings CPU-only inference with tool-calling and robotics tags.
A community LoRA teaches MiniMax-H3's video model to spin the camera around a subject in a seamless, loopable 360 degree orbit from a single photo.
A ternary-quantized Qwen3.8-27B derivative packs uncensored reasoning, a one-row 'thinking fix,' and multi-token prediction into a 7.66GB file.
Alibaba's flagship 32B dense reasoning model gets an official 4-bit AWQ build, cutting VRAM enough to fit on a single 24GB GPU with minor accuracy loss.
A 1.2B parameter open-source vision-language model that parses both digital PDFs and warped phone-camera document photos in one framework
A community port brings Mirai Labs' 2.4-bit trellis-compressed Qwen3.8-27B to llama.cpp, fitting 128K context on a 12 GB RTX 3090.
ISTA's DASLab shrinks a 176.9B-parameter Qwen mixture-of-experts model to 29.6GB resident memory by pruning half its experts and quantizing the rest to 3.5 bits.
A tiny 5.3M parameter EfficientNet-B0 in timm keeps racking up nearly a million monthly downloads thanks to its modern RandAugment training recipe.
A 4.39M-parameter BERT sentence encoder producing 128-dimensional embeddings sits on Hugging Face as a lightweight fixture for testing sentence-transformers pipelines.
A 1.5B parameter Qwen2-based anime chatbot lands in imatrix GGUF format, running under 1GB on plain consumer laptops.
A 9B Qwen3.5 fine-tune strips refusal behavior and adds agentic terminal skills, targeting local red-team workflows with GGUF quants that fit on a laptop.
Moondream shrank NVIDIA's Parakeet speech model from 1.2GB to 178MB using ternary weights, hitting 113x realtime on CPU while matching accuracy.