Skip to content
  • PrismML

    AI & Software llm
    2
    0 Votes
    2 Posts
    19 Views
    montezM
    Bonsai 1 Bit Announcement: https://prismml.com/news/bonsai-8b Hugging Face: https://huggingface.co/prism-ml/Bonsai-8B-mlx-1bit Bonsai 1 Bit is a 1 bit language model that comes in 8B, 4B, and 1.7B parameter sizes. The 8B model is 1/16 the size of comparable 16 bit 8B open models with similar performance. At 1.15gb, this model can fit on many kinds of devices with 4-5x better energy efficiency
  • Local LLMs

    AI & Software llm
    12
    0 Votes
    12 Posts
    57 Views
    montezM
    Google Gemma 4 Hugging Face: https://huggingface.co/collections/google/gemma-4 GitHub: https://github.com/google-gemma Website: https://ai.google.dev/gemma/docs/core Announcement: https://blog.google/innovation-and-ai/technology/developers-tools/gemma-4/, https://blog.google/innovation-and-ai/technology/developers-tools/introducing-gemma-4-12B/ Developer: Google DeepMind Released: 26B A4B and 31B: April 2026 / 12B Unified: June 2026 Variants: 12B Unified, 26B A4B, 31B Parameters: 12B Unified: 11.95B / 26B A4B: 25.2B total, 3.8B active / 31B: 30.7B Context: 256,000 tokens Architecture: 31B: Dense / 26B A4B: MoE, 8 active of 128 experts plus 1 shared / 12B: Unified encoder-free dense, multimodal input projected directly into the decoder License: Apache 2.0 Modalities: 12B: Text + Image + Audio / 26B A4B and 31B: Text + Image Runs on: Laptop, consumer GPU/workstation class Formats: GGUF via Ollama/LM Studio, safetensors via Hugging Face, Docker On disk: 12B: 7GB Q4, estimated / 26B A4B: 15GB Q4, estimated / 31B: 18GB Q4, estimated