Inkling 2 Mini

(thinkingmachines.ai)

120 points | by jasondavies 37 minutes ago

9 comments

  • montroser 9 minutes ago
    This is bonkers good if these benchmarks hold up in real-world scenarios. To be at the level of Qwen3.8-27B with a looped transformer model is quite the flex. They just left this note on reddit:

    Hope that folks find this model more amenable to local usage - the sizing was largely informed by what folks on this subreddit ask for the most haha!

    There are two particularly interesting aspects of this model for local users:

    We do our training end-to-end in nvfp4, and although we haven't exhaustively benchmarked this, folks like Unsloth have noticed that our models seem to respond very well to being quantized, maintaining 90% top-1 even at at 1-bit quantization.

    This model is looped, which allows more depth at the same parameter count, which we particularly notice seems helpful for coding tasks. :)

    This is our first model targeted at local users, so let us know how this model is and anything you want to see out of future iterations!

    https://www.reddit.com/r/LocalLLaMA/comments/1y1diuk/thinkin...

  • gchadwick 2 minutes ago
    Very interesting to see them publish a looped transformer. It's been reported that OpenAI are now using looped transformers, though of course not confirmed.

    I think this may be the first public example of a looped transformer model good enough for real world use cases?

  • jakswa 5 minutes ago
    When inkling first released I tested it out and thought it was the best prose from an LLM in my quick sampling -- easy-reading and easy to understand. Big hopes I can write code with one of these models one day.
  • mattnewton 28 minutes ago
    Benchmarks look good, and inkling 2 small felt better than the benchmarks suggested, so I am very excited to play with this.

    From a research perspective, I'm even more interested in the varlooped variant they're releasing https://thinkingmachines.ai/model-card/tml-d24-varloop-resea... I'm not aware of any other working open source models like that.

    • liuliu 14 minutes ago
      My current feedback on Inkling 2 Small: 1. it feels intelligent, and can solve open problems throw at it like other quasi-frontier models (DeepSeek 4 Flash 0731 / DeepSeek 4.1 Flash 1017 / GLM 5.3 Flash etc). 2. its responses sometimes can be odd (they are honest about it in the blog post!), can have wrong use of markdown syntax, sometimes overly brief, etc. 3. tool uses are good, but sometimes have some old take on tools (too quickly to assume image generation tools cannot do text etc).

      EDIT: by "open problems", I meant the problems I don't really formulate how to solve it first in my mind and then throw to it. I just describe what I want and let it to figure it out.

    • kcb 19 minutes ago
  • jakswa 8 minutes ago
    The masses lying in wait for Qwen 4 cry out in joy. A savior? Could it be?!
  • neya 18 minutes ago
    Wow, that coding demo was super impressive. Can't wait to try it out. Just need to wait for the hardware market to cool down a bit so we can run these on our own commodity hardware.
  • holistio 3 minutes ago
    I'm starting to believe Gestalt is actually theirs. This is very nice.
  • walrus01 22 minutes ago
    Looking at the link to quantizations it looks like unsloth has already quantized it:

    https://huggingface.co/thinkingmachines/Inkling-2-Mini

    https://huggingface.co/unsloth/Inkling-2-Mini-GGUF

    In terms of the active parameters and token/s on slow or less capable hardware it seems like it should be in the same general performance category as qwen 3.6 35B A3B.

  • christkv 16 minutes ago
    I'm loving this trend. My framework desktop is looking like a better and better investment.