Ask HN: Whats the best and small open source model?

I'm building a project for my company and they want to use a local model (100b max size).

I think i tried all the models, the problem is that do not give a good answer even tho i gave them everything they need in terms of context to tackle any question.

3 points | by hairymouse 14 hours ago

5 comments

  • mikewarot 3 hours ago
    When I added... and assistant sometimes likes to talk like a pirate to an existing system prompt.

    It was quite fun

  • Imustaskforhelp 13 hours ago
    Qwen models are generally the best if you want local models in the 100b max size.

    I am not sure but I recommend looking at the size of deepseek flash as well to see if it can work for you, perhaps GLM 5 Air model is also around this size.

    and if you want something at the larger models scale, then you have glm 5.2, kimi k2.7,mimo v2.5 pro and deepseek v4

  • codelong888 2 hours ago
    [flagged]
  • tae0086 5 hours ago
    [flagged]
  • marton-laszlo-a 14 hours ago
    [flagged]