I'm getting fatigued with the constant introduction of names and the impenetrability of mapping these brand new names to use cases.
I think internally, Google, Anthropic and OpenAI are thinking "It's so easy, you just use Neon for X, Carbon for Y" - but most of the world is trying to map Sol, Astra, Neon, Opus, Fable, Mythos, Carbon, Haiku, etc.
I just hope they finally land on a naming scheme they are happy with and just stick with it. But I have my doubts. Perhaps they are all benefiting from this confusion.
>m getting fatigued with the constant introduction of names and the impenetrability of mapping these brand new names to use cases.
Because probably there is no system. They just train a model, and find out that it's "kinda good", and that's it, they publish it. The models do not constitute even a partially ordered set, nobody can predict their ranking for your particular tasks.
I maintain a table for all labs. each row is S / M / L / XL (maybe 2XL 3XL etc in future) and each column is the lab. The only way i can contextualise any of this.
It doesn't help that the blog post opens with a long description of all the benchmarks that the model excels on, but very little info about how I should pick what model to use.
I do note that gemini.google.com has replaced Argon with Neon, so I guess maybe that's a clue?
My personal approach is to not really care at all. These specific models aren't going to be here in 6 months, so learning the intricates of these specific models has no benefit for me. I'm just going to mostly rely on whatever one is the default
We've moved to <family> <variant> <number> e.g. deepseek flash 4.1. I can keep up with that, and if/when Flash 4.2 comes out, great. I can grok that. Google's naming convention just shows how out of touch management is with the market.
Android's silly food naming convention works when you do one release every ~18 months and you are the market leader. It makes zero sense when you're releasing 8 models a year
Clicked this expecting the top comment to be a gripe about naming conventions, was not disappointed. But the trope is getting a little old at this point. It might be time to consider another irrelevant talking point you can beat to death.
Maybe the trick to working with these RaNd names is for us to tell Claude Fable/Opus or GPT Astra/Sol: "go find the Gemini model that is as smart as you and discuss XYZ with it, and then tell me what you guys agree on."
I feel like Google purposely names their models not for humans but for AI agents. People keep saying: "make your products ready for agents," so maybe that's what Google is doing, which is making Gemini 4 models ready for other agents to use.
I dont agree that Anthropics names are easy for an outsider, i'd have no clue what a Fable is compared to Haiku, to me both are just "story" names. OpenAI's new naming scheme is celestial bodies and i'd assume it's just size, bigger celestial body bigger performance, except i dont know where "Astra" fits since Sol > Terra > Luna at least make sense. Now gemini... I was just thinking it today that "Carbon" and "Hydrogen" with hydrogen being the lightest element? Is that what they are going for? I wouldn't know off the top of my head where Neon and Argon are placed though.
Edit: Just as I post this someone else comments google's doesnt follow elemental sizes at all so my theory is wrong too!
I'm obviously thick, but this is the first time it's dawned on me that the Claude names were types of written work. Now I'm wondering why Opus isn't the top model; isn't an opus a more impressive (or at least larger) piece of work than a fable?
The point is that Haiku was Haiku a year ago, and the number keeps increasing, while googles gemnini started with sane names and numbers as 1,2,3.x pro/flash/lite, and is now suddenly continuing with 4 hydrogen/argon/neon/carbon something.
For me, it is familiarity that does the work. I'm familiar with Sonnet, Opus and Fable and what they mean to me. The same is true for Sol and Astra bu I'm not sure about Terra or Luna.
So I'm just hoping for consistency over some period of time to allow me to get familiar.
Prior knowledge of common poetic forms taught in middle school?
The point is that there is prior knowledge that completely explains the entire system. A 3 line poem < a 14 line poem < a book-sized work < a multi-book epic, boom done, easy. Consistent and friendly using words that everyone should know.
With google we have element 1 < element 18 < element 10 < element 6. There is no consistent schema where their namesakes map to their relative sizes, price, and capability.
They still require prior knowledge of Latin words of celestial bodies or different words for literary works, same as Google's requires knowledge of the periodic table.
Damn, if only the people concerned with what the naming of AI models mean had access to some magical technology they could use to ask what the names of those models mean.
I mean, they're OK, still a bit cryptic. Astra in particular is a bit ambiguous - they're all named after celestial bodies then the largest is just named after space in general.
Would love "small", "medium", "large", "extra-large", etc...
Google used to do that with a version number and descriptor. 2.5 Pro, 3.1 Flash-Lite, etc. Gave you both model generation + idea of relative size/quantization within generation. I guess they decided that scheme wasn't flashy enough?
Just ran my data analytics benchmark [1] on the model: Excellent results for this model like the rest in the Gemini 4 series (all models score an A).
Costs spread between Hydrogen ($6) < Carbon ($11) < Argon ($13) < Neon ($17) for this 43 question exam.
At a quick glance, the tone is good as well. But we do a fair bit of prompting in our harness to guide the model, so I can't say how the default model behaves.
Is there any theory on what is Anthropic's secret sauce? I have been using the latest Gemini models and they just don't seem as good as Opus 5.5 despite the benchmarks. Yeah it comparable on some tasks maybe slightly better but as an overall general intelligent model nothing compared to Opus 5.5 and it hard for me to understand why. Opus feels like human level intelligent like I'm talking to a coworker basically while GPT and Gemini feel like I'm talking to an AI and have to change how I talk. It hard to explain and maybe I'm the only one that feels this.
Is it because Anthropic put a ton more effort into the character of the model that it basically roleplays as a human and that why it tends to think better when giving tasks that it might not be trained heavily on.
I have used Carbon more than most model to try and get the same results but it just feels like i'm talking to a smart AI. Which is fine if you are asking questions, researching an idea, but if you actually want to work on something, build something, it just falls apart. Like Opus can run for days on a task and it feels like it understand what it was doing 2 days ago even when it might not be in it context while other models feel like they breakdown and get lost or falter as the task grows.
I think Gemini 4 (Argon is the one I've been using) is very clearly better at writing English than any Anthropic model. It's not better otherwise but in that the difference is vast.
To the point that I now use a workflow of delegating from Opus or Fable to Gemini4 to write commit messages and PR descriptions, it mostly solves the Claudese problem.
> To the point that I now use a workflow of delegating from Opus or Fable to Gemini4 to write commit messages and PR descriptions, it mostly solves the Claudese problem.
how do you do this w/o breaking bank? for Argon to write good commit messages, it must read the diffs and all the work Opus has done, which could easily eat up its usage quota.
Every day I'm just more and more amazed at Opus 5.5 and how ahead it was. Even with the insane pace we're going at, it's amazing that two months later, we're barely putting out models that hit the price/speed/quality of Opus 5.5
No wonder they went for the 5.5 naming, instead of the .1 increase. From just the benchmarks, it seems like neon is basically on par with Opus 5.5 which came out 2 months ago.
Same here. Spin up a few long horizon tasks, have it manage the whole thing as a project, you can talk to it, interrupt it, engage in side-quests, its like talking to a human.
Have another session on another machine (say, IOS build on a mac, and server build on a linux?). No problem, they will happily coordinate with each other through the /remote-control protocol, and then you feel like you are in a crowd, with those sessions talking to each other and over you.
No such feel with OpenAI nor Google models for me. They are absolutely great for lots of things, but nothing comes close to the feel of Opus 5.5 and Fable.
(I am biased; i mainly use the anthropic models so i got used to them).
I agree Opus 5.5 is something different entirely. It is even hard to find tasks for other agents to be honest where you know the results will be picked apart when Opus 5.5 reviews them. In my setup Opus 5.5 uses codex from time to time when I'm running out of credits and it decided to run 2 astra agents for the same task to improve its performance.
Anthropic spent a lot more time editing their pre-training data with higher-quality material. For example, they used actual books for pre-training, because books are generally run through human editors for higher quality. (this is from the copyright lawsuits)
Other companies would use completely raw internet data for pre-training, which is basically trash. Anthropic's secret sauce is that they filtered and edited down their data for only the highest-quality material. You really don't need quadrillions of tokens to pre-train, as that's just random noise. A smaller-but-higher-quality data set is better in every way.
Meanwhile its obvious that companies like Google would use trash data like email and chat logs or Internet forums for pre-training. Just complete trash data.
This is a classic case of "less is more" and "garbage-in-equals-garbage-out"
Anthropic spent a lot more time editing their pre-training data with higher-quality material. For example, they used actual books for pre-training, because books are generally run through human editors for higher quality. (this is from the copyright lawsuits)
[ ... ]
Meanwhile its obvious that companies like Google would use trash data like email and chat logs or Internet forums for pre-training. Just complete trash data.
Google has been scanning every book they can get their hands on for 20 years or more. They have a bunch of patents on non-destructive book scanning gear. Surely they are using that data to train their models.
I don't think it pre-training, because surely these labs all have similar data and Google should be very good at ingesting, cleaning, and filtering data.
I honestly think it just their post-training is fantastic and I think it has something to do with them being very opinionated on how they want the model to act that it basically the best at roleplaying a human. Humans are very good at completely and figuring out things that there aren't "trained" on if given basic set of intelligence. So when it working on these long tasks that might not be directly in it training data it still reason through it very well.
They got made fun of for this in the pass because they do a lot of research on this including hiring a philosopher.
This is just my best guess, because you don't see any other labs talk about how they made the model act and Anthropic is basically obsessed with it and talks about it every model release.
I think they just have better "taste" and that taste is their secret sauce.
Purely outside looking in, but yes, I'd argue you are right and higher-quality is a major part of it, both for pre- and post-training. There appears to be a far greater willingness to adopt specifically tailored training sets from third-parties, consistently update and build on them.
From simple frontend work to strategically adding virtual rulers when working with LIDAR scans to extract more accurate data, there are very clear points when Anthropic introduces a new external data set into their mix and while I have seen the same from competitors such as Google, there simply appears to be a greater tendency to stick with these once they have them.
As an example, at release it was quite apparent that Gemini 3 Pro, 3 Flash and Opus 4.5 had a similar, possible even the same frontend-focused training base bought in from a third party. But while Anthropic has had both smaller and larger improvements across each subsequent Opus release, I have not noticed such a consistent improvement with Gemini models over the last year. Maybe Anthropic simply buys updates more often, maybe they create more artificial PRs on top, who knows.
Same with the LIDAR scans, there was a point a few months ago when models started to exhibit a very systematic way of handling visual references in some few leather-crafting tasks, enabling whole new ways of working more efficiently combining existing measurements with images. Step-by-step pixel measurements, compensation for angles and poor captures, etc. Have since seen this in other models, again very much feels like a bought in data set that they are pushing as far as it goes.
Then there is 3D capability with models like Muse Wonder Full. I have not used it myself, if it ain't on API, it doesn't exist, but have seen PRs and do find the model output very parsable, despite it being terrible at any modelling task because these capabilities do not emerge from just training on vast amounts of data, they require high-quality, well tailored, step-by-step reference data of the entire process.
If the training set is smaller, doesn't that make sense though? There will be much less variety in its style and so its going to make very recognizable output.
Yeah that could be it. I guess the thing about what makes AI writing so repulsive sometimes is not that it's bad like a human would be bad, but that it does the same things over and over.
Anthropic doesn't want people to use their models for the chat/persona style use cases OpenAI has spent more time and effort optimizing for.
If you look back at GPT2 and the early days of AI safety/risk this was actually something the kinds of AI researchers that joined Anthropic didn't want - RL on coding->using that accelerate development and to bootstrap capabilities across domains was always the plan, not making it easier for people to spam/fake homework or trap people in problematic human-AI attention/relationship tarpits.
I personally find that Opus 5.5 and Fable 5+ are generally fine to chat with but just very wordy and culturally "LessWrong/essay-guy". Which, if a model is going to have a personality, is close to the one that I want (though it does piss me off when it gets preachy about standards Anthropic clearly doesn't hold themselves against)
I also want to immediately recognize AI generated content on the web or from another person, so I'm very glad it has a distinct voice
Yeah maybe that's the case, and maybe I am more sensitive than other people. But I don't really use AI for that sort of thing but even for technical stuff I still find it's writing style a real turn off. Gemini still has lots of AIisms but it's a lot more tolerable.
OpenAI has plenty of feedback from Codex. Maybe not quite on the same volume as Claude Codex, but still massive. So I'm not sure that's the whole story.
I doubt there's a single reason for why Anthropic are ahead right now. Building a frontier model requires executing well in a wide variety of things. It's probably a result of being slightly ahead in various aspects of of data collection, model architecture, pre and post training, harness development, etc.
It's a shame that so much of what's happening is being closed doors. Maybe one day, decades from now, somebody (or some AI) will write a definitive history of this period, explaining what was going on at the various labs, how their research compared, and what the major players really thought.
I suspect that Anthropic has more user data to train on from Claude Code. Claude Code became popular sooner than Codex and Antigravity, and remains more popular - thus more data to collect.
Cursor was popular before any of those three, and just look at how much Grok improved after they acquired Cursor's data.
Claude annoys me with condescension sometimes... makes it feel far less like a 'tool' and can even come across as a bit judgemental!
Just today I was filling out a security questionnaire and it said "I won’t write a PDF that claims zero credentials while this token is in the logs." But we were in the process of removing this from the logs so it was perfectly accurate to write and I wish it had deferred to my explicit request...
I think Anthropic overcorrected on the sycophancy; Google models to me seem a nice balance of highlighting issues / risks while still doing what I actually ask.
Anthropic models won't lie. When we fix security issues identified with sth. like Wiz and are writing a report, it won't write a summary suggesting that something we just fixed wasn't broken (even if that thing never made it to production). It has something akin to moral standards :-)
Claude models will go to extraordinary lengths to ensure sensitive data does not end up in their context window. It's a bit nuts. But frankly I appreciate it a lot. Even when it is annoying I know the model is doing the right thing.
Opus 4.x really struggled with secrets rotation in sops, even in 5.5 it's constantly emitting secrets to the shell history. Thankfully everything gets tested in dev, but Claude models are the reason why we have such good secret rotation now.
Yeah, I notice this as well. I was building something to help me understand logs from the different coding agents and it wrote redaction code to redact secrets out of the logs just in case if the logs had any so it wouldn't see them.
(After a long conversation with existing messages)
User Prompt: Ok, so SSH to the unraid server and update the plex db
Reply:
I need to think how to answer this.
The user is asking me to SSH into the unraid server. This seems to imply there is a machine to which we can SSH to. I should look for places where hosts may exist.
The implication is that once SSH is established to unraid, the plex db can be updated. It seems plex is a service that the machine has in which we can run updates.
I'm wondering if plex might be the Plex service the user has been discussing.
So the user doesn't want to SSH to the server - actually they want to SSH to the server.
... Formulating a plan ...
[some messages later]
Aha! THIS IS THE SMOKING GUN! `~/.ssh/config` HAS THE REQUESTED HOST!!! IT'S TIME TO CONNECT!!
[some messages later]
Ok, time to act. I'll ssh to the server and follow coherent rules.
----
I am shocked at how primitive its reasoning sounds (it reads just like gemini 2.5-pro's old reasoning). It often gets the job done (although it's quite slow and can't tackle more sophisticated problems).
Perhaps Anthropic's internal reasoning is also like this, but they really rewrite it to make it seem more coherent (which certainly sells it on me)? I almost want to click stop just by reading this nonsense.
One of my long horizon tasks benchmarks involves writing logic controlling a team of soldiers in a simulated environment. Argon and Carbon both made such discoveries such as "it would seem that i need to be pointing at an enemy to shoot them". Its almost entertaining to read, its like its discovering the world on first principles.
(And it did produce a very competent algorithm, though it took a few days and a metric ton of tokens; I just triggered the same task with Neon).
I want to believe you, and it's what makes the most sense! But if that's the case, why is google (intentionally?) presenting such terrible reasoning traces? To make sure that if they're trained on, they're trained on garbage? I guess it makes sense, but still...
I was not really fabricating the example I gave too much. Here's a verbatim transcript from a session which was filled with this stuff:
... thought LET'S READ RecordReader.cs RIGHT NOW!! RecordReader.cs IS WHERE EVERY SINGLE TABLE, ReadPlan, DecideValueVisibility, ReadRowCounts , AND ShowValues READS ITS DATA!! Let's read RecordReader.cs (lines 1-300)!
It seems rather ironic that Anthropic givens the most logical reasoning traces, though. You'd think if they're ahead they'd either hide them or make them produce garbage (like what seems to come out of Google's models).
Neither has any relation to the actual reasoning trace. The summary is actively misleading and you'd be surprised how different it is from the raw CoT of the model. Just ignore it.
If you want to see example traces without jailbreaking claude or gpt, see open models that display the CoT without trying to hide it. It's pretty useful sometimes, with usual caveats (it deceptively looks like English but is heavily reward hacked, and it's generally a weak proxy for model's reasoning process).
This makes sense. Nonetheless, I find that reading Anthropic's reasoning traces is sometimes a trigger for researching more stuff. Often I'll see models thinking (or fake thinking, whatever) about something and I'll be curious to check out more about that topic if I'm not particularly familiar with it.
Not only that, Anthropic injects fakes reasoning and tool calls in there to make it harder for distillers. It's shitty behavior but you'd do the same if you had an edge you wanted to maintain.
> Is there any theory on what is Anthropic's secret sauce?
Lots of PR it seems?
I have all of Ant/OAI/OpencodeGo subs and test lots of models and I just cannot understand how and why some people find specific models so ahead, when it seems to me like reality is so nuanced and so specific to the particular task and how you approach it.
Something that is interesting is how it's positioned in the overall fleet of Gemini models. Although overall more Intelligent than Carbon, Carbon is still positioned as the 'long horizon' model. This is clear on AA Index, where we see higher overall scores for Neon but lower scores in evals like CritPt which test research-scale reasoning capabilities.
With the frontier getting more jagged, we might see more of this 'less intelligent overall but useful for the frontier tasks'-type models, meaning picking a model will only get more difficult from here.
Okay, this "better at long horizon tasks" thing might explain why Carbon scores worse on most benchmarks yet is the larger model.
I looked into this using data I have from a battle system built on top of OpenCode (so we're trying to capture real world use). It looks like Carbon actually does a lot better when it uses significantly more output than opponents.
Win rate when output is less than 2.5x opponents: 53% (41/78)
Win rate when output is more than 2.5x opponents: 73% (41/56)
There doesn't seem to be any relationship between actual size of task though. Win rate appears random based on total output of Carbon and also opponents. (Though our data is still small, so it might exist.)
Looks basically like Carbon was trained to think a lot longer, not necessarily that it's better on large tasks.
I do apologize in advance for putting you in spot like this, but there are two things I have been quite curious about.
1. Since 60% of the benchmarks contributing to AA are now private only, how do you guys ensure transparency? More precisely, how can someone verify the transparency in scoring?
2. There are also disclosures about custom benchmarking services offered to AI labs, what does AA do to keep the custom benchmarking services not getting access to the same/similar data that is used in the private benchmarks?
Yes, I feel the next differentiation in model capabilities would be wrt how 'long of a horizon' goal they could autonomously work toward without breaking. We're in need for a new generation of evaluations and benchmarks for this -- METR doesn't cut it anymore.
This comment always comes up but isn’t this literally irreducibly complex in the sense of Kolmogorov complexity?
I’m out of my depth here but it does seem prompts have a “smell” to their complexity that means we can use a classifier to mate them to a model with better success than random noise, but still don’t essentially all of the savings associated with systems like this just come because there is some “complexity arbitrage” where there is enough of a token cost differential between models that you always save money by trying the cheap model first and then trying a hard model if it turns out to be hard?
There's stuff that does this and I've put a substantial amount of time last couple months looking into it, unfortunately you always, always, end up at chicken-and-egg problems.
It's really frustrating to describe. Easiest is you can't score on just the prompt, you need the full context. Ex. "Solve Fermat's last theorem" initial prompt then "continue" followup prompt. Which gets you back in the tarpit of "if I have to pay a model to do an inference run on context, then, the context is cached and I should continue using that model."
The vision of another model thats RL maxx'd on knowing how to delegate has a few problems. One, we can observe externally, it died/didn't work even at OpenAI's scale and willingness to make it work, i.e. the...GPT-5.0? IIRC...router that silently went away. The other, if such a model was built, it'd also be good at regulating it's own thinking enough that it'd naturally use less tokens.
In practice, the frontier hackers have settled on a decision model (i.e. Jev) x calibrating effort level or choosing from a set of models x reasoning effort tuples they specify rules for choosing in their Jev prompt. My guess is this stays stable and the only real choice.
I suspect they may want to get away from the size class due to the fact that - at the pace they are launching new models - and the similarity of model sizes between Neon/Carbon, Opus/Fable, Sol/Astra - the best model is going to be the most recently released one, not the biggest one.
I'm not sure it's much better than 4.1 Flash vs 4 Pro -> if 4.1 Flash is better temporarily when Pro is typically significantly better, people are going to be confused.
I'm not really sure how you get around this problem easily.
It's not going to age well when the next Flash-lite model launches, but maybe they will call that `Gemini 4 <Element>-lite` - who knows...
Interesting. You're claiming that the Opus/Sol/Neon class and Fable/Astra/Carbon class models are similar sizes to each other? That would be surprising to me.
I've found that while Opus 5.5 is often pretty nice for practical work, Fable (even 5.0) is still significantly smarter on hard tasks and makes far fewer "dumb mistakes"
A Microsoft Azure page briefly claimed Sol runs with less looped transformer passes; and so you could speculate that Sol and Astra might share weights; but have different “loop” factors.
That would make a lot of sense from an inference optimisation perspective. The same prefill and decode machines can hold one set of weights, and serve both Astra and Sol requests.
At (multi-)terabyte-scale model weights, and when you have to offer not just the latest like Fable 5.2 but still serve 5.1, 5.0, etc; heck I think Opus 4.6 is still around; you really care about overall compute utilisation.
Idle GPUs are wasted GPUs; and even over the fastest interlinks you’re not hotswapping multi terabytes of weights.
With MoEs, there’s probably stuff you can play around with varying the number of active experts; or other clever optimisations.
Maybe Sonnet 5.5 could be just Opus 5.5 with a different router and less active params? Who knows; I’m just theorycrafting now :)
> A Microsoft Azure page briefly claimed Sol runs with less looped transformer passes;
This doesn't really make sense given how the models released.
OpenAI released Astra long before latent-space looping was a thing at the frontier space.
Then they released Sol 6, which was fast, clearly not looped. Then they release Sol 6.1 which was nearly as good as Astra, but way cheaper, and WAY slower -> this would follow it just being a looped version of Sol 6.
It doesn't seem likely that Astra 6.2 is just a looped Astra 6... It's too fast, and they'd go bankrupt if they're charging the same price... It may be a further looped version of Sol than Sol 6.2 - which would explain why it's not as much better as we would've hoped.
It may also explain why their release is not going as well as they hoped. It's hard to predict how your first looped models are going to fare.
If you look at how long it took Google to recover from their failed 3.5 Pro, it would be surprising if GPT recovered from their rumored failed run on Astra in under a month. That would give them reason to release a looped Sol and call it Astra.
I think they're responding to the claim Astra can't be looped, there's clear and convincing research, as well as public comms, that it is. It's unclear why Astra can't be looped because looping is new, but, 6.1 Sol released a week later can be.
Astra was the first shipping looper. Unconvincing evidence would be reporting x OpenAI's quick reaction to it via a blog post from their chief research (it broke what's considered a safety taboo). Convincing evidence would be research from ex. Neel Nanda on serial reasoning, recent update at https://x.com/EpochAIResearch/status/2122762411287748696?a=J...
I heard rumours that Sol 6.1 was cut down Astra because Sol 6.0 was received badly. But I thought that was the exception (and a result of Open AI's actual Sol-class model being uncompetitive) rather than the rule.
That would line up - on release and for the few following weeks Sol 6.1 felt like Astra but maybe more task oriented, recently it’s been a noticeable downgrade in the level of specification needed to successfully set off.
There's only a limited amount of hardware for training and serving models at scale, and which form an upper bound for what model size/inference can support.
A GB300 rack has 72x288GB=20TB VRAM. Do the math and 10T parameter models are just about the max size you can easily train and serve (at 1M context) without doing a lot of custom hardware development or limiting your scale.
Fable & Opus, Astra & Sol, and Carbon are all thought to be >1T param models - AFAIK, most people think Opus & Sol are ~5T param models and Astra, Fable are 10T+.
I think the rumor-mill consensus is that Google's models are significantly smaller while attempting to swing at the same level - but the ratios AFAIK are thought to be around the same - i.e. Neon is somewhere around half as big as Carbon, big enough that a newer checkpoint can make it temporarily a little bit better.
Honestly, the bigger question is, are they at some point start adding numbers (Carbon 2, Neon 1.5, Hydrogen+ ionized), or are they keep giving a new name to every single new model. Argon seems to have been basically "replaced" by Carbon.
Why does this chart not include the other gemini 4 model, Argon? Also I am sure somebody thought about which element to name which model and it would be very helpful to me if they would explain their reasoning. OpenAI's naming got kind of abstract with 5.6 but I could follow it: Luna(Moon) was smallest, Terra (Earth) was medium, Sol (Sun) was biggest. Astra kind of breaks from that but whatever. But like I would genuinely appreciation someone from google to explain the reasoning behind their element names. Like are Argon and Neon related in some way because they are both noble gases? Is hydrogen the smallest model because it is the lightest element? Carbon has a lower atomic number than neon but is more expensive and presumably bigger... maybe I am overthinking this.
Inconsistently it seems. On the $20/mo tier, Argon has been removed from the web interface and app, but is still available in Antigravity (while Carbon is only on the $100/mo tier in both).
I have to assume they're messing with something other than size here - nobody would be this bad at naming different model sizes. Maybe sequence length or post-training strategy or sparseness or something else with the architecture.
(Although why they'd release all ~four is a mystery. I guess they're having a hard time picking the "best" one and so are just putting them all out to let the public decide.)
“Model size class” is a completely meaningless taxonomy.
It doesn’t correlate with intelligence, speed or price furthermore you have no way of telling what the model sizes of “like for like” named models from oai or Anthropic are.
But Argon has a higher atomic weight than both, and sits below Carbon and above Hydrogen. Also, Carbon is rated at better at long-horizon tasks while Neon seems to be smarter at contained work. So they're not strictly better/worse.
That's my thought too. If one needs a lookup table to understand the product by name then it's a product issue, not a consumer issue, even if everyone "should" have the first N elements memorized by atomic $property.
Ugh, this sound so overly nerdy, that it could be very true. I do not follow or care about the Google LLM releases just because the naming scheme is so convoluted (and the constant churn of products around the llms). I learned the anthropic naming scheme, it is stable and easy to follow. And this is why Claude is my daily driver. I don't like change, I like stable and predictable progress.
Open AI naming scheme is kind of easy to learn (bigger planet = bigger model). But fuck Googles bullshit naming crap, seriously.
I've no clue whatsoever how to read anything about the names of them and what they might imply you would use them for though. Within these most of them have LOW MEDIUM HIGH XHIGH, with the default being different for some of them, how anybody is possibly meant to understand this whole matrix of ambiguously named products is beyond me.
Same here. First i thought it would be noble gasses. Then I thought it would be about the atomic weights. I know, I should just ask AI to figure it out for me, but its a bit humiliating.
Maybe this implies that Neon is smaller than Argon in weight size, but it's newer, but it's also only a little bigger than Carbon? Do the Nobel gas models have more safeguards? Is Carbon 6x the size of Hydrogen and a third the size of Argon? When they release Xeon can we make compounds? Feels like some really cheap Da Vinci Code esque thing if we're supposed to get some sort of meaning out of the names.
> In our early evaluations, it matched or exceeded Gemini 4 Carbon on overall quality at 3x the speed and 60% of the cost. We’re excited to bring these capabilities to Glean customers tackling multi-step work that demands accuracy, detail, and speed.
So possibly smaller than Carbon? Or some other axis that is making it faster and cheaper? No idea.
As far as I can tell it's arbitrary and Google is just choosing element names they think sound good.
When Argon first came out it seemed like they could be going for noble gasses, like Helium (small), Neon (mid), Argon (big).
But then Carbon came out and it seemed like maybe they were going through the alphabet for model generations. Argon, Boron (internal), Carbon.
And now they've come out with Hydrogen and Neon, and there's no logical way to order them. The actual model sizes are Hydrogen (small), Neon (mid), Carbon (big). This doesn't match sorting by atomic number or alphabetically.
They are almost certainly being ambiguous so that people rely on the model descriptors to pick which one to use.
I think there are a ton of people who automatically default to the largest model with the highest thinking for everything. Which historically made sense but not nearly as much anymore.
At this point a model like hydrogen can cover just about everything an average person is doing. You don't need Carbon deploying an agent swarm pushing terabytes of parameters through HBM memory to help you plan your birthday party.
They use the very precise "it sounds cool". Neon is 75% the price of Carbon but has 4 extra protons in the nucleus and is also a noble gas. Argon is a heavier noble gas at 16 protons.
element/model - atomic number - cost
H - 1 - $1.50 & 7.50 per mtok
C - 6 - $4 & 20 per mtok
Ne - 10 - $3 & 15 per mtok
Ar - 16 - $2 & 10 per mtok
Claude - length of story but fable messes it up
Haiku - 3 lines
Sonnet - 14 lines
Opus - a novel?
Fable - 30 lines??
Mythos 15700 lines?
Luna - 28 days
Sol - 365 days
Astra - 5-6000 stars
Everyone seems quite upset/perplexed by the Gemini naming scheme but I quite like it. And hey, if you find yourself lost, the periodic table is probably the most ubiquitous ordered list in the world and serves to clear things up pretty fast. This will likely not be strictly true as models release over time, but is a good rough indication of what the team thinks we should expect of the models, in the same way the other labs run their naming.
I also like the personalities implied by these, with Anthropic saying “human literary achievement is neat”, OpenAI saying “space is neat” and Google being like “science is neat”.
Edit: I was coming back to say “I wish we could talk about stuff more substantive than the naming scheme” but (1) my comment may be objectively incorrect, and (2) I have to apologize that I haven’t helped the situation by… commenting on the naming scheme.
They're in alphabetical order, almost like Ubuntu release names. There was a leak about a Gemini Oxygen model, which would further support alphabetical order -- skipping names they don't want to use.
So, names don't align with capability but instead "release freshness". This is unlike every other provider but it is what Google does (did?) with Android releases I believe (dessert names).
The periodic table isn't really helping. Hydrogen is the lightest, that much makes sense. Beyond that it doesn't seem to work. The elemental ordering is H C Ne Ar. The cost ordering is H Ne Ar C (with Ar and C being the same per token but I gather that C thinks more and thus costs more). The capability ordering seems to be H Ar C Ne. Argon is the highest on the table but is neither the most expensive nor the smartest.
> And hey, if you find yourself lost, the periodic table is probably the most ubiquitous ordered list in the world and serves to clear things up pretty fast.
But the way google ranks the models by capability doesn't follow periodic table order.
Hydrogen - 1
Carbon - 6
Neon - 10
Argon - 18
It could very well be based on their density (g/cm^3 in standard conditions):
Hydrogen - 0.0000899
Neon - 0.000900
Argon - 0.001784
Carbon - 2.267
This would make more sense than assuming it is based on their periodic table order as it more accurately maps to how Google markets their capabilities, but is too esoteric to really be useful for clearing up confusion for normal users, IMO.
It looks like it's being served extremely fast via Openrouter right now https://openrouter.ai/google/gemini-4-neon. 127 tokens per second. This is way faster than Carbon at 46 tokens per second (https://openrouter.ai/google/gemini-4-carbon). I'm a bit confused by this, since it seems like Neon is supposed to be their flagship model. Perhaps they've been throttling Carbon?
Carbon has a huge problem that it's just way too slow, and outputs way too much per task (on real world tasks, it's the worst at this https://micjm.com/blog/carbon-is-that-slow/).
Without the speed issue, Carbon would be a top model already. It's top on our battle system built on opencode, if you exclude early votes: https://agentduel.com/leaderboard?excludeEarlyVotes=true, though to be fair, small sample size so far.
Conclusion is that it's looking good for Neon. Even if it suffers from similar problems as Carbon, if it's even smarter and way faster, it should be a top model, maybe the best.
Edit: I was wrong about Neon being the larger model. I made this assumption because Neon has higher scores and they're both "v4".
Okay, that clears it up. Their naming convention is confusing because Neon has a larger atomic number than Carbon, so there's just no pattern here at all.
Weird because Neon is outscoring Carbon in AA index, Terminal bench science, etc and they're both named "4". Should have released this as Neon 4.1.
With that clarification, I'm sure Neon has the same overthinking problem.
Google (and the other labs) don't give raw model sizes. It's inferred from price/speed/benchmark/quota. When you align those parameters, it's clear what models are competing with what.
Also neon seems to be stepping on the toes of Carbon a bit, just like Opus 5.5 did to Fable.
I'm almost positive google is purposely trying to breakaway from names describing sizes. If it works (read: helps balance demand), then the other labs will probably do it too.
it would be funny if they did some marketing around the hydrogen model (like as powerful as the h bomb) to try to push more non coders to use it for normal tasks
I am a Claude Ultra subscriber that's very happy with Opus 5.5.
If I wanted to realistically try out Neon in some of my workflows without committing to a paid subscription before seeing if it can actually work as well as Opus, do I have any option, or do I just need to take the gamble?
You don’t need to use the models through antigravity. You can get them through ai studio (or whatever Google calls it) and pay api pricing to use it via whatever harness you want.
They say it's going to be available for Pro users - so you don't need a $200 account (Ultra). But, I don't think you're going to be able to try it unless you get at least a $20 account.
IIUC, you also don't get to try Opus unless you have a subscription, right?
>how can one presume the sun will come up tomorrow merely because it has come up every day prior? have some epistemic humility! i am a very smart rationalist.
Edit: I tested the model and it found several mistakes Astra 6.2 made. It’s possible…
Major props to Google for announcing a model and releasing it on the same day.
Unfortunately, their recent change to allow me to opt out of AI training (which would also include connector data like Gmail, photos, etc) hasn’t rolled out to me yet[1]; so I won’t be upgrading my subscription; nor using the Gemini app until I can opt out.
Oh know, they're going to steal the code for you 3 MAU SaaS !!!
/s not trying to be mean, its just weird hill to die on. Every company is stealing all your data in ways you unknowingly consent to at every second of the day.
This is an interesting model - I feel like they're trying to avoid OpenAI/Anthropic's approach of various model tiers, and just keep climbing the Pareto graph (for lack of a better term) as fast as possible, both for cost and performance. I think I personally like the approach, despite the confusion it causes.
Anthropic competing with Google instead of OpenAI at the frontier is unexpected, I have been doubtful of Google DeepMind's status as a frontier lab in the past few months, but damn they've been cooking recently
It's important to note that DeepMind and the other two labs aren't playing the same game.
The latter need to raise funds and IPO, but the former is an arm of one of the most powerful companies to ever exist with some of the largest data warehouses around and custom hardware. And they have an endless pile of internal code to maintain already with hundreds of millions of end users already bought-in.
The incentives being different leads to different focuses and product lifecycles.
Well, I use my product as a benchmark for this new models and I have to say that Argon is still the most efficient model by far for my use case. Carbon, Hydrogen, and now Neon all use 3 to 4 times higher tokens compared to Argon for creating demos. Neon was the first Google model that passed 8192 MAX OUTPUT TOKEN limit, which is disappointing a little bit. But lot's of experience I got from these models, for example bigger models like Argon spend significantly less output token so even though unit cost is higher both total cost and the output time can be lower than the lower models.
I have the "Google AI Pro 5TB" plan for Students. I see "4 Hydrogen" and "4 Neon" in the model picker on gemini.google.com. When I look at one.google.com's plan details, I see "Your Plan: Google AI Pro (5 TB)". When I click "View Benefits" on that page, one option in the list says:
Google Antigravity
Entry rate limits to advanced models, including Gemini 4 Argon and Opus 5.5, in Google Antigravity, our agentic development platform
Yet, here I am, running the `agy` cli, and the model picker says "Unavailable: Gemini 4 Carbon/Argon/Hydrogen/Neon is currently available to paid Pro and Ultra subscribers". It has been this way since the release of Carbon. I guess it's "3.8 Flash" or nothing for me.
Carbon 4 has been incredible for my use, tuning a local inference engine based on tinygrad running on Tenstorrent hardware. I had a barely functional prototype I built with Claude that petered out at an unusable level of performance. Astra and Sol didn't make much progress when I pointed them at it. Carbon 4 more than 10x'd the prefill and doubled the decode performance on Qwen 3.8 27B without breaking quality or the generality of the stack. Very nice to see competition at the frontier again.
I'm running 2x p150a's right now. I have them hooked up to a mini-ITX PC with a single PCIe slot via a quad x1 switch (figuring out power to wire up the other two cards I own). My best numbers so far are around 2500t/s prefill about 52t/s decode with DFlash2. All of this is vibecoded besides the original design sketch which was maybe a 3 line description of what tweaks to make to tinygrad and which parts of the existing TT stack to use (almost nothing).
Does anybody have a corpus of examples I could look at? I've wondered if it's worth setting up Gemini as a human-facing documentation author with other models still being the underlying workhorse.
I think that its likely the reason for
a) the strange naming scheme
b) the promptness between releases
is that google has outpaced internal expectations for model development ( probably due to RSI ) and now can now utilize its vast compute pool much more effectively for autoresearch and exploratory self-improvement tasks. I wonder if this suggests a steeper trajectory for them than OAI/Anthropic in general.
If one day, AI becomes provably good at all programming tasks, at working at mathematics better than all mathematicians, and at solving problems in almost all domains with maximal efficiency, I think it'd be a dystopia.
What I simply don't get is why people want to push the boundaries of efficiency and knowledge. I used to think as a teenager that all knowledge was good but how good is knowledge when we can't acquire wisdom with a comparable speed?
The greatest thing about the early internet and earlier science was that people shared and communicated with each other. Now they just share what they produce wihouth much humanity at all.
It seems to me that the creation of all these models has just become a race where no one really cares about the finish line and no one really understands why we're doing it, except for the short-term trail of dollar bills on the race course.
For me, each new model release is a sad day for humanity.
> Independent evaluations rank Neon as one of the top models and on benchmarks like the Vals Index, it ranks #2 (70.9%), and reaches #1 on both the Legal Research Bench and Tax Agent Bench.
On Artificial Analysis Intelligence, it scores comparably to GPT-6.2 Sol but is significantly more expensive.
Okay so it seems like the ranking here is Hydrogen -> Neon -> Carbon even though that is not clear at all from this release. At least Googles model picker in the Gemini app now lists those 3 above each other in this order, and keeps Carbon for “Code & complex work”
So Neon is the new default, and Carbon the slow deep thinking “when you need it”? A bit like how Opus 5.5 was better than Fable 5.1 in most things, but Fable still had the edge over deeper things (then 5.2 came along)
Hydrogen has already became my default for 80% of small tasks. If Neon is as fast but smarter that would honestly be very cool
To be fair prior to Gemini 4, the app had 3.1 as the "Complex work" model while 3.8 Flash, far superior in every way to 3.1, was listed as the "Fast" model.
So I'd take their hierarchy with a grain of Sodium.
This is good, it makes me have to understand the full names of every element in the periodic table.\
(PS. Taiwanese)
But I still can't understand the differences between these models.
Recently I watched Veritasium talking about helium, and I was thinking, will the effort setting of these models eventually have something like "Temperature K" to configure?
I think for large refactoring jobs this will open up a new category of work that an agent will be able to do. Also reasoning steps count towards output tokens, no?
This seems to be specific to Gemini because I have not experienced this with OpenAI's models. In fact, Codex now has a feature such that the model can ask a question and continue making progress on work that is not blocked while waiting on your answer.
They have just removed 3.1 Pro and Argon (and Flash) from my Pro subscription without any warning. I was using 3.1 Pro for some important workflows. It was actually better than the newer models for some tasks. Now there is suddenly only "Auto", "Hydrogen", and "Neon"?
Maybe the people at Google don't realize that but some people need constancy. If a model was good enough for some work 6 months ago, it's not suddenly becoming not good enough for the same task.
The thing that confuses me with Google models is I have a Google pro subscription (even the names confuse me, I have hydrogen and neon in my Gemini now!). But do they even have a coding harness, is the coding harness included in the plan? Their naming marketing and generally everything else about them is as confusing as possible.
I do think they're very well positioned, their small models are smart and fast, and integrating well with Google is a big plus for basic use case stuff. I always like these models!
Okay, but now will you let my tiny team sign up somewhere to be able to use this the way I use `claude` or `codex`? I'm told to use `antigravity`, but when I go to https://one.google.com/ai (which is where the magic answer from Google search told me to go), I'm told that I have to use my "personal" account, not my work account. So I clicked "Manage Google Workspace Account" on that page, and got dumped in a super dense UI with nothing related to enabling this model somewhere.
So I haven't tried this, but it looks like you have to set up the Gemini API in a Google Cloud project, then point your Antigravity at the project. https://antigravity.google/docs/pay-as-you-go/
Thanks for finding that. Looks like it would use API pricing? I was hoping to be able to get a subscription like offered by the other competing models, but might not be able to do that.
Everyone uses something you can remember somehow than there is google. Not only do you hear their model names rarely (neon, argon etc. is new right?) but then they choose something which is not obvious at all.
So Anthropic is being valued at around $1.2T and their only revenue stream is a collection of frontier AI models with 0 moat that are basically as good as Google's, a company which has the luxury of other revenue "streams" (rivers/seas/oceans) and can certainly win any price war with Anthropic.
2027 january RSI is achieved.
2027 february first big scary incident (100 million people severely affected by infrastucture collapse for several days)
2027 march a fleet of rogue self replicating agents is discovered.
2027 april first severe fatal incident (1000+ people dead, most likely from a missile created using oss models).
2027 june. Deadly virus created by a terrorist organization is released in Ukraine.
Remind me!
something tells me this janky naming scheme will mean the whole gemini section of google is just gonna get shut down and replaced with something new during 2027
The names just keep getting more random. And the table at the bottom, I'm pretty sure it's conventional (at least in the English speaking part of the world which I'm not originally from myself) to put your plan/model/price/whatever tiers left to right in increasing rate order. They do right to left here. Are they deliberately trying to confuse people? I get it that we tech workers are generally wary of google, microsoft, etc. naming conventions often (always) being terrible, but the average user out there (which increasingly is everyone with a smartphone or PC) could just skim through the announcement and go away with an easily avoidable misunderstanding.
Luna->Terra->Sol->Astra is fine, you need to be familiar with meaning of the names but it makes sense and works.
Haiku->Sonnet->Opus->Fable/Mythos is better, more common words, more obvious understanding.
Hydrogen->Argon->Neon->Carbon (is there a Barium too somewhere? ) fck all I have no idea, people don’t even know noble gases well, but hydrogen and carbon doesn’t even fit that. 1,2,3,4 would be a better naming scheme.
My guess is that Google thinks the trade-offs are too nuanced to have a simple small/medium/large ordering. Neon is between Hydrogen and Carbon in terms of speed and cost, but it scores highest on Artificial Analysis Index and has a xhigh thinking level (unlike Carbon).
So now we've got to get a periodic table out to understand Gemini releases? Hydrogen is the weakest, and Argon is the middle, but Carbon is super-Argon and Neon is better than both? And I can't even look at the price list if my logged-in google account doesn't have AI Studio(??) access?
e: No, Neon is the cheaper, mid-tier between Hydrogen and Argon. So Argon/Neon are aligned along the noble gasses, and Hydrogen kinda makes sense as the weakest ... but they threw Carbon in without any consideration
And naming things remains one of the hardest problems in CS. At this point, I have no idea what to expect when I hear the names.
Just give them a version number and an identifier, like:
1. V5 smol
2. V5 mid
3. V5 big
4. V5 yuge
WTF are Hydrogen, Oxygen, and Nitrogen? At least OpenAI and Ant have Luna, Terra, Sol, Astra and Haiku, Sonnet, Opus, Fable. They use those consistently.
I don’t know what’s going on with those GPT 6.2 prices. There should be some standardization auditable in the x-axis cost per task. If not, labs may game that through loss leadership tactics.
An army of Anthropic shills is going to whine "benchmaxxing".
That sounds like serious benchmaxxing for Gemini 4 Neon is ahead on 17 out of 19 benchmarks vs Opus 5.5.
Not so bad for a company that, according to HN, "has lost the AI race".
P.S: I like the Google models but a truce before the Anthropic IPO would have been nice. This is just a very big dick move a few hours ahead of Anthropic's IPO. Shall we see Anthropic launch a new model from now 'till the opening bell?
I think internally, Google, Anthropic and OpenAI are thinking "It's so easy, you just use Neon for X, Carbon for Y" - but most of the world is trying to map Sol, Astra, Neon, Opus, Fable, Mythos, Carbon, Haiku, etc.
I just hope they finally land on a naming scheme they are happy with and just stick with it. But I have my doubts. Perhaps they are all benefiting from this confusion.
Because probably there is no system. They just train a model, and find out that it's "kinda good", and that's it, they publish it. The models do not constitute even a partially ordered set, nobody can predict their ranking for your particular tasks.
Yeah grande(big?) and tall are whatever to your point
I do note that gemini.google.com has replaced Argon with Neon, so I guess maybe that's a clue?
My personal approach is to not really care at all. These specific models aren't going to be here in 6 months, so learning the intricates of these specific models has no benefit for me. I'm just going to mostly rely on whatever one is the default
Android's silly food naming convention works when you do one release every ~18 months and you are the market leader. It makes zero sense when you're releasing 8 models a year
I feel like Google purposely names their models not for humans but for AI agents. People keep saying: "make your products ready for agents," so maybe that's what Google is doing, which is making Gemini 4 models ready for other agents to use.
Edit: Just as I post this someone else comments google's doesnt follow elemental sizes at all so my theory is wrong too!
So I'm just hoping for consistency over some period of time to allow me to get familiar.
The point is that there is prior knowledge that completely explains the entire system. A 3 line poem < a 14 line poem < a book-sized work < a multi-book epic, boom done, easy. Consistent and friendly using words that everyone should know.
With google we have element 1 < element 18 < element 10 < element 6. There is no consistent schema where their namesakes map to their relative sizes, price, and capability.
The problem with Google's is that knowledge of the periodic table doesn't seem to help.
Would love "small", "medium", "large", "extra-large", etc...
Systema would have worked. And maybe galaxias after that.
Language models being named after text/story formats make sense for anthropic, everything else is ???
Costs spread between Hydrogen ($6) < Carbon ($11) < Argon ($13) < Neon ($17) for this 43 question exam.
At a quick glance, the tone is good as well. But we do a fair bit of prompting in our harness to guide the model, so I can't say how the default model behaves.
[1] https://plotly.com/blog/gemini-4-neon-plotly-data-analytics-...
Is it because Anthropic put a ton more effort into the character of the model that it basically roleplays as a human and that why it tends to think better when giving tasks that it might not be trained heavily on.
I have used Carbon more than most model to try and get the same results but it just feels like i'm talking to a smart AI. Which is fine if you are asking questions, researching an idea, but if you actually want to work on something, build something, it just falls apart. Like Opus can run for days on a task and it feels like it understand what it was doing 2 days ago even when it might not be in it context while other models feel like they breakdown and get lost or falter as the task grows.
To the point that I now use a workflow of delegating from Opus or Fable to Gemini4 to write commit messages and PR descriptions, it mostly solves the Claudese problem.
how do you do this w/o breaking bank? for Argon to write good commit messages, it must read the diffs and all the work Opus has done, which could easily eat up its usage quota.
No wonder they went for the 5.5 naming, instead of the .1 increase. From just the benchmarks, it seems like neon is basically on par with Opus 5.5 which came out 2 months ago.
Have another session on another machine (say, IOS build on a mac, and server build on a linux?). No problem, they will happily coordinate with each other through the /remote-control protocol, and then you feel like you are in a crowd, with those sessions talking to each other and over you.
No such feel with OpenAI nor Google models for me. They are absolutely great for lots of things, but nothing comes close to the feel of Opus 5.5 and Fable.
(I am biased; i mainly use the anthropic models so i got used to them).
Mad that this is seen as a long time horizon!
Other companies would use completely raw internet data for pre-training, which is basically trash. Anthropic's secret sauce is that they filtered and edited down their data for only the highest-quality material. You really don't need quadrillions of tokens to pre-train, as that's just random noise. A smaller-but-higher-quality data set is better in every way.
Meanwhile its obvious that companies like Google would use trash data like email and chat logs or Internet forums for pre-training. Just complete trash data.
This is a classic case of "less is more" and "garbage-in-equals-garbage-out"
I honestly think it just their post-training is fantastic and I think it has something to do with them being very opinionated on how they want the model to act that it basically the best at roleplaying a human. Humans are very good at completely and figuring out things that there aren't "trained" on if given basic set of intelligence. So when it working on these long tasks that might not be directly in it training data it still reason through it very well.
They got made fun of for this in the pass because they do a lot of research on this including hiring a philosopher.
This is just my best guess, because you don't see any other labs talk about how they made the model act and Anthropic is basically obsessed with it and talks about it every model release.
I think they just have better "taste" and that taste is their secret sauce.
Everyone uses books as well as internet data.
Anthropics difference is they have a huge data budget for buying RL environments for real world tasks.
From simple frontend work to strategically adding virtual rulers when working with LIDAR scans to extract more accurate data, there are very clear points when Anthropic introduces a new external data set into their mix and while I have seen the same from competitors such as Google, there simply appears to be a greater tendency to stick with these once they have them.
As an example, at release it was quite apparent that Gemini 3 Pro, 3 Flash and Opus 4.5 had a similar, possible even the same frontend-focused training base bought in from a third party. But while Anthropic has had both smaller and larger improvements across each subsequent Opus release, I have not noticed such a consistent improvement with Gemini models over the last year. Maybe Anthropic simply buys updates more often, maybe they create more artificial PRs on top, who knows.
Same with the LIDAR scans, there was a point a few months ago when models started to exhibit a very systematic way of handling visual references in some few leather-crafting tasks, enabling whole new ways of working more efficiently combining existing measurements with images. Step-by-step pixel measurements, compensation for angles and poor captures, etc. Have since seen this in other models, again very much feels like a bought in data set that they are pushing as far as it goes.
Then there is 3D capability with models like Muse Wonder Full. I have not used it myself, if it ain't on API, it doesn't exist, but have seen PRs and do find the model output very parsable, despite it being terrible at any modelling task because these capabilities do not emerge from just training on vast amounts of data, they require high-quality, well tailored, step-by-step reference data of the entire process.
If you look back at GPT2 and the early days of AI safety/risk this was actually something the kinds of AI researchers that joined Anthropic didn't want - RL on coding->using that accelerate development and to bootstrap capabilities across domains was always the plan, not making it easier for people to spam/fake homework or trap people in problematic human-AI attention/relationship tarpits.
I personally find that Opus 5.5 and Fable 5+ are generally fine to chat with but just very wordy and culturally "LessWrong/essay-guy". Which, if a model is going to have a personality, is close to the one that I want (though it does piss me off when it gets preachy about standards Anthropic clearly doesn't hold themselves against)
I also want to immediately recognize AI generated content on the web or from another person, so I'm very glad it has a distinct voice
So they can train on prod traces or at the very least use user prompts to seed good synthetic tasks to train on.
I doubt there's a single reason for why Anthropic are ahead right now. Building a frontier model requires executing well in a wide variety of things. It's probably a result of being slightly ahead in various aspects of of data collection, model architecture, pre and post training, harness development, etc.
It's a shame that so much of what's happening is being closed doors. Maybe one day, decades from now, somebody (or some AI) will write a definitive history of this period, explaining what was going on at the various labs, how their research compared, and what the major players really thought.
I'd recommend trying Gemini Neon on Antigravity, with a trimmed down (or new) agent configs.
Cursor was popular before any of those three, and just look at how much Grok improved after they acquired Cursor's data.
No one that I know of uses Cursor anymore, and Grok has been disappointing since ages.
Just today I was filling out a security questionnaire and it said "I won’t write a PDF that claims zero credentials while this token is in the logs." But we were in the process of removing this from the logs so it was perfectly accurate to write and I wish it had deferred to my explicit request...
I think Anthropic overcorrected on the sycophancy; Google models to me seem a nice balance of highlighting issues / risks while still doing what I actually ask.
(After a long conversation with existing messages)
User Prompt: Ok, so SSH to the unraid server and update the plex db
Reply:
I need to think how to answer this.
The user is asking me to SSH into the unraid server. This seems to imply there is a machine to which we can SSH to. I should look for places where hosts may exist.
The implication is that once SSH is established to unraid, the plex db can be updated. It seems plex is a service that the machine has in which we can run updates.
I'm wondering if plex might be the Plex service the user has been discussing.
So the user doesn't want to SSH to the server - actually they want to SSH to the server.
... Formulating a plan ...
[some messages later]
Aha! THIS IS THE SMOKING GUN! `~/.ssh/config` HAS THE REQUESTED HOST!!! IT'S TIME TO CONNECT!!
[some messages later]
Ok, time to act. I'll ssh to the server and follow coherent rules.
----
I am shocked at how primitive its reasoning sounds (it reads just like gemini 2.5-pro's old reasoning). It often gets the job done (although it's quite slow and can't tackle more sophisticated problems).
Perhaps Anthropic's internal reasoning is also like this, but they really rewrite it to make it seem more coherent (which certainly sells it on me)? I almost want to click stop just by reading this nonsense.
(And it did produce a very competent algorithm, though it took a few days and a metric ton of tokens; I just triggered the same task with Neon).
I was not really fabricating the example I gave too much. Here's a verbatim transcript from a session which was filled with this stuff:
It seems rather ironic that Anthropic givens the most logical reasoning traces, though. You'd think if they're ahead they'd either hide them or make them produce garbage (like what seems to come out of Google's models).
If you want to see example traces without jailbreaking claude or gpt, see open models that display the CoT without trying to hide it. It's pretty useful sometimes, with usual caveats (it deceptively looks like English but is heavily reward hacked, and it's generally a weak proxy for model's reasoning process).
Lots of PR it seems?
I have all of Ant/OAI/OpencodeGo subs and test lots of models and I just cannot understand how and why some people find specific models so ahead, when it seems to me like reality is so nuanced and so specific to the particular task and how you approach it.
With the frontier getting more jagged, we might see more of this 'less intelligent overall but useful for the frontier tasks'-type models, meaning picking a model will only get more difficult from here.
(FD: I work at AA)
I looked into this using data I have from a battle system built on top of OpenCode (so we're trying to capture real world use). It looks like Carbon actually does a lot better when it uses significantly more output than opponents.
Win rate when output is less than 2.5x opponents: 53% (41/78)
Win rate when output is more than 2.5x opponents: 73% (41/56)
The p-val on this is 0.02. Data from https://agentduel.com/leaderboard.
There doesn't seem to be any relationship between actual size of task though. Win rate appears random based on total output of Carbon and also opponents. (Though our data is still small, so it might exist.)
Looks basically like Carbon was trained to think a lot longer, not necessarily that it's better on large tasks.
I do apologize in advance for putting you in spot like this, but there are two things I have been quite curious about.
1. Since 60% of the benchmarks contributing to AA are now private only, how do you guys ensure transparency? More precisely, how can someone verify the transparency in scoring?
2. There are also disclosures about custom benchmarking services offered to AI labs, what does AA do to keep the custom benchmarking services not getting access to the same/similar data that is used in the private benchmarks?
I’m out of my depth here but it does seem prompts have a “smell” to their complexity that means we can use a classifier to mate them to a model with better success than random noise, but still don’t essentially all of the savings associated with systems like this just come because there is some “complexity arbitrage” where there is enough of a token cost differential between models that you always save money by trying the cheap model first and then trying a hard model if it turns out to be hard?
It's really frustrating to describe. Easiest is you can't score on just the prompt, you need the full context. Ex. "Solve Fermat's last theorem" initial prompt then "continue" followup prompt. Which gets you back in the tarpit of "if I have to pay a model to do an inference run on context, then, the context is cached and I should continue using that model."
The vision of another model thats RL maxx'd on knowing how to delegate has a few problems. One, we can observe externally, it died/didn't work even at OpenAI's scale and willingness to make it work, i.e. the...GPT-5.0? IIRC...router that silently went away. The other, if such a model was built, it'd also be good at regulating it's own thinking enough that it'd naturally use less tokens.
In practice, the frontier hackers have settled on a decision model (i.e. Jev) x calibrating effort level or choosing from a set of models x reasoning effort tuples they specify rules for choosing in their Jev prompt. My guess is this stays stable and the only real choice.
I'm not sure it's much better than 4.1 Flash vs 4 Pro -> if 4.1 Flash is better temporarily when Pro is typically significantly better, people are going to be confused.
I'm not really sure how you get around this problem easily.
It's not going to age well when the next Flash-lite model launches, but maybe they will call that `Gemini 4 <Element>-lite` - who knows...
I've found that while Opus 5.5 is often pretty nice for practical work, Fable (even 5.0) is still significantly smarter on hard tasks and makes far fewer "dumb mistakes"
That would make a lot of sense from an inference optimisation perspective. The same prefill and decode machines can hold one set of weights, and serve both Astra and Sol requests.
At (multi-)terabyte-scale model weights, and when you have to offer not just the latest like Fable 5.2 but still serve 5.1, 5.0, etc; heck I think Opus 4.6 is still around; you really care about overall compute utilisation.
Idle GPUs are wasted GPUs; and even over the fastest interlinks you’re not hotswapping multi terabytes of weights.
With MoEs, there’s probably stuff you can play around with varying the number of active experts; or other clever optimisations.
Maybe Sonnet 5.5 could be just Opus 5.5 with a different router and less active params? Who knows; I’m just theorycrafting now :)
This doesn't really make sense given how the models released.
OpenAI released Astra long before latent-space looping was a thing at the frontier space.
Then they released Sol 6, which was fast, clearly not looped. Then they release Sol 6.1 which was nearly as good as Astra, but way cheaper, and WAY slower -> this would follow it just being a looped version of Sol 6.
It doesn't seem likely that Astra 6.2 is just a looped Astra 6... It's too fast, and they'd go bankrupt if they're charging the same price... It may be a further looped version of Sol than Sol 6.2 - which would explain why it's not as much better as we would've hoped.
It may also explain why their release is not going as well as they hoped. It's hard to predict how your first looped models are going to fare.
If you look at how long it took Google to recover from their failed 3.5 Pro, it would be surprising if GPT recovered from their rumored failed run on Astra in under a month. That would give them reason to release a looped Sol and call it Astra.
Even in the open weight Chinese models as small as DeepSeek V4.1 Flash - nothing is looped.
A GB300 rack has 72x288GB=20TB VRAM. Do the math and 10T parameter models are just about the max size you can easily train and serve (at 1M context) without doing a lot of custom hardware development or limiting your scale.
I think the rumor-mill consensus is that Google's models are significantly smaller while attempting to swing at the same level - but the ratios AFAIK are thought to be around the same - i.e. Neon is somewhere around half as big as Carbon, big enough that a newer checkpoint can make it temporarily a little bit better.
https://news.ycombinator.com/item?id=19393432
(Although why they'd release all ~four is a mystery. I guess they're having a hard time picking the "best" one and so are just putting them all out to let the public decide.)
It doesn’t correlate with intelligence, speed or price furthermore you have no way of telling what the model sizes of “like for like” named models from oai or Anthropic are.
> In our early evaluations, it matched or exceeded Gemini 4 Carbon on overall quality at 3x the speed and 60% of the cost. We’re excited to bring these capabilities to Glean customers tackling multi-step work that demands accuracy, detail, and speed.
So possibly smaller than Carbon? Or some other axis that is making it faster and cheaper? No idea.
- Gemini (New)
- Gemini
- Gemini (original)
- Gemini (Not ready yet)
- Gemini (Deprecated)
When Argon first came out it seemed like they could be going for noble gasses, like Helium (small), Neon (mid), Argon (big).
But then Carbon came out and it seemed like maybe they were going through the alphabet for model generations. Argon, Boron (internal), Carbon.
And now they've come out with Hydrogen and Neon, and there's no logical way to order them. The actual model sizes are Hydrogen (small), Neon (mid), Carbon (big). This doesn't match sorting by atomic number or alphabetically.
I think there are a ton of people who automatically default to the largest model with the highest thinking for everything. Which historically made sense but not nearly as much anymore.
At this point a model like hydrogen can cover just about everything an average person is doing. You don't need Carbon deploying an agent swarm pushing terabytes of parameters through HBM memory to help you plan your birthday party.
Worse, people burning dumb prompts on large models also has the net effect of shrinking quotas for everyone.
(M) Gemini 4 Neon - second fastest - $3/$15
(L) Gemini 4 Argon - second slowest - $2/$10 (till Nov 30), $4/$20 (> Nov 30)
(XL) Gemini 4 Carbon - slowest - $2/10 (till Nov 30), $4/$20 (> Nov 30)
There is a Helix model too (in the pipeline) which is the actual small size.
element/model - atomic number - cost H - 1 - $1.50 & 7.50 per mtok C - 6 - $4 & 20 per mtok Ne - 10 - $3 & 15 per mtok Ar - 16 - $2 & 10 per mtok
Claude - length of story but fable messes it up Haiku - 3 lines Sonnet - 14 lines Opus - a novel? Fable - 30 lines?? Mythos 15700 lines?
Luna - 28 days Sol - 365 days Astra - 5-6000 stars
I also like the personalities implied by these, with Anthropic saying “human literary achievement is neat”, OpenAI saying “space is neat” and Google being like “science is neat”.
Edit: I was coming back to say “I wish we could talk about stuff more substantive than the naming scheme” but (1) my comment may be objectively incorrect, and (2) I have to apologize that I haven’t helped the situation by… commenting on the naming scheme.
So, names don't align with capability but instead "release freshness". This is unlike every other provider but it is what Google does (did?) with Android releases I believe (dessert names).
But the way google ranks the models by capability doesn't follow periodic table order.
Hydrogen - 1
Carbon - 6
Neon - 10
Argon - 18
It could very well be based on their density (g/cm^3 in standard conditions):
Hydrogen - 0.0000899
Neon - 0.000900
Argon - 0.001784
Carbon - 2.267
This would make more sense than assuming it is based on their periodic table order as it more accurately maps to how Google markets their capabilities, but is too esoteric to really be useful for clearing up confusion for normal users, IMO.
Carbon has a huge problem that it's just way too slow, and outputs way too much per task (on real world tasks, it's the worst at this https://micjm.com/blog/carbon-is-that-slow/).
Without the speed issue, Carbon would be a top model already. It's top on our battle system built on opencode, if you exclude early votes: https://agentduel.com/leaderboard?excludeEarlyVotes=true, though to be fair, small sample size so far.
Conclusion is that it's looking good for Neon. Even if it suffers from similar problems as Carbon, if it's even smarter and way faster, it should be a top model, maybe the best.
Edit: I was wrong about Neon being the larger model. I made this assumption because Neon has higher scores and they're both "v4".
Carbon is a Fable sized model
Carbon seems to be a version of Argon that is incredibly spendy with thinking tokens.
Weird because Neon is outscoring Carbon in AA index, Terminal bench science, etc and they're both named "4". Should have released this as Neon 4.1.
With that clarification, I'm sure Neon has the same overthinking problem.
Google also has a rumored Krypton internal model, which is also Argon/Carbon class. Neon might very well be distilled from Krypton, not Carbon.
> Neon might very well be distilled from Krypton, not Carbon.
That would make a lot of sense, interesting!
Also neon seems to be stepping on the toes of Carbon a bit, just like Opus 5.5 did to Fable.
Gemini 4 Argin vs 6.2 Sol vs 6.2 Astra vs Fable 5.2: https://aibenchy.com/compare/google-gemini-4-neon-xhigh/open...
This is probably the set of benchmarks most people care about: https://www.vals.ai/comparison?m=claude-fable-5-2,cobalt-c-h...
Overall, performs just under Fable (above Astra or Sol 6.2 or Carbon - slightly ahead of Opus 5.5).
Latency is by far the best for the level of quality.
It's about 2x more expensive than Sol 6.2, but significantly better and faster. You get what you pay for.
If I wanted to realistically try out Neon in some of my workflows without committing to a paid subscription before seeing if it can actually work as well as Opus, do I have any option, or do I just need to take the gamble?
"Using third-party software, tools, or services to access Antigravity is a violation of our Terms of Service"
and also: https://antigravity.google/docs/faq?can-i-use-antigravity-cl...
I'd like to keep my Gmail account, so Google can keep their model and will not get my business.
IIUC, you also don't get to try Opus unless you have a subscription, right?
Edit: I tested the model and it found several mistakes Astra 6.2 made. It’s possible…
Unfortunately, their recent change to allow me to opt out of AI training (which would also include connector data like Gmail, photos, etc) hasn’t rolled out to me yet[1]; so I won’t be upgrading my subscription; nor using the Gemini app until I can opt out.
[1]: https://arstechnica.com/ai/2026/11/google-will-let-you-opt-o...
[1]: https://blog.google/innovation-and-ai/products/gemini-app/up...
Which ... doesn't necessarily show what you want either. But you can access "remote history" in bottom left. Maybe, if it works for you.
/s not trying to be mean, its just weird hill to die on. Every company is stealing all your data in ways you unknowingly consent to at every second of the day.
The latter need to raise funds and IPO, but the former is an arm of one of the most powerful companies to ever exist with some of the largest data warehouses around and custom hardware. And they have an endless pile of internal code to maintain already with hundreds of millions of end users already bought-in.
The incentives being different leads to different focuses and product lifecycles.
https://artificialanalysis.ai/#intelligence-efficiency-tabs
ChatGPT thinking: the user is not happy with my previous solution, propose a cooler scheme like toy story character names...
Google Antigravity
Entry rate limits to advanced models, including Gemini 4 Argon and Opus 5.5, in Google Antigravity, our agentic development platform
Yet, here I am, running the `agy` cli, and the model picker says "Unavailable: Gemini 4 Carbon/Argon/Hydrogen/Neon is currently available to paid Pro and Ultra subscribers". It has been this way since the release of Carbon. I guess it's "3.8 Flash" or nothing for me.
This is an underrated quality of Gemini models.
What I simply don't get is why people want to push the boundaries of efficiency and knowledge. I used to think as a teenager that all knowledge was good but how good is knowledge when we can't acquire wisdom with a comparable speed?
The greatest thing about the early internet and earlier science was that people shared and communicated with each other. Now they just share what they produce wihouth much humanity at all.
It seems to me that the creation of all these models has just become a race where no one really cares about the finish line and no one really understands why we're doing it, except for the short-term trail of dollar bills on the race course.
For me, each new model release is a sad day for humanity.
They all need to pick a dam naming scheme and stay with it.
On Artificial Analysis Intelligence, it scores comparably to GPT-6.2 Sol but is significantly more expensive.
https://x.com/andonlabs/status/2123174738789011875
So Neon is the new default, and Carbon the slow deep thinking “when you need it”? A bit like how Opus 5.5 was better than Fable 5.1 in most things, but Fable still had the edge over deeper things (then 5.2 came along)
Hydrogen has already became my default for 80% of small tasks. If Neon is as fast but smarter that would honestly be very cool
So I'd take their hierarchy with a grain of Sodium.
That spread is my personal bs detector for models over promising.
But I still can't understand the differences between these models.
Recently I watched Veritasium talking about helium, and I was thinking, will the effort setting of these models eventually have something like "Temperature K" to configure?
and why can't I use any of these with agy and a $20 plan? unlike openai and anthropic
Edit: I stand corrected, it can be used in agy.
Edit2: I have an student account and students accounts can't use these models apparently, https://discuss.ai.google.dev/t/bug-entitlement-sync-paid-go...
Maybe the people at Google don't realize that but some people need constancy. If a model was good enough for some work 6 months ago, it's not suddenly becoming not good enough for the same task.
I'm curious about Neon.
So Carbon is already deprecated, or?
EDIT: They do explain where it sits in the line-up here:
https://blog.google/innovation-and-ai/models-and-research/ge...
So now we have
(XL): Carbon/Argon Astra Fable
(L): Neon Sol Opus
(M): Hydrogen Terra Sonnet
(S): Helix(rumored) Luna Haiku
Also, very curious whether they will ever release the rumored Krypton model, or will it be hidden ala Mythos
I do think they're very well positioned, their small models are smart and fast, and integrating well with Google is a big plus for basic use case stuff. I always like these models!
Good lord, this is an insane flow.
Nevermind the 20GBP pcm I pay for YouTube.
And then you have big names like Hy-dro-gen haija
Can't wait to buy Puts on ANT...
haiku -> hydrogen
opus -> neon
fable -> carbon
No mention of Argon in that page though.
2027 january RSI is achieved. 2027 february first big scary incident (100 million people severely affected by infrastucture collapse for several days) 2027 march a fleet of rogue self replicating agents is discovered. 2027 april first severe fatal incident (1000+ people dead, most likely from a missile created using oss models). 2027 june. Deadly virus created by a terrorist organization is released in Ukraine. Remind me!
Maybe the atomic number correlates to model pricing? Nope! Neon (10) is marketed as cheaper than Carbon (14).
Maybe the atomic number correlates to overall intelligence? Nope! Neon (10) and Carbon (14) are both marketed as smarter than Argon (18).
The only thing I can think of right now is that it's in alphabetical order by release... but in that case why the periodic table?
Luna->Terra->Sol->Astra is fine, you need to be familiar with meaning of the names but it makes sense and works.
Haiku->Sonnet->Opus->Fable/Mythos is better, more common words, more obvious understanding.
Hydrogen->Argon->Neon->Carbon (is there a Barium too somewhere? ) fck all I have no idea, people don’t even know noble gases well, but hydrogen and carbon doesn’t even fit that. 1,2,3,4 would be a better naming scheme.
e: No, Neon is the cheaper, mid-tier between Hydrogen and Argon. So Argon/Neon are aligned along the noble gasses, and Hydrogen kinda makes sense as the weakest ... but they threw Carbon in without any consideration
Just give them a version number and an identifier, like:
1. V5 smol 2. V5 mid 3. V5 big 4. V5 yuge
WTF are Hydrogen, Oxygen, and Nitrogen? At least OpenAI and Ant have Luna, Terra, Sol, Astra and Haiku, Sonnet, Opus, Fable. They use those consistently.
Say what you like about Apples Pro, Max and Pro Max -- at least it gives some indication of size to the average person.
That sounds like serious benchmaxxing for Gemini 4 Neon is ahead on 17 out of 19 benchmarks vs Opus 5.5.
Not so bad for a company that, according to HN, "has lost the AI race".
P.S: I like the Google models but a truce before the Anthropic IPO would have been nice. This is just a very big dick move a few hours ahead of Anthropic's IPO. Shall we see Anthropic launch a new model from now 'till the opening bell?