The problem is that "cybersecurity" isn't some special task that only your security team does.
In the project I maintain, I find bugs and fix bugs. Some of those bugs might result in an LPE. I generate a regression test, then I fix the bug.
The problem is that generating a regression test for that type of bug is technically a PoC. I can almost never get Fable to create one. Sometimes Opus 5 punts as well. Same with Sol and Luna.
That is, unless I socially engineer the model. I can't talk about security. I make sure they don't read the file call cve_test.c (literal regression tests for CVEs). I have to hide part of my project from the models for them to work.
Anthropic and OpenAI are driving me to use other models.
I’m a web performance engineer — I help clients find and fix site speed issues — but recently I spotted what I thought might be a security/privacy issue. Security not being my specialism, I asked Fable to help me triage and, if necessary, raise the issue with my client.
It refused. It’s so so so adjacent to the work we’d already been doing, but the moment I asked it to help me understand what I thought I’d found, it left me high and dry!
$35M in credits (!) for the Defender Advantage Fund (0xDAF) doesn't sound that much given that e.g. the HAWK attack [1] cost $100k for 1 (albeit very advanced) vulnerability.
As a side note, that Golden Eagle wording "bringing a wartime footing to the cyber domain to relentlessly patch vulnerabilities" sounds so AI-written maybe that's what the credits are needed for.
What a bunch of wankery from Anthropic. I already use Sol 5.6 for security auditing and it works great, and as a bonus doesn't give verbal vomit every time.
From a cost perspective Mythos is too expensive right now. With the right Harness and a few layers of models you can get close or better in some circumstances. Kimi / GLM, Qwen etc. And that's before ablation / Abliteration...
For those in Mythos.. if you ask how much it cost to assess their repos, your jaw would drop. We're talking the price of buying a couple machines to run Kimi / GLM full weight outright.. for one Scan.
Right now I wouldn't say GLM 5.3 is the same, but it's not far off. For the cost benefit it's the better of the two.
I’ve been working on a decompilation project that fable was choking on and GLM 5.3 has been chunking away at it for 72 hours now? I think it’s my favorite agentic/implementer model right now.
This week I found two issues in my company codebase. After finding them I told a claude session about one and asked for a quick proof of concept demo of the exploit. It refused, including refusing simple things in the same session afterwards.
Meanwhile same model in a new tab, say I need help creating a page that hits an endpoint with a special payload and it does the same things that were too dangerous in the previous tab...
> Bringing the cybersecurity capabilities of Claude Mythos 5 to more defenders
This dance is quite annoying. When Anthropic releases a paid model, the user should control what it does and doesn't do. The other day I had a security incident that required urgent response. ChatGPT and Claude were utterly useless (I quickly attempted to get access to the former's advanced security capabilities but was met with a form I could complete - far too slow for a time-sensitive problem like a security incident!). So I used grok and it helped! I am told Kimi also helps in such cases although haven't tried it yet.
may have been rushed by hugging face being unable to use claude to debug or fix their breach, because there isnt detail on new guardrails put into place to protect against anthropic's initial concerns of wide distribution?
separately, it is interesting they are adding an oem type offer:
>We’re working with our cybersecurity technology and services partners to integrate Claude Mythos 5 into the products and services defenders already use to secure their software.
anyone know the shape of those contracts, e.g. pure tokens/usage or more of a traditional licensing or oem type structure?
Screw you Anthropic and screw your gatekeeping, Opus 5 refuses even basic reverse engineering / patching tasks, even BPF is apparently too dangerous, you lost your minds..
I found that Claude / Sol were basically useless when approaching various CTFs that allowed AI tools, but running Qwen and DeepSeek locally and GLM via OpenRouter worked fine. It's blatantly obvious to anyone that even does tangentially cybersecurity related work that Anthropic's position here is stupid and detrimental to security.
In a world where things such as GLM-5.3, DeepSeek-V4-Pro-0813, and Kimi-K3 exists, this is a bit laughable.
Anthropic needs some model with a fancy name so they can pretend for another while that their model is so powerful it will destroy the world if released. I propose Claude Legend 6.
>In a world where things such as GLM-5.3, DeepSeek-V4-Pro-0813, and Kimi-K3 exists, this is a bit laughable.
This is not just for security, too. Using Fable for anything that could be remotely construed as being connect to chemistry or biology was impossible until a few weeks ago. Now it is slightly better, but still fails on many completely innocuous projects.
So as other models advance, Anthropic's sole frontier offering to entire academic fields remains an Opus that seems to get worse in capability each release. They're starting to become a joke in my field: at a conference a few weeks ago, one presenter laughed when I asked about his use of Fable and pointed out that it would downgrade if the letters 'd', 'n', and 'a' were anywhere near each other, which is not that far from my experience.
>> In a world where things such as GLM-5.3, DeepSeek-V4-Pro-0813, and Kimi-K3 exists, this is a bit laughable.
Is it, though?
We don't know what Mythos is really capable of, beyond what Anthropic has told us, and some second-hand accounts from orgs that have been whitelisted.
What we do know is that their withholding it from the masses is causing a lot of harm to their reputation and general annoyance. And probably a lot of money as well, as those people cancel their subscriptions in favor of other models. They are about to IPO, and you don't want people to have a bad taste in their mouth during this critical period.
As such, I think it is reasonable conclude that there must in fact be very valid reasons for them to keep going down this path of gradual access-widening. I'm never going to blindly trust a corporation, but in this case I'm not going to hate on them either because, at the risk of repeating myself, we just don't have all the facts.
Open models are extremely capable, as benchmark after benchmark has indicated.
Beyond that, for the vast majority of software development (including cybersecurity), the open models are there already. All that without having to pay the hefty Anthropic premium, not to mention all their bullshit with pretending their model is some sort of WMD and their awful uptime (although, to their credit, they seem more stable than Github).
As basically every subject matter expert has stated again and again, benchmarks do not tell reveal anything meaningful and have effectively no relation to the model's actual capabilities.
In the project I maintain, I find bugs and fix bugs. Some of those bugs might result in an LPE. I generate a regression test, then I fix the bug.
The problem is that generating a regression test for that type of bug is technically a PoC. I can almost never get Fable to create one. Sometimes Opus 5 punts as well. Same with Sol and Luna.
That is, unless I socially engineer the model. I can't talk about security. I make sure they don't read the file call cve_test.c (literal regression tests for CVEs). I have to hide part of my project from the models for them to work.
Anthropic and OpenAI are driving me to use other models.
It refused. It’s so so so adjacent to the work we’d already been doing, but the moment I asked it to help me understand what I thought I’d found, it left me high and dry!
There are techniques and ways around it. For example, I've found that disabling auto mode in CC sometimes helps (anecdotal, YMMV).
This is all for "security". You can always make it do what you want, it just gets really, really laborious.
As a side note, that Golden Eagle wording "bringing a wartime footing to the cyber domain to relentlessly patch vulnerabilities" sounds so AI-written maybe that's what the credits are needed for.
(1) https://www.anthropic.com/research/discovering-cryptographic...
For those in Mythos.. if you ask how much it cost to assess their repos, your jaw would drop. We're talking the price of buying a couple machines to run Kimi / GLM full weight outright.. for one Scan.
Right now I wouldn't say GLM 5.3 is the same, but it's not far off. For the cost benefit it's the better of the two.
I have a feeling what we are about to see on HuggingFace is not the GLM 5.3 that you're using now.
Meanwhile same model in a new tab, say I need help creating a page that hits an endpoint with a special payload and it does the same things that were too dangerous in the previous tab...
I eventually gave up and just asked it to fix the issue. The first thing it did? Write a PoC to verify the issue was still valid...
This dance is quite annoying. When Anthropic releases a paid model, the user should control what it does and doesn't do. The other day I had a security incident that required urgent response. ChatGPT and Claude were utterly useless (I quickly attempted to get access to the former's advanced security capabilities but was met with a form I could complete - far too slow for a time-sensitive problem like a security incident!). So I used grok and it helped! I am told Kimi also helps in such cases although haven't tried it yet.
I’m not a fan of limiting access to models, but the other extreme (no limits or guardrails) is at least as bad if not worse.
separately, it is interesting they are adding an oem type offer:
>We’re working with our cybersecurity technology and services partners to integrate Claude Mythos 5 into the products and services defenders already use to secure their software.
anyone know the shape of those contracts, e.g. pure tokens/usage or more of a traditional licensing or oem type structure?
The approval process seems quite intimidating, has anyone managed to implement these compliance standards?
Anthropic needs some model with a fancy name so they can pretend for another while that their model is so powerful it will destroy the world if released. I propose Claude Legend 6.
With how unsustainable they are they really need to hype up those bagholders.
This is not just for security, too. Using Fable for anything that could be remotely construed as being connect to chemistry or biology was impossible until a few weeks ago. Now it is slightly better, but still fails on many completely innocuous projects.
So as other models advance, Anthropic's sole frontier offering to entire academic fields remains an Opus that seems to get worse in capability each release. They're starting to become a joke in my field: at a conference a few weeks ago, one presenter laughed when I asked about his use of Fable and pointed out that it would downgrade if the letters 'd', 'n', and 'a' were anywhere near each other, which is not that far from my experience.
Is it, though?
We don't know what Mythos is really capable of, beyond what Anthropic has told us, and some second-hand accounts from orgs that have been whitelisted.
What we do know is that their withholding it from the masses is causing a lot of harm to their reputation and general annoyance. And probably a lot of money as well, as those people cancel their subscriptions in favor of other models. They are about to IPO, and you don't want people to have a bad taste in their mouth during this critical period.
As such, I think it is reasonable conclude that there must in fact be very valid reasons for them to keep going down this path of gradual access-widening. I'm never going to blindly trust a corporation, but in this case I'm not going to hate on them either because, at the risk of repeating myself, we just don't have all the facts.
Yes, it truly is.
Open models are extremely capable, as benchmark after benchmark has indicated.
Beyond that, for the vast majority of software development (including cybersecurity), the open models are there already. All that without having to pay the hefty Anthropic premium, not to mention all their bullshit with pretending their model is some sort of WMD and their awful uptime (although, to their credit, they seem more stable than Github).
I cannot fathom why anyone uses their service.
Anthropic is overconfident, and it's going to bite them in the ass.
Dario deserves it for being so hypocritical, fear mongering, and ladder pulling. Fastest hero to villain arc in recent memory.