2 comments

  • bessbd 8 minutes ago
    > 5 phases and 33 stages from initialization through operation

    > 14 agents: 11 domain experts, 2 reviewers, and an adaptive composer

    wow, that's a lot of domain experts, I'm convinced

    • robbomacrae 7 minutes ago
      It's a great for tokenmaxxing /s
  • swiftcoder 31 minutes ago
    Sounds good in theory, but are there evaluations of whether or not it actually works?
    • robbomacrae 8 minutes ago
      The answer to that is no. A lot of these are released on vibes and showing that it does what it says it does. For most organizations that care about processes and procedures thats... enough? I've worked on agentic development in enterprise and they just want their way to stamp their old methods on to the new agentic world so it can pass through their release hoops.

      I've tried to benchmark them the most common public skills including those for ADLC (ie SuperPowers) couple of times here https://orcabot.com/benchmarks/agent-skills. Annoyingly I haven't been able to release one in a while because its been next to impossible to stop the new frontier models from cheating one way or another.

    • Throw12349067 6 minutes ago
      I am one of the organisational victims who have been trialling this.

      My assessment has been just use the native harness.