Rendered at 09:05:01 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
supermdguy 10 hours ago [-]
It'll be really interesting when they run RL training on the harness self-improvement loop. I've tried using LLMs for harness engineering, but it often creates too much bloat that weighs things down in the end. Guessing it's just not something the models are tuned to do by default.
Curious if anyone's tried using RL for harness engineering? I think we're still pretty far away from the optimal harness, especially when it comes to long-context memory management.
I went into this thinking I’m a big boy and don’t need all these warnings.
I was wrong.
windowshopping 8 hours ago [-]
I vouch for this story, personally. I love it. I consider it a classic among science fiction novellas.
It does include some brutal sadomasochism with graphic torture, that's true, and that's why it isn't better known. If that part bothers you, which is fair, I would skim past it. The story overall is quite worth it
Jordan-117 3 hours ago [-]
Tbh the torture scenes are not nearly as disturbing as the underage incest. It's like "Saw" vs. a pedo flick from the 70s. Especially weird since the latter is portrayed like some kind of innocent ideal.
It's frustrating because apart from those (awful) aspects the story is quite thoughtful and compelling. I always recommend people skip the final chapter since the resulting existential cliffhanger is far better than the bizarre last-minute swerve into gratuitous sex abuse.
51 minutes ago [-]
nullc 4 hours ago [-]
You shouldn't link that without mentioning that it is a particularly intense S&M/rape/incest fetish piece, and that the squick content is entirely integral to the story. I'm generally dubious of "trigger warnings" but if ever there was something that needed content tags-- this is it.
If you imagine it being written for alt.sex.stories.moderated but somehow failing to be erotic by virtue of being too explicit, and being a few orders of magnitude better writing for that venue... then you wouldn't be too far off. [Started making a silly example of how some sex story could fail like that and then realized I was litterally describing a scene from prime intellect].
It's also arguably the origin of a lot of the mentally ill ai-safety hysteria. Arguably an enjoyable romp for those who understand that it's fiction, but it seems a lot of people cannot.
EarlKing 9 hours ago [-]
For everyone downvoting: It's literally a story about the creation of mankind's first artificial general intelligence, Prime Intellect, and the consequences of that discovery.
JLO64 8 hours ago [-]
I feel that more warning is needed for this book. Everything you’ve stated is true, but the book’s first chapter contains some of the most disturbing depictions of stuff I don’t know I can type here on HN. Additionally, the last chapter put a really bad taste in my mouth.
That said, the stuff that deals with AI and its implications on the universe was great and more relevant than ever. The way PI works is pretty similar to how we use subagents to tackle large repos!
heed 8 hours ago [-]
yea the beginning is pretty gory / horrific. it almost made me stop reading but you can't deny the world building is.. unique
EarlKing 8 hours ago [-]
Yeah, there's no question this one's over-the-top when it comes to trying to gross out the reader, but I'd like to think people can overlook that.
KiwiJohnno 5 hours ago [-]
Not just the first AGI, but the book deals with a (very) hard-takeoff scenario of the singularity. The AI, Prime Intellect starts recursively increasing its capabilities and things rapidly spin out of control. This is actually a small part of the book, most of the book is about what happens after this - Its a fantastic read, yes as other posters have said there is some extremely graphic sex and violence in this book, but it is not gratuitous. I highly reccommend.
10 hours ago [-]
embedding-shape 10 hours ago [-]
LLM-generated code that seemingly went without much review or design is always such an interesting dive into just how bloated you can make code. In this repository, multiple files are close to 10K LOC, one file contains a switch statement that has so many case statements it spans more than 1000 lines, and lots of other fun stuff.
I guess it depends on the model you're trying to use, but seems most of them prefer smaller codebases, they work a lot better with less code, which kind of makes sense. With that in mind, I'd probably aim for something way smaller to bootstrap a self-improving agent. Then I'd use this "Prime Agent" as an example to my self-improving agent for what it should not evolve to.
c-hendricks 8 hours ago [-]
> one file contains a switch statement that has so many case statements it spans more than 1000 lines
Probably best to leave YandereDev's code out of the training data.
easier to add and customize stuff when you start from a small base
think of it as your starter dough
nullbio 2 hours ago [-]
How on Earth do we solve this bloat and death-by-a-thousand-cuts issue with frontier LLMs? Are there any actual solutions or attempts at solutions to this problem that I can try? Any tools or frameworks? I've tried re-architecture skills, dedicated cleanup sessions, and a bunch of other stuff, but nothing really works well.
impulser_ 29 minutes ago [-]
Don't have it write the whole thing in one session.
Literally says who. Swe are the least credible "engineers". "It depends" "No you cant track us" "No we have no credentials system other than big company shill certs"
digidecode 6 hours ago [-]
[dead]
trenchgun 3 hours ago [-]
Interesting, so they shipped slop? Succumbed to their own AI psychosis?
andai 9 hours ago [-]
A write up on RLM (Recursive Language Models) by one of the authors of the RLM paper:
I built one of these RLM harnesses and a local MCP server along with logging, memories, and project rules based on directories. It worked great for a while but the foundational models have largely caught up to the point where they don't need this harness anymore. At least for my use cases. I can basically just store context in .md in the directories we work out of together and accomplish what I need.
hypercube33 8 hours ago [-]
I went the skills route - skill improvement skill and a rule to use it always. Basically it's directed that if anything causes more than a hop of thinking - failure - try something else it should flag that it needs to learn it as a skill so it never does it other than first shot again or if an existing skill fails improve it after it solves whatever problem. it then syncs the files to a shared location and updates the version and also pulls new skills. this let's a team use it or you have multiple workstations.
oofbey 8 hours ago [-]
The core idea of the RLM paper is to make a regular LLM act more like a coding agent - offload context to something external that needs to be explicitly queried instead of filling up valuable context. The "recursion" part of the paper really only wins because they use a top-tier model for the root agent, and cheaper models for the sub-agents.
Prime Agent took the RLM idea (which is really just an academic view on how coding agents have always worked) and then added this "continual harness" idea. This part isn't super well described in the blog post, but includes some message passing between the agents, and the ability to share code.
Overall I chalk it up as neat, but not revolutionary. Another version of what most of these systems are already doing.
sexyketchup777 3 hours ago [-]
As models get stronger, huge harnesses may become less useful. An overly opinionated harness could even constrain the model’s reasoning instead of improving it.
ViscountPenguin 2 hours ago [-]
I'd assume the best harness for a model will tend to be the one that it's RLVF'd on.
Is it that it wasn't accepted yet, or are there issues with how it was run?
noahbp 10 hours ago [-]
It’s a self-improving harness, and ARC-AGI-3 is explicitly a few-shot benchmark. It’s likely that it gave itself more than the maximum number of tries to learn the games, or even hardcoded the answers.
There’s a lot of improvement to be had from the benchmark harnesses, but sometimes, like with ARC-AGI-3, the limitations are intentional.
zuzululu 2 hours ago [-]
this seems like its going to rip through tokens like crazy
self improvement is not a new idea but at current economics its not feasible
Curious if anyone's tried using RL for harness engineering? I think we're still pretty far away from the optimal harness, especially when it comes to long-context memory management.
I was wrong.
It does include some brutal sadomasochism with graphic torture, that's true, and that's why it isn't better known. If that part bothers you, which is fair, I would skim past it. The story overall is quite worth it
It's frustrating because apart from those (awful) aspects the story is quite thoughtful and compelling. I always recommend people skip the final chapter since the resulting existential cliffhanger is far better than the bizarre last-minute swerve into gratuitous sex abuse.
If you imagine it being written for alt.sex.stories.moderated but somehow failing to be erotic by virtue of being too explicit, and being a few orders of magnitude better writing for that venue... then you wouldn't be too far off. [Started making a silly example of how some sex story could fail like that and then realized I was litterally describing a scene from prime intellect].
It's also arguably the origin of a lot of the mentally ill ai-safety hysteria. Arguably an enjoyable romp for those who understand that it's fiction, but it seems a lot of people cannot.
That said, the stuff that deals with AI and its implications on the universe was great and more relevant than ever. The way PI works is pretty similar to how we use subagents to tackle large repos!
I guess it depends on the model you're trying to use, but seems most of them prefer smaller codebases, they work a lot better with less code, which kind of makes sense. With that in mind, I'd probably aim for something way smaller to bootstrap a self-improving agent. Then I'd use this "Prime Agent" as an example to my self-improving agent for what it should not evolve to.
Probably best to leave YandereDev's code out of the training data.
easier to add and customize stuff when you start from a small base
think of it as your starter dough
https://minimal-agent.com/
https://alexzhang13.github.io/blog/2025/rlm/
Prime Agent took the RLM idea (which is really just an academic view on how coding agents have always worked) and then added this "continual harness" idea. This part isn't super well described in the blog post, but includes some message passing between the agents, and the ability to share code.
Overall I chalk it up as neat, but not revolutionary. Another version of what most of these systems are already doing.
I am curious - how does it fare for other benchmarks, or everyday programming?
Is it that it wasn't accepted yet, or are there issues with how it was run?
There’s a lot of improvement to be had from the benchmark harnesses, but sometimes, like with ARC-AGI-3, the limitations are intentional.
self improvement is not a new idea but at current economics its not feasible