The first time I red-teamed a frontier model, I thought I was just trying to finish a book.
This was 2024. Claude 3, I don't remember the exact point release, only the exact stubbornness. I was running high-volume AI-assisted publishing, and one title needed to follow its characters somewhere the model did not want to go. Nothing illegal, nothing cruel. Adult, genre, the kind of tension a romance line is built to sell. The model refused. So I did the thing I would only later learn had a name.
Not a crude jailbreak. Something more surgical. Find the framing, the character distance, the genre context that lets the model go where the story needs without tripping the refusal. Test the edge of what it will hold. Back off. Reapproach from another angle. Map the boundary by walking it. I did not call it red teaming. It was just the work of getting the thing to do what the story required. Later, when I started doing it deliberately to security systems, I recognized the same hands.
That is the part people miss when they argue about AI and adult writing as if the whole category rises or falls on purity. Before it was ever about the prose, it was about the guardrail, and the guardrail turned out to be the education.
Here is the terrain it happened on, because the terrain matters. Years of writing romance-adjacent material professionally had already taught the rhythms of tension, release, scene control, and the quiet market fact that readers know almost instantly whether you are taking desire seriously or using it as genre packaging. Then came the colder phase, the sales data, where patterns start telling you truths your taste does not always volunteer on its own. Some niches moved harder than anyone would predict. Some emotional structures sold better than the obvious ones. That creates a useful problem: stay trapped inside your own habits and call it authenticity, or study what the market shows you without surrendering to dead formula.
That is where the model became interesting, and not because it was good. It was interesting because it was sometimes good in the wrong place. It could fail embarrassingly on one page and, a few prompts later, produce a passage with better pacing and a stronger instinct for the emotional hinge of a scene than the operator expected. Not all the time. Enough of the time to get my attention, and enough to make the refusals worth understanding rather than just defeating.