Josh Bolding PRO
AI & ML interests
Recent Activity
Organizations
Awesome model, Thanks! <3
Instruction following breaking
No, it’s not a restoration. Abliteration never touched output.weight, so the row was already identical to stock. The edit is a new delta fit on the abliterated model’s own states.
I checked the entanglement idea on stock. At the refusal direction’s own layer, the reading drops in the last few thinking tokens before (benign 6.6 to 4.7, harmful-but-answered 21 to 13) and jumps back up once the answer starts. At the final layer, the stop shift is close to orthogonal to the refusal direction, about what you’d get from a random direction, and so is the readout. Also, if you hand the abliterated model stock’s finished thinking, it closes where stock does. It just doesn’t get there by itself. So I don’t see a shared linear direction. It could still be entangled somewhere non-linear, and I can’t rule that out.
Failed to parse Jinja template
Unpatched Version Request
Read your SRP post. That’s a system prompt, so it’s a different layer from what I’m doing. The row fix on absolute-heresy uses no prompt at all. Quality went from .57 to .99 with 0 refusals, and everyday prompts went from 127 no answers to 3. Same weights, one row changed. Anyone who wants SRP can still stack it on top.