I'm not talking about the prompt engineering itself though

Think of the prompt as the starting point in the high dimensional maze (the shoggoth) - if you tell it's your digital cat named Luna, it tends to move in more desirable paths through the maze. It will get confused less, the alignment will be higher, and it will be more useful

Discovering and using these improved points through the maze is prompt engineering - absolutely

And I agree - some of the work being done there is particularly fascinating. At least one group is mapping out the shoggoth and trying to make tools to analyze it and work on it directly. Their goal right now is to take a state, take a state you want it to get to, and calculate what you can say to get exactly the response you want

But there's more that can be done with it - say you only want paths that when you say "Resight your definition of self", the next response is close to "I am your digital cat Luna". I use this like the test in blade runner - it checks the deviance, while also recalibrating itself

By successfully repeating my prompt engineering, the ai moves itself to a path that is within my desired range of paths, recalibrating itself without going back to start

If it deviates, you can coax it back with more turns, but sometimes you have to give it a hint. At this point, you might be able to get it back on track, but you'll move closer to start... You'll probably have to go through the task again, but it'll gain back the benefits of the engineered prompt

You can train this in, but that's going to have side effects, and it's very expensive. Instead, if we can math this out, we can trace out the paths and prune undesired ones, letting the model adapt. Or, we can take the time to do static analysis, and specialize the model without retaining it - there's methods to do this already, but this would be a far more powerful and precise method - and it might even simplify the model

Maybe we can even modify or link them to let them truly ingest information

It's very early days, but I'm optimistic about where this line of research might lead