BUG: falls out of spec mode against user intent

In spec mode, the agent asks a question:

```
Yes, allow
Yes, and always allow low impact commands (file edits and read-only commands)
No, cancel
```

If I select `Yes, and always allow` the mode is changed from spec to normal, the model changes etc. This is unwanted behavior!