using <think> as a way to pass the internal process to the users client.

[DunaSpice]

I think it would be more interactive and informational to see the requests that are send to and from the proxy as thinking of the model in traditional llms.

[codelion]

I think this is a good idea, the internal state may actually help generate data that can be used for training eventually.