OnnxRuntimeGenAIChatClient how to use Tools?

[williamlzw]

OnnxRuntimeGenAIChatClient how to use Tools?


using var client = new OnnxRuntimeGenAIChatClient(model, options:config);
var completion = client.GetStreamingResponseAsync(chatHistory, new()
{
    MaxOutputTokens = 4096,
    AdditionalProperties = new() { { "max_length", 2048 } },
    Tools =???
});

[baijumeswani]

At the moment, the OnnxRuntimeGenAIChatClient does not support tools. Will discuss internally if this is feasible. I'll move this issue to discussion for now.

[williamlzw]

modelcontextprotocol/csharp-sdk#202 (comment)
This is the effect I can achieve at present. I don't know if there is a more stable systemprompt template.

[williamlzw]

https://github.com/williamlzw/MCPSharpDemo/tree/main

[haleemzahid]

Is there any ETA on the tool calls? @baijumeswani

[kunal-vaishnavi]

All examples have been updated in this PR. Please see the READMEs in each example for more information on tool calling.