Ollama chat with streaming mode using TextArea component

3 次查看（过去 30 天）

Iori Sumida 2025-4-30

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2176763-ollama-chat-with-streaming-mode-using-textarea-component

编辑： Walter Roberson 2025-4-30

I refered the follow URL to implement.

https://github.com/matlab-deep-learning/llms-with-matlab/blob/main/examples/ProcessGeneratedTextInRealTimeByUsingOllamaInStreamingMode.md

This example shows "Print stream to HTML UI Component". But I'd like to use TextArea component instead.

As the callback function of addChat

function addChat(app, content)
app.TextArea.Value = [app.TextArea.Value, content];
pause(0.1);
drawnow
end

To setup the ollama chat,

app.chat = ollamaChat("gemma3:12b", ...
    systemPrompt, ...
    Temperature=0.2, ...
    StreamFun=@(x) app.addChat(x), ...
    TimeOut=600);

Then, in order to generate text like following;

prompt = "Context:" + join(selectedDocs, " ") + newline + ...
    "Answer the following question: " + query;
app.history = addUserMessage(app.history, prompt);
[text, response] = generate(app.chat, app.history);
app.addChat(text);
app.history = addResponseMessage(app.history, response);