Truncated answers when querying chatgpt with Matlab

1 次查看（过去 30 天）
012786534
012786534 2023-3-24
回答： Hans Scharler 2023-9-16
Some users (like here for example: https://www.mathworks.com/matlabcentral/answers/1894530-connecting-to-chatgpt-using-api ) have pointed out that we can ask chatgpt to write Matlab code.
I was curious and I have been playing with the code below a bit but I seem to get truncated annswers
import matlab.net.*
import matlab.net.http.*
% Define the API endpoint Davinci
api_endpoint = "https://api.openai.com/v1/engines/text-davinci-003/completions";
% Define the API key from https://beta.openai.com/account/api-keys
api_key = "your_api_key";
prompt = "Matlab code to replace string in multiple text files";
parameters = struct('prompt', prompt, 'max_tokens', 100);
% Define the headers for the API request
headers = matlab.net.http.HeaderField('Content-Type', 'application/json');
headers(2) = matlab.net.http.HeaderField('Authorization', ['Bearer ' + api_key]);
% Define the request message
request = matlab.net.http.RequestMessage('post', headers, parameters);
% Send the request and store the response
response = send(request, URI(api_endpoint));
% Extract the response text
response_text = response.Body.Data;
response_text = response_text.choices(1).text;
disp(response_text)
Its not immediately clear if the problem lies with the code above or with chatgpt. Has anyone experienced truncated answers from chatgpt ?

请先登录，再回答此问题。

回答（2 个）

Hans Scharler
Hans Scharler 2023-9-16
The "max_tokens" parameter limits the response from OpenAI language models.
Try increasing it to 1000.
parameters = struct('prompt', prompt, 'max_tokens', 1000);
the cyclist
the cyclist 2023-3-24
My impression from searching the same topic is that there is an unpublished token limit (which will roughly translate to a character limit) for both input and output to ChatGPT. (This is not MATLAB specific.)
  2 个评论
012786534
012786534 2023-3-24
Perhaps but I have read that chatgpt has a character limit of 2048 characters per response, which is far more than I get when querying with Matlab. In the example above, I get a complete answer when I ask the same question directly on Introducing ChatGPT (openai.com).
the cyclist
the cyclist 2023-3-24
Looking at your code a bit more closely ...
Did you realize that this line
parameters = struct('prompt', prompt, 'max_tokens', 100);
is setting the maximum token value that your code is asking for? Set that higher.

请先登录，再进行评论。

类别

在 Help Center 和 File Exchange 中查找有关 Call Web Services from MATLAB Using HTTP 的更多信息

标签

产品


版本

R2022b

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by