"webread" does not work for Yahoo Option Chains page

Question

Cengiz Esmersoy 2024-8-4，21:41

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2142831-webread-does-not-work-for-yahoo-option-chains-page

回答： Kanishk 2024-8-13，10:44

在 MATLAB Online 中打开

Going to any Yahoo Option Chain page, copy and paste the URL to webread returns an error. For example:

webread('https://finance.yahoo.com/quote/AAPL/options/')

returns

The server returned the status 404 with message "Not Found"

It works for stock prices, but not for option chains. Is this a Yahoo protection issue or a limitation of webread?

3 个评论
显示 1更早的评论隐藏 1更早的评论

Cengiz Esmersoy 2024-8-5，20:43

编辑：Cengiz Esmersoy 2024-8-5，20:44

Yes, it works for stocks, but not for options. This makes me think there may be an access block by Yahoo, but this would typically be status 401.

And, I understand from blog traffic Pyton can access it, although I have not tried myself.

Walter Roberson 2024-8-6，3:02

Access blocks would typically be error 403, Access Prohibitted.

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Kanishk 2024-8-13，10:44

1
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2142831-webread-does-not-work-for-yahoo-option-chains-page#answer_1498409

在 MATLAB Online 中打开

Hi Cengiz,

It seems that when trying to use ‘webread’ to access the Yahoo Finance options page ‘404 Not Found’ error is encountered.

The issue appears to be related to the "User-Agent" field in the HTTP request. Some servers, including Yahoo Finance, selectively block requests from certain clients if the "User-Agent" field is not set or is set to an unrecognized value.

Although the field is not mandatory in HTTP requests, to resolve this issue, you can specify the "User-Agent" in the ‘webread’ request to mimic a web browser using ‘weboptions’.

Please follow the below code snippet to resolve the error:

url = 'https://finance.yahoo.com/quote/AAPL/options';
% Set the web options with a User-Agent to mimic a web browser 
options = weboptions('UserAgent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.3'); 
try 
    data = webread(url, options); 
    % Save retrieved page in HTML file 
    fid = fopen('AAPLOptions.html','w'); 
    fprintf(fid, '%s\n',data); 
    fclose(fid); 
catch err 
    disp(['Error: ', err.message]); 
end 