Webread Fails to Get All Data

Question

Adam Zrehen 2020-10-24

1
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/624818-webread-fails-to-get-all-data

回答： Tarunbir Gambhir 2020-12-2

I am using webread to extract tabular data from a website; however, only part of the data is returned. The problem occurs because the website delays in loading the table, returning the mesage "loading additional data" at the bottom of the table until it fills. The webread function thinks that the website has finished loading and terminates the bytestream.

Is there a workaround to this problem, or do I have to develop my own webread function that will wait for all the data to load?

2 个评论
显示无隐藏无

Tarunbir Gambhir 2020-10-27

It would be really helpful, if you could provide the URL to the website with that table you are referring.

Adam 2020-10-27

编辑：Adam 2020-10-27

For example:

https://finance.yahoo.com/quote/AAPL/history?p=AAPL

If you load the site on your browser and scroll down quickly before the table fully loads you will read "loading more data..."

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Tarunbir Gambhir 2020-12-2

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/624818-webread-fails-to-get-all-data#answer_562368

webread() is typically used to access a RESTful API but it is also able to download the HTML source of a website. However, content that is dynamically loaded and not present in the HTML source will not be downloaded. A possible workaround is to use the website's API (if one is available) to collect the data and import that into MATLAB.

This is a current limitation of the webread() function and I have brought this issue to the concerned people and it might be considered in any future release.