How to scrape values from a dynamically loaded web page?

Question

0 个投票

The issue was addressed by finding the API webpage of the main website. Then, I requsted an API-Key via an online form. They provided me an API key for accessing some basic data. However, more data needed a paid membership.

2 个评论
显示无隐藏无

Vinod 2020-10-9

编辑：Vinod 2020-10-9

Rather than scrape the dynamic page, do they have an API you can use? I looked it up and it appears barchart.com has an API.

Mehran Rahmani 2020-10-10

Thanks Vinod for your helpful hint. I submitted a form on their webpage requesting access to their API. I assume they will send me an API Key, correct? I am currently awaiting their response and will comment when I tried their Key to fetch the data.

请先登录，再进行评论。

请先登录，再回答此问题。

Follow Question

Answer 1

Ameer Hamza 2020-10-9

0 个投票

Text Analytics toolbox provides an html parser: https://www.mathworks.com/help/textanalytics/ug/parse-html-and-extract-text-content.html. However, if you don't have a toolbox, then you may need to use regexp or textscan().

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

Mehran Rahmani 2020-10-10

Thanks for your response. Similar to "urlfiler()" and "webread()", the textscan() does not read the numeric values dynamically loaded to the page. As Vinod noted above, the values should be fetched through the webpage API. I am yet to to try it.

请先登录，再进行评论。

How to scrape values from a dynamically loaded web page?

2 个评论
显示无隐藏无

回答（1 个）

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

社区

类别

产品

版本

标签

Community Treasure Hunt

How to scrape values from a dynamically loaded web page?

2 个评论 显示 无 隐藏 无

回答（1 个）

1 个评论 显示 -1更早的评论 隐藏 -1更早的评论

社区

类别

产品

版本

标签

另请参阅

Community Treasure Hunt

2 个评论
显示无隐藏无

1 个评论
显示 -1更早的评论隐藏 -1更早的评论