Reading hyperkinks from a website to crawl.

1 次查看（过去 30 天）
Juan Sanchez
Juan Sanchez 2020-8-5
编辑： Juan Sanchez 2020-8-5
I am designing a Data Scraper in Matlab that can extract all the HTML from a web page. My problem is that the website to load the pages uses a "Load More" button and shows 5 new items each time they press it. Since the Webread command is used in matlab, it only reads the HTML of the page directly, but I'm not sure how to tell the program to read the links that appear after "Load more".
I'm guessing the approach is to simulate the "load more" command and redo the scraping and extract unique urls, but im not completely sure.
Since I am not an expert I have no idea how to access all the links so I kindly ask for your help.

请先登录，再回答此问题。

回答（0 个）

类别

在 Help Center 和 File Exchange 中查找有关 Web Services 的更多信息

标签

产品


版本

R2019a

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by