Thingspeak now unable to parse website

52 次查看（过去 30 天）
Mark Quinn
Mark Quinn 2024-10-31，20:34
评论： Mark Quinn 2024-11-1，17:26
I have a ThingHTTP request that parses my local council website and extracts the bins which are collected each week. I then display this on an arduino with colour LEDs.
This worked fine for years but now for some reason the Thingspeak request cannot parse the website any more???
The conucil website is:
https://www.salford.gov.uk/bins-and-recycling/bin-collection-days/your-bin-collections/?UPRN=100012691624
This isn't my address but a random house nearby ;)
I've copied the XPath for the string about this week (//*[@id="standard-page"]/div/div/div[2]/p[1]/text()[2])
Then used the GET request on thingspeak - This used to work fine.
Now it gives me :
Error parsing document, try a different parse string.
Any ideas?
  2 个评论
Steven Lord
Steven Lord 2024-11-1，14:40
You have confirmed that the layout of the page hasn't changed, and that the council hasn't changed who/what is allowed to access the website (choosing to use a robots.txt to block the scraping mechanism that ThingSpeak uses to read the data, for example?)
Mark Quinn
Mark Quinn 2024-11-1，15:05
The layout hasn't changed. I checked the XPath and I'm sure that's correct.
I don't know how to check if the website has a scraper blocker though - how would I go about checking for that?

请先登录，再进行评论。

请先登录，再回答此问题。

回答（1 个）

Vinod
Vinod 2024-11-1，13:37
I can't access the URL from the public internet in the US. I believe this to be the reason the ThingSpeak servers can't get to the page and parse the content. I also tried to use Opera browser's VPN to see if this page is accessible in other locations, and it is not accessible.
Have there been changes to the page's availability outside the UK?
  3 个评论
显示 1更早的评论
Vinod
Vinod 2024-11-1，16:42
The one thought I had was to see if we could run it through Google Translate. However, it appears even Google Translate cannot get to the site. See:
https://translate.google.com/translate?sl=es&tl=en&hl=en&u=https://www.salford.gov.uk/bins-and-recycling/bin-collection-days/your-bin-collections/?UPRN%3D100012691624&client=webapp
The alternative I can think of is to find a free online proxy server based in the UK that can allow the page to be accessed outside the UK.
Mark Quinn
Mark Quinn 2024-11-1，17:26
That's a clever approach- pity it didn't work 😞
I think I might have to look at using the Arduino to parse the website directly rather than using an API... I can't imagine this being fun 😅

请先登录，再进行评论。

社区

更多回答在  ThingSpeak Community

类别

在 Help Center 和 File Exchange 中查找有关 String Parsing 的更多信息

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by