How to access itemprop = "name" from within a data structure in HTML code using Matlab?
显示 更早的评论
HTML code
<div class="itemName largestFont" itemprop="name"> Information which I want to extract </div>
<div class="itemCategory largeFont"><a href="/somerandomwebsitelink"> Information which I dont need </a></div>
I want to extract the information from itemprop = "name" only
using the selector feature with text analytics,
I can do "selector = "DIV.itemHeader"
Item Header is the class in which both those div elements lie and as a result both of the information within those divs is extracted.
I only want the information from itemprop = "name"
How do I go about doing that?
3 个评论
Walter Roberson
2019-3-26
Are you using the Text Analytics Toolbox? https://www.mathworks.com/help/textanalytics/ug/parse-html-and-extract-text-content.html
N/A
2019-3-26
Walter Roberson
2019-3-26
Unfortunately I do not have that toolbox to test with.
My own implementation would probably be to use regexp with named tokens and the 'names' option.
采纳的回答
I don't have the toolbox you mentioned, but it most likely uses xpath to parse the html...
I think the best options are xpath or regular expressions.
as far as I know to use xpath in matlab you have to use Java classes, but regular expressions are built in to matlab and they are very covenient.
The regex pattern could be something like that:
str = ['<div class="itemName largestFont" itemprop="name"> Information which I want to extract </div>'...
'<div class="itemCategory largeFont"><a href="/somerandomwebsitelink"> Information which I dont need </a></div>'];
match = regexp(str, '<div\s+(\w+="[^"]*"\s+)*itemprop="name"(\s+\w+="[^"]*")*\s*>(?<data>[^<]*)</div>', 'names')
match =
struct with fields:
data: ' Information which I want to extract '
11 个评论
N/A
2019-3-26
TADA
2019-3-27
anyway, I edited my answer with a regular expression solution to your problem
N/A
2019-3-28
TADA
2019-3-28
what do you get back from this line?
name = extractHTMLText(nameSection);
do you get the HTML you mentioned?
if so you can simply run the regexp line on this string:
function name = getTitle(tree)
selector = "DIV.itemHeader";
nameSection = findElement(tree, selector);
% i'm not sure because I don't have your original HTML nor that toolbox
% but I suspect that this line returns the HTML you mentioned
html = extractHTMLText(nameSection);
regexPattern = '<div\s+(\w+="[^"]*"\s+)*itemprop="name"(\s+\w+="[^"]*")*\s*>(?<data>[^<]*)</div>';
name = regexp(html, regexPattern, 'names');
end
TADA
2019-3-28
come to think of it, "DIV.itemHeader" is a css selector,
If you post the original HTML document you are mining data from it will help
this is a wild guess, but if I'm right you can try this instead:
selector = "DIV.itemHeader.itemName";
nameSection = findElement(tree, selector);
name = extractHTMLText(nameSection);
or this (although I'm not sure because itemprop is not a valid html attribute):
selector = "DIV.itemHeader[itemprop=""name""]";
nameSection = findElement(tree, selector);
name = extractHTMLText(nameSection);
N/A
2019-3-28
TADA
2019-3-28
this was a real long shot:
selector = "DIV.itemHeader[itemprop=""name""]";
the regex doesn't work because that extractHTMLText returns an array of strings of the text and not the HTML...
can you post you HTML document so I can at least try the css selectors?
also I made a mistake with the selector earlier,
try that instead:
% this css selector is now valid if I got the structure of your html right
% and if matlab handle's css selectors correctly
selector = "DIV.itemHeader .itemName";
or that: (probably won't work either)
selector = "DIV.itemHeader [itemprop=""name""]"
or maybe (not sure as the htmlTree is only available starting 2018b so I don't have it):
function name = getTitle(tree)
selector = "DIV.itemHeader";
nameSection = findElement(tree, selector);
html = nameSection.Content; % hopefully this will return the inner HTML
regexPattern = '<div\s+(\w+="[^"]*"\s+)*itemprop="name"(\s+\w+="[^"]*")*\s*>(?<data>[^<]*)</div>';
match = regexp(html, regexPattern, 'names');
name = match.data;
end
TADA
2019-3-28
OK,
so that element you want to find is the only one with the "itemName" css class
the simplest css selector for that one would be ".itemName"
this should work:
function name = getTitle(tree)
selector = ".itemName";
nameSection = findElement(tree, selector);
name = extractHTMLText(nameSection);
end
N/A
2019-3-28
TADA
2019-3-28
Cheers
更多回答（1 个）
Sean de Wolski
2019-3-28
编辑：Sean de Wolski
2019-3-28
Using htmlTree, this is trivial:
tree = htmlTree(fileread('yourfile.html'))
div = tree.findElement('div')
item = div.getAttribute("itemprop")
names = item == "name"
div(names).extractHTMLText
4 个评论
N/A
2019-3-28
TADA
2019-3-28
Neither me nor Walter Robertson (as far as I know) work for mathworks... I'd gladly take that raise though :)
Sean de Wolski
2019-3-29
@TADA, we're always hiring into MathWorks and have a distributor in Israel who may or may not be looking for MATLAB users.
@Shivam, this returns exactly what you want from your comment above:
s = string(webread("https://beta.trollandtoad.com/yugioh/invasion-of-chaos-ioc-unlimited-singles/manticore-of-darkness-ioc-067-ultra-rare-unlimited/1155511", weboptions('Timeout', 15)));
%%
tree = htmlTree(s)
%%
div = tree.findElement('div')
%%
item = div.getAttribute("itemprop")
%%
names = item == "name"
%%
div(names).extractHTMLText
ans =
"Manticore of Darkness - IOC-067 - Ultra Rare Unlimited"
类别
在 帮助中心 和 File Exchange 中查找有关 Language Support 的更多信息
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!
Translated by 
