Extract email information from webpages/URLs using Matlab

Question

Gobert 2021-6-13

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/855095-extract-email-information-from-webpages-urls-using-matlab

评论： Gobert 2021-6-14

Hi,

I do need your help. When I run the code, K gives 143 empty cells. In other words, K does not contain any email. I tried this with other websites that show emails on some pages but in vain (K always gave empty cells). Therefore, can you please help to find what is wrong with or where I am screwing things up in the following code? I want to write a code that is capable of checking each L page of the main H website and extract emails according to the expression E.

H = webread("https://edition.cnn.com");
L = regexp(H,'https?://[^"]+','match')';
E ='[a-zA-Z0-9._%''+-]+@([a-zA-Z0-9._-])+\.([a-zA-Z]{2,4})';
K = regexpi(L,E,'match')';

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Image Analyst 2021-6-13

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/855095-extract-email-information-from-webpages-urls-using-matlab#answer_723850

编辑：Image Analyst 2021-6-13

在 MATLAB Online 中打开

Looks like L is a cell array of web sites, none of which is an email address with @ in it. So why do you think it should find an email there? Try searching H instead:

K = regexpi(H,E,'match')';

That will give you email addresses.

% Retrieve a web page.
%url = 'https://www.mathworks.com/matlabcentral/answers/?term=';
url = 'https://edition.cnn.com';
webPageContents = webread(url);
% Harvest web sites listed in the page.
listOfWebSites1 = regexp(webPageContents,'https?://[^"]+','match')';
listOfWebSites2 = regexp(webPageContents,'https?://[^"]+','match')';
% Throw out duplicates:
listOfWebSites = unique([listOfWebSites1;listOfWebSites2])
% Harvest email addresses listed in the page.
reForEMailAddresses ='[a-zA-Z0-9._%''+-]+@([a-zA-Z0-9._-])+\.([a-zA-Z]{2,4})';
listOfEMails = regexpi(webPageContents,reForEMailAddresses,'match')';
% Throw out duplicates:
listOfEMails = unique(listOfEMails)

5 个评论
显示 3更早的评论隐藏 3更早的评论

Image Analyst 2021-6-14

在 MATLAB Online 中打开

You could just go through each web site found on the main web site and scan each of those web sites for emails:

reForEMailAddresses ='[a-zA-Z0-9._%''+-]+@([a-zA-Z0-9._-])+\.([a-zA-Z]{2,4})';
for k = 1 : length(listOfWebSites)
    thisWebSite = listOfWebSites{k};
    webPageContents = webread(thisWebSite);
    % Harvest email addresses listed in the page.
    listOfEMails = regexpi(webPageContents, reForEMailAddresses, 'match')';
    % Throw out duplicates:
    listOfEMails = unique(listOfEMails)
end