how to find the similarity between two text documents

Question

Jothi 2012-12-19

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/56961-how-to-find-the-similarity-between-two-text-documents

评论： info info 2020-3-20

i have two text document.

For example, a.txt file contains ' Hai How R U'.

and b.txt file contains 'Hai How are U'.

How I can calculate the cosine similarity or Euclidean Distance for these two documents (text files).

thanks in advance.

2 个评论
显示无隐藏无

Jan 2012-12-19

The Euclidean Distance requires vektors of the same size. There are different Edit Distances, but I do not know the cosine distance. Perhaps it is better that you explain the details that that we search in WikiPedia.

info info 2020-3-20

i think the best way to give the similarity text is "shinling"

Shingling, a common technique of representing documents as sets. Given the document, its k-shingle is said to be all the possible consecutive substring of length k found within it. An example with k = 3 is given below :

## $Original

## [1] "The sky is blue and the sun is bright."

##

## $Shingled

## [1] "the sky is" "sky is blue" "is blue and" "blue and the"

## [5] "and the sun" "the sun is" "sun is bright"

then we virify if find in our textes

## doc_1 doc_2 doc_3

## the sky is 1 1 1

## sky is blue 1 0 1

## is blue and 1 0 0

## blue and the 1 0 0