Can we use k-means clustering on a 100×34596 matrix?

Question

bamini thavarajah 2017-11-9

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/366087-can-we-use-k-means-clustering-on-a-100x34596-matrix

评论： Image Analyst 2017-12-5

I have a feature matrix with size 100×34596, with class labels.
This matrix is very large because I want to cluster these matrix.
Is it possible?
I don't have experience about k-means.
Could you help me?*

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Walter Roberson 2017-11-9

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/366087-can-we-use-k-means-clustering-on-a-100x34596-matrix#answer_290244

Yes. See https://www.mathworks.com/help/stats/kmeans.html

Just make sure to pass data to kmeans such that the rows correspond to observations (points).

The class table will not be of any use for kmeans clustering: kmeans is a method of trying to figure out which values belong together without knowledge of the class labels.

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

Image Analyst 2017-12-5

Hopefully you have 34,596 observations and 100 features (which still seems ridiculously high) and not 100 observations of 34,596 features (which I don't see as possible in most normal/typical scenarios).

Anyway, if you have some of them labeled already, then you can use knnsearch() to label/classify any other, non-labeled data.

kmeans will come up with its own labels, so if they're all labeled already, then all you can do is pass in the feature values, without the labels as Walter said, and see how what kmeans chose differs from whatever method you have that produced the labels in advance (like human judging or whatever). You can then create a confusion matrix or ROC curve.

请先登录，再进行评论。