Outer product of tall arrays

1 次查看（过去 30 天）

Z 2022-9-24

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1811470-outer-product-of-tall-arrays

编辑： Z 2022-9-25

I have two column vectors x and y which I cast as tall arrays. I want to take their outer product x*y', however I cannot transpose a tall array. What other way is there to perform the computation x*y'?

10 个评论
显示 8更早的评论隐藏 8更早的评论

John D'Errico 2022-9-24

编辑：John D'Errico 2022-9-25

NO. You did not listen to me. Think about what you are asking to do. If your arrays really are so tiny, then just convert them to regular, boring vectors. Then compute the outer product. Of course then, why in the name of god and little green apples are you using tall arrays in the first place if they are small?

But just suppose that your vectors REALLY do need to be tall arrays, as they are too large to store in memory. That is why you would use a tall array. For example, perhaps x and y are each 1e9 elements long.

Then the trivially simple rank 1 array the outer product would generate has 1e9*1e9=1e18 elements, each of which uses 8 bytes of RAM to store. Do you have that much disk storage available, so around 8e18 bytes, or roughly 8e9 GIGABYTES? That would be 8e6 terabytes. Or 8e3 petabytes. Or roughly 8 exabytes.

Do you, honestly, seriously have an 8 exabyte drive? Probably more than that of course, as things are never quite that easy. I suppose, if you work for the NSA, and you have full access to some seriously massive computers, you might have it. But then, if you do work there, you surely do not need me to explain this!

The computation you want to perform would have an immense result. You CANNOT DO IT, EVEN IF YOU COULD TAKE THE TRANSPOSE.

John D'Errico 2022-9-25

Suppose the column vectors are small enough, that you can trivially store them in memory.

So say that x and y are only 1e7 elements in length. Then x*y' would use only 8e14 bytes of memory to store.

This is still a huge array, 800 terabytes.

Z 2022-9-25

@John D'Errico I see. Thank you for your responses!

请先登录，再进行评论。

请先登录，再回答此问题。

回答（0 个）

请先登录，再回答此问题。

类别

MATLAB Data Import and Analysis Large Files and Big Data Tall Arrays

在 Help Center 和 File Exchange 中查找有关 Tall Arrays 的更多信息

产品

版本

R2022a

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by

Outer product of tall arrays

10 个评论
显示 8更早的评论隐藏 8更早的评论

回答（0 个）

另请参阅

类别

标签

产品

版本

Community Treasure Hunt

Outer product of tall arrays

10 个评论 显示 8更早的评论隐藏 8更早的评论

回答（0 个）

另请参阅

类别

标签

产品

版本

Community Treasure Hunt

10 个评论
显示 8更早的评论隐藏 8更早的评论