清空筛选条件
清空筛选条件

fileDatastore request to AWS S3 limited to 1000 files

4 次查看（过去 30 天）
MaKe
MaKe 2020-1-29
评论： Jhon Wine 2021-4-22
I have a bucket on an AWS S3 server which I can reach without any problems.
The issue is: The answer from the server is limited to 1000 files. How can I increase this number? My target is to get just the list of filenames.
I also tried different calls of fileDatastore.
imds = fileDatastore(['s3://',<bucket>,','/'],'FileExtensions','.csv','ReadFcn',@load,'IncludeSubfolders',true)
  4 个评论
显示 2更早的评论
Sameer Gummuluru
Sameer Gummuluru 2020-12-1
I was able to figure out a temporary solution to this, today. On older versions of MATLAB, I was able to use filedatastore to access more than 1000 files from S3. (I tried on MATLAB R2019a)
You can give it a try if working on older MATLAB versions is fine by you.
Jhon Wine
Jhon Wine 2021-4-18
I have the same issue. When using Matlab R2020b I cannot get more than 1,000 files.
However while using Matlab R2019b, fileDataStore seems to return all the files I need.
Using AWS CLI seems to work fine, but is not as elegent of a solution.

请先登录，再进行评论。

请先登录，再回答此问题。

回答（1 个）

Div Tiwari
Div Tiwari 2021-4-19
Hi all, this issue was resolved in MATLAB R2021a and R2020b Update 5: https://www.mathworks.com/support/bugreports/details/2407120.
If you're using R2020b, you can install updates by clicking on the notification icon towards the top-right of the MATLAB window.
  1 个评论
Jhon Wine
Jhon Wine 2021-4-22
I just installed R2021a, problem persists.
In fact I have two versions of Matlab on the same computer. 2019a shows 2000 files, 2021a shows 1000 files...

请先登录，再进行评论。

类别

在 Help Center 和 File Exchange 中查找有关 Introduction to Installation and Licensing 的更多信息

标签

产品


版本

R2019b

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by