How to use Matlab to download data from an AWS S3 bucket

20 次查看（过去 30 天）
Stephen Forczyk
Stephen Forczyk 2021-8-6
评论： Yongjian Feng 2021-8-11
I have been using python scripts to download from a public Amzon S3 bucket to my local computer. I would like to create a Matlab script to do the same. So far my Matlab scripts do not work. The key steps in the python scripts are easy (see below)
import s3fs
import os
import numpy as np
fs = s3fs.S3FileSystem(anon=True)
fs.ls('s3://noaa-goes16/')
sourcestub='noaa-goes16/ABI-L2-CPSF/2020/238/' (gets a list of particular files in a folder)
files = np.array(fs.ls(sourcestr)) (skipped some steps but these are the essentials
Basically the python script goes to the bucket and logs on to the public account with no need for a password. Retrieves the files using a loop one file at a time.
How can I replicate this functionality in Matlab. The data in the AWS help provided by Mathworks talks mostly about uploading data to a personal S3 bucket (not FREE!) on AWS. The python script does not require me to pay any fees as it is a public account apparently owned by the US Govt

请先登录，再回答此问题。

采纳的回答

Yongjian Feng
Yongjian Feng 2021-8-11
Try this?
https://www.mathworks.com/help/cloudcenter/ug/transfer-data-to-amazon-s3-buckets.html
  2 个评论
Stephen Forczyk
Stephen Forczyk 2021-8-11
The data I am trying to download is public access I don't have an AWS account to download from python. So after reading the web page I don't see how I can complete entries such as
set AWS_ACCESS_KEY_ID="YOUR_AWS_ACCESS_KEY_ID"
set AWS_SECRET_ACCESS_KEY="YOUR_AWS_SECRET_ACCESS_KEY"
set AWS_DEFAULT_REGION="us-east-1"
Can the first two items be set to blank?
Yongjian Feng
Yongjian Feng 2021-8-11
Maybe you need to set the first two env vars to be blank. Please give it a try.

请先登录，再进行评论。

更多回答（0 个）

类别

在 Help Center 和 File Exchange 中查找有关 Downloads 的更多信息

标签

产品


版本

R2020a

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by