Is there a way to use matlab to automate the download files from a web site

1 view (last 30 days)
I want to copy files from a geographic database hosed on a website. I don't want to read the web page-just make a list of the files on the page and download them to my local machine 1 by 1 . I don't believe websave or webread is the appropriate tool.
  6 Comments
Stephen Forczyk
Stephen Forczyk on 15 Mar 2022
I typically download lots of files from AWS and NOAA websites. I can do this with Python but have failed when I tried this with webread. I have studied up on the use of webread and might still get it to work. FTP does not appear to be possible with the AWS S3 bucket but there exists a companion Gov't website that I can FTP the data. Unfortunately they do enforce daily limits whic is lower than I want by about a factor of 50
Jan
Jan on 16 Mar 2022
@Stephen Forczyk: Do you want to post how you have tried it with websave? Maybe you get a useful suggestion from the forum.
Did you contact the FTP-admin already? The limits are set to prevent millions of users to access all data. If you have a scientific interest, the admins usually give you a higher volume.

Sign in to comment.

Answers (0)

Categories

Find more on Downloads in Help Center and File Exchange

Products


Release

R2019b

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!