...
Prior to using the AWS CLI you will need to register with the AusSeabed Data Hub and follow the instructions below:
Complete the Contributing Data Partner Request form
Register for an account using the Data Submission Tool (https://www.datasubmission.ausseabed.gov.au/ )
Install the AWS Command Line Interface CLI - (https://aws.amazon.com/cli/)
If you are registered you will receive an AWS Access key and Secret Access key from the AusSeabed@ga.gov.au email account.
Step ID | Step Description | User Interface |
|---|---|---|
1 | Open Command Prompt or Powershell to initiate commands | |
2 | Type the following commands at the Prompt (C:\...) C:\WINDOWS\system32>aws configure | |
3 | You will be prompted for your Access Key ID, your secret Access key, a default region and a default output Note: to view your current configuration type: aws configure list |
 | |
4 | Type aws s3 ls (to display available S3 buckets) C:\WINDOWS\system32>aws s3 ls |
 | |
5 | If you want to look deeper type C:\WINDOWS\system32>aws s3 ls |
dataprovider-999999 |  | |
6 | Ensure each source survey is contained within an identifiable Folder | |
7 | Recursive copy commands can be found at | cp — AWS CLI 1.19.72 Command Reference (https://docs.aws.amazon.com/cli/latest/reference/s3/cp.html) |
8 | Using scripts or some python code to record and log the process is recommended. e.g create a batch file called SurveyNameCopy.bat and create copy statements like” | aws s3 cp z:\data "s3://dataprivider-999999" --recursive |
9 | Execute the batch file from a command line using the following syntax to ensure the process is logged. | >> SurveyNameCopy.bat > c:\temp\ SurveyNameCopyLog.txt 2>&1 |
10 | End |