Create package that:
- download items from buckets to your local repo (think analysis)
- add functionality to upload from dropbox (not the website but local version) into a bucket (ie bulk loads)
For part 1
Base
-list_files() that lists all files in the bucket
- regex to narrow down (year, group, date, type, etc)
- recursive
path_to_file() function that you pass the list of file too
Wrappers
- create easy fun wrapper functions for the script level like
get_tracks() which will use the base functions but in a more readable way
Ask vs overwriting
- have a question to check overwriting etc before proceeding
- have an ask parameter that you have give T/F response to ignore overwriting questions/warning
Will need to give it an already created working directory and it will paste the whole bucket (or narrowed) to the folder provided.
No special AWS users required (unless we make a single company wide shared credentials that only have read access) - otherwise users can use their more general acct for this task
Create package that:
For part 1
Base
-
list_files()that lists all files in the bucketpath_to_file()function that you pass the list of file tooWrappers
get_tracks()which will use the base functions but in a more readable wayAsk vs overwriting
Will need to give it an already created working directory and it will paste the whole bucket (or narrowed) to the folder provided.
No special AWS users required (unless we make a single company wide shared credentials that only have read access) - otherwise users can use their more general acct for this task