Cloud computing data and analysis workflows

Last updated on 2025-05-08 | Edit this page

Estimated time: 47 minutes

Overview

Questions

  • What steps would a researcher go through to obtain public data and “put” it on a cloud computer?
  • What might a researcher do to work with their data that is on a cloud computer?
  • What might a researcher do to export their results from their cloud computer?

Objectives

  • Download open data from a public URL using {R code or wget/curl - TBD}
  • Use scp to transfer a set of files from a local computer to a remote computer
  • Clone a public github repository onto a remote computer
  • Run R code to analyze data, within a remote RStudio server session

Moving data around


TODO

#::::::::::::::::::::::::::::::::::::: challenge

Downloading data


If you wanted to download data sets for 1999-2025 from X open data site, what are your options for doing so?

#:::::::::::::::::::::::: solution

Solutions


  1. Manual download
  2. API

#:::::::::::::::::::::::::::::::::

TODO

Key Points

  • TODO