Benjamin Banavige & Karthik Garimella
- Data Recipes
- How to Install Docker
- How to Run Docker
- How to Use Jupyter Notebook and the Docker terminal.
This repository contains several GES DISC data recipes to demonstrate how to work with Earth Science Data. This repository contains everything a user needs to run a GES DISC Jupyter Notebook on your computer without having to install anything besides docker.
Note: Installing Docker on your machine will require Admin privileges
If you have a mac, there are two possible versions of docker you may need. The need for different versions of docker depend on whether your Mac has virtualization capibilities. In order to check whether your Mac has virtualization enabled, run the following in your terminal:
sysctl kern.hv_support
You should see a line of output that says kern.hv_support: followed by a 1 or a 0. Follow the following instructions based on your output from this command.
If you see this output, you have virtualization capibility, and you can run the current version of docker from the command line. To install, follow these steps:
-
Click this link to download docker: Docker Download
-
Once the download has finished, open the file.
-
Drag the Docker application to the Applications folder.
-
Navigate to the Applications folder and open docker. You may need to input an administrator's password to allow docker to run.
-
You should see a whale on your status bar with some boxes moving around. Once these boxes stop moving, docker is successfully installed and running. You can run docker from here.
If you have more questions about this process, refer to the following video tutorial: https://youtu.be/MuhyK1QFwfM
If this is the output you saw, you do not have virtualization capabilities, so you will need to download Docker Toolbox. To install, follow these steps:
-
Click this link to download Docker Toolbox for Mac: Download Docker Toolbox Mac
-
Once the download has finished, open the file and install the software. You will need adminstrator's privelege complete this step.
-
Once the installation is complete, you will have two new applications, Docker Quickstart Terminal and Kitematic.
-
Navigiate to the Applications folder and open the docker folder. Now, you can open the Docker Quickstart Terminal and run docker commands from here.
If you have more questions about this this process, refer to the following video tutorial: https://youtu.be/rKbNsT2kH7g
If you are using a Windows machine, we recommend that you install the Docker Toolbox Application. To install, follow these steps:
-
Click this link to download Docker Toolbox for Windows: Docker Toolbox Windows Download
-
Once the download has finished, open the file.
-
Once installation is complete, you will have two new applications, Docker Quickstart Terminal and Kitematic.
-
First, open the Kitematic application. After it is mostly loaded, click on "Use Virtual Box".
-
Once Kitematic is finished creating a Docker VM, it will ask you for your DockerHub credentials. You can create a free DockerHub account by going here. You can now search for Docker containers within Kitematic.
-
If you would like to use the Docker Quickstart Terminal instead (recommended), you must first open Kitematic (only once) so that it starts the Docker VM.
If you have more questions about this process, refer to the following video tutorial: https://www.youtube.com/watch?v=I_r44eGhN90&t=322s
Remember: if you have a Mac, to check for virtualization capability, run the following command in your terminal:
sysctl kern.hv_support
If you see an output of 1, your Mac supports virtualization. If you see an output of 0, your Mac does not support virtualization.
Right click on this link, click "Save Link As..." and save the file to your desktop as "startup_mac_virtualization.sh". Now, we have this .sh file saved to the Desktop.
Open your terminal, and use cd ("change directory") to navigate to your Desktop. You can use ls ("list") to check what is in your current directory. If you see Desktop in the ls output, you can type cd Desktop to navigate there. Once at your Desktop, you can again type ls and hit enter. You should see startup_mac_virtualization.sh in the list. Run the following command to allow this file to be executable:
chmod +x startup_mac_virtualization.sh
Now, we can run this file as an executable. To do this, type the following in your terminal:
./startup_mac_virtualization.sh
Assuming Docker has been installed correctly, this command will download the image of the docker container, startup a container and open Jupyter Notebook in your default web browser.
Right click on this link, click "Save Link As..." and save the file to your desktop as "startup_toolbox.sh". Now, we have this .sh file saved to the Desktop.
Open the Docker Quickstart Terminal, and use cd ("change directory") to navigate to your Desktop. You can use ls ("list") to check what is in your current directory. If you see Desktop in the ls output, you can type cd Desktop to navigate there. Once at your Desktop, you can again type ls and hit enter. You should see startup_toolbox.sh in the list. Run the following command to allow this file to be executable:
chmod +x startup_toolbox.sh
Now, we can run this file as an executable. To do this, type the following in your quickstart terminal:
./startup_toolbox.sh
Assuming Docker Toolbox has been installed correctly, this command will download the image of the docker container, startup a container and open Jupyter Notebook in your default web browser.
Remember, you have two options to run a docker container with Docker Toolbox for Windows. You can either use the Kitematic Application or you can use the Docker Quickstart Terminal (recommended).
Remember, if this is your first time opening Docker Quickstart Terminal, you must first run the Kitematic application to start the VM (then, you may close out of Kitematic). Afterwards, you will no longer need to run the Kitematic app.
Right click on this link, click "Save Link As..." and save the file to your desktop as "windows_startup.sh". Now, we have this .sh file saved to the Desktop.
Open the Docker Quickstart Terminal, and use cd ("change directory") to navigate to your Desktop. You can use ls ("list") to check what is in your current directory. If you see Desktop in the ls output, you can type cd Desktop to navigate there. Once at your Desktop, you can again type ls and hit enter. You should see windows_startup.sh in the list. Run the following command to allow this file to be executable:
chmod +x windows_startup.sh
Now, we can run this file as an executable. To do this, type the following in your quickstart terminal:
./windows_startup.sh
Assuming Docker Toolbox has been installed correctly, this command will download the image of the docker container, startup a container and open Jupyter Notebook in your default web browser.
- Launch the Kitematic app that comes with the installation of Docker Toolbox (you may have to login to your DockerHub account).
- From here, search for "karthenjamin/data_recipes" in the "Search for Docker images in Docker Hub" search bar.
- Once you have located this repository, simply click on "Create".
- This should start the container; click the expand button on the Web Preview
- This should open the Jupyter Notebook and prompt you for a password. Enter: benkarthik
- Back in the Kitematic application, click on the "EXEC" button above the container logs to start the terminal for this container.
This section assumes that you have followed the above steps and successfully gotten the Jupyter Notebook to open. For more info on this, see above. Using Jupyter Notebook is the same across platforms.
For more information on how to use the Jupyter Notebook environment, see this youtube tutorial.