Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Describe our resource limits properly #45

Closed
yuvipanda opened this issue Oct 8, 2020 · 1 comment
Closed

Describe our resource limits properly #45

yuvipanda opened this issue Oct 8, 2020 · 1 comment

Comments

@yuvipanda
Copy link
Member

Each hub restricts individual users to not use more than a specified amount of
compute resources. The primary resources we care about, in order of 'caring' are:

  1. Memory. This is inflexible - if you go over the amount of RAM available,
    your kernel dies. This is the most important resource to understand for our
    use cases - almost all educational hubs are memory bound, rather than CPU or
    storage bound.

  2. CPU. More flexible resource, since CPU availability is decided dynamically
    by the linux kernel. It can give a user 1full CPU for a minute, but only 0.01
    for the next 5 minutes, without any issues (other than a slowdown). This isn't
    possible with memory. We wanna make sure that users have as much CPU as they
    need, but it's not usually an issue - especially because cloud providers won't
    let you get a lot of memory without enough CPU.

  3. Storage. Home directory storage is persistent between users. Only code
    should be kept in home directories, ideally from git repositories. Many
    repos can be multiple hundreds of megs, and users can also accidentally write
    code that fills up the entire storage. We should ideally restrict users to
    something like a max of 10G. This doesn't require us to provision 10G for
    each user - we can easily overprovision this, since we would need a large
    number of users to exceed 10G at the same time to cause issues.

It's important for instructors to know these limits. Memory limit is a prime
driver in designing courses. These limits also define many other hosted
notebook providers - Colab's claim to fame is a free GPU, for example.

@choldgraf
Copy link
Member

Will document! this is a great writeup

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants