-
Notifications
You must be signed in to change notification settings - Fork 185
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Control amount of memory usage #121
Comments
Funny that you just created this issue, because i noticed the same problem minutes ago. |
Same for me for my 16Gb developer machine, a simple Output of
Is there a way to avoid this? We want to evaluate ckan for a data catalog project. Thanks :) |
The hardware specs wiki page has been updated to be more realistic with current implementations of CKAN. Also, Are you @gacou54, @loleg and @Alexandero89 able to provide more detail on how many datasets/resources you have in your environments. Those numbers do look high. I have just installed a fresh 2.10.3 CKAN Docker environment with 1 dataset uploaded. I see the follow stats: |
That is kind of strange. I don't have any dataset, I simply cloned the project, copy-pasted While "upping", the
After the up (which takes several minutes), only the ckan seems to take 8Gb. Not sure if pertinent, but for the taken storage, this is what I get during the
|
I don't get those spikes at all. My host machine is a fairly elderly Apple Mac Mini with: I presume you have run a |
Also, I entered the
I started only the container
I will try that, I can do the prune. |
Yes, I use |
I still have the same issues regarding memory usage after the system prune. Maybe the issue should be raised in https://github.com/ckan/ckan-docker-base, since |
Sure, I'll create a new issue in the ckan-docker-base repo...in the meantime are you able to change the base image to 2.10.2 and 2.10.1 to see if that changes anything |
Thanks! Same issue with 2.9.9 and 2.10.1. In the meantime it is not so important on our side (we finally plan to use a humble s3 object storage (minio) for our project, we don't need most of the ckan features). I was trying to find/document the problem for the others :) |
The official hardware specs suggest a 4 GB RAM requirement. However, on my developer machine with 16 GB RAM, I'm experiencing a lot of swapping within minutes of starting up CKAN - without a large database. I suspect my OS as well (current Manjaro, based on Arch Linux) could also be at fault (I have looked into OOM to avoid the system freezing). Nevertheless, I am wondering if we could check the defaults and perhaps suggest a "leaner" installation for VM and dev sandboxes.
This could just be a section of a README with some parameters relevant to memory consumption.
Relevant issues on upstream:
The text was updated successfully, but these errors were encountered: