Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bring down memory usage when run as individual services #6819

Closed
wkloucek opened this issue Jul 17, 2023 · 4 comments
Closed

bring down memory usage when run as individual services #6819

wkloucek opened this issue Jul 17, 2023 · 4 comments
Labels
Category:Enhancement Add new functionality

Comments

@wkloucek
Copy link
Contributor

wkloucek commented Jul 17, 2023

Is your feature request related to a problem? Please describe.

When starting every service on it's own, like eg. in Kubernetes with the oCIS Helm Chart, RAM usage matters in scale.

If you start a Go program, it always needs at least as much memory as the size of the binary. For oCIS the binary size is currenlty 92MB. Therefore if you start a oCIS service, it will at least allocate 92MB. In comparision if compile the thumbnails service standalone, it's binary is only 35MB. Thus it needs 67MB less memory when run.

So the first step is to build and release a separate OCI image for all services: #6818

The next problem is that all REVA runtime based services import everything from REVA (https://github.com/cs3org/reva/blob/b38215dd8772079332e7e6ef6d91bf1d422bfed9/cmd/revad/runtime/loader.go#L21-L57). Therefore all REVA runtime based services produce a binary of 56MB. This applies to the code-wise big storage-users service as well as to the little users service. An exception of code that does come from REVA, but does not use the REVA runtime and therefore produces a smaller binary is the ocdav servcei, which has 35MB.

So the second step would be to stop using the REVA runtime and instead gomicro-fy the REVA services, as we already did with the ocdav service.

cc @d7oc

@wkloucek wkloucek added the Category:Enhancement Add new functionality label Jul 17, 2023
@wkloucek wkloucek changed the title bring down idle memory usage bring down idle memory usage when run as individual services Jul 17, 2023
@wkloucek wkloucek changed the title bring down idle memory usage when run as individual services bring down memory usage when run as individual services Jul 17, 2023
@wkloucek
Copy link
Contributor Author

This are the current binary sizes for single service binaries:
31M antivirus
31M audit
31M postprocessing
32M eventhistory
33M notifications
33M ocs
33M webfinger
34M idm
34M invitations
34M settings
34M userlog
34M webdav
35M ocdav
35M proxy
35M thumbnails
36M nats
37M graph
38M store
39M idp
39M policies
39M search
39M web
56M app-provider
56M app-registry
56M auth-basic
56M auth-bearer
56M auth-machine
56M frontend
56M gateway
56M groups
56M sharing
56M storage-publiclink
56M storage-shares
56M storage-system
56M storage-users
56M user

It totals to 1540MB of memory for the binaries alone. If starting these 36 services from the single binary with all oCIS services, this totals to 3312MB.

In the case of running every service twice for HA reasons, this boils down to 3080MB vs. 6624MB memory alone for the binaries.

@wkloucek
Copy link
Contributor Author

@rhafer I did not find hint that the binary is virtual memory only:

$ pmap -x 70861
70861:   ./ocis-3.1.0-next.4-linux-amd64 server
Address           Kbytes     RSS   Dirty Mode  Mapping
0000000000400000       4       4       0 r---- ocis-3.1.0-next.4-linux-amd64
0000000000401000   36840   31976       0 r-x-- ocis-3.1.0-next.4-linux-amd64
00000000027fb000   20064    7944       0 r---- ocis-3.1.0-next.4-linux-amd64
0000000003b93000   36260   26852     468 rw--- ocis-3.1.0-next.4-linux-amd64
0000000005efc000     444     296     296 rw---   [ anon ]
00000000078bb000       4       0       0 -----   [ anon ]
00000000078bc000       4       4       4 rw---   [ anon ]
000000c000000000    4096    4096    4096 rw---   [ anon ]
000000c000400000    4096    4096    4096 rw---   [ anon ]
000000c000800000   28672   28456   28456 rw---   [ anon ]
000000c002400000   16384   16208   16208 rw---   [ anon ]
000000c003400000   14336   14336   14336 rw---   [ anon ]
000000c004200000   18432    4608    4608 rw---   [ anon ]
000000c005400000   30720       0       0 rw---   [ anon ]
000000c007200000   24576     736     736 rw---   [ anon ]
000000c008a00000    4096       0       0 rw---   [ anon ]
000000c008e00000    2048       0       0 rw---   [ anon ]
000000c009000000    6144       0       0 rw---   [ anon ]
000000c009600000    2048       8       8 rw---   [ anon ]
000000c009800000    2048       0       0 rw---   [ anon ]
000000c009a00000    8192      84      84 rw---   [ anon ]
000000c00a200000    6144       0       0 rw---   [ anon ]
000000c00a800000    2048       0       0 rw---   [ anon ]
000000c00aa00000    6144       0       0 rw---   [ anon ]
000000c00b000000    6144     512     512 rw---   [ anon ]
000000c00b600000    2048       0       0 rw---   [ anon ]
000000c00b800000    8192       0       0 -----   [ anon ]
00007f9f4936d000       8       0       0 -----   [ anon ]
00007f9f4936f000     132       4       4 rw---   [ anon ]
00007f9f49390000       8       0       0 -----   [ anon ]
00007f9f49392000     132       4       4 rw---   [ anon ]
00007f9f493b3000       8       0       0 -----   [ anon ]
00007f9f493b5000     132       4       4 rw---   [ anon ]
00007f9f493d6000       8       0       0 -----   [ anon ]
00007f9f493d8000     580     452     452 rw---   [ anon ]
00007f9f49469000       8       0       0 -----   [ anon ]
00007f9f4946b000    4496    3484    3484 rw---   [ anon ]
00007f9f498cf000      64      32       0 r--s- ocis.boltdb
00007f9f498df000     256     252     252 rw---   [ anon ]
00007f9f4991f000       8       0       0 -----   [ anon ]
00007f9f49921000     132       4       4 rw---   [ anon ]
00007f9f49942000       8       0       0 -----   [ anon ]
00007f9f49944000     388     260     260 rw---   [ anon ]
00007f9f499a5000      64      32       0 r--s- root.bolt
00007f9f499b5000      64      48       0 r--s- root.bolt
00007f9f499c5000     256     244     244 rw---   [ anon ]
00007f9f49a05000       8       0       0 -----   [ anon ]
00007f9f49a07000     644     500     500 rw---   [ anon ]
00007f9f49aa8000       8       0       0 -----   [ anon ]
00007f9f49aaa000    3716    2876    2876 rw---   [ anon ]
00007f9f49e4b000       8       0       0 -----   [ anon ]
00007f9f49e4d000     132       4       4 rw---   [ anon ]
00007f9f49e6e000       8       0       0 -----   [ anon ]
00007f9f49e70000     388     260     260 rw---   [ anon ]
00007f9f49ed1000       8       0       0 -----   [ anon ]
00007f9f49ed3000     132       4       4 rw---   [ anon ]
00007f9f49ef4000       8       0       0 -----   [ anon ]
00007f9f49ef6000     132       4       4 rw---   [ anon ]
00007f9f49f17000       8       0       0 -----   [ anon ]
00007f9f49f19000     132       4       4 rw---   [ anon ]
00007f9f49f3a000       8       0       0 -----   [ anon ]
00007f9f49f3c000   35600    1256    1256 rw---   [ anon ]
00007f9f4c200000    2048       0       0 rw---   [ anon ]
00007f9f4c400000    1640       4       4 rw---   [ anon ]
00007f9f4c59a000  267748       0       0 -----   [ anon ]
00007f9f5cb13000       4       4       4 rw---   [ anon ]
00007f9f5cb14000  293564       0       0 -----   [ anon ]
00007f9f6e9c3000       4       4       4 rw---   [ anon ]
00007f9f6e9c4000   36692       0       0 -----   [ anon ]
00007f9f70d99000       4       4       4 rw---   [ anon ]
00007f9f70d9a000    4580       0       0 -----   [ anon ]
00007f9f71213000       4       4       4 rw---   [ anon ]
00007f9f71214000     508       0       0 -----   [ anon ]
00007f9f71293000     384      64      64 rw---   [ anon ]
00007ffc3eb9b000     132      16      16 rw---   [ stack ]
00007ffc3ebe2000      16       0       0 r----   [ anon ]
00007ffc3ebe6000       8       4       0 r-x--   [ anon ]
ffffffffff600000       4       0       0 --x--   [ anon ]
---------------- ------- ------- ------- 
total kB          945260  150048   83624

Though it looks like not the complete binary is in the RSS

When I only start the thumbnails service it looks slighly different:

$ pmap -x 73148
73148:   ./ocis-3.1.0-next.4-linux-amd64 thumbnails server
Address           Kbytes     RSS   Dirty Mode  Mapping
0000000000400000       4       4       0 r---- ocis-3.1.0-next.4-linux-amd64
0000000000401000   36840   30248       0 r-x-- ocis-3.1.0-next.4-linux-amd64
00000000027fb000   20064    7052       0 r---- ocis-3.1.0-next.4-linux-amd64
0000000003b93000   36260   20784     460 rw--- ocis-3.1.0-next.4-linux-amd64
0000000005efc000     444     256     256 rw---   [ anon ]
00000000071e6000       4       0       0 -----   [ anon ]
00000000071e7000       4       4       4 rw---   [ anon ]
000000c000000000    4096    4096    4096 rw---   [ anon ]
000000c000400000    4096    4072    4072 rw---   [ anon ]
000000c000800000   16384   15428   15428 rw---   [ anon ]
000000c001800000   40960       0       0 -----   [ anon ]
00007fd12df4d000       8       0       0 -----   [ anon ]
00007fd12df4f000     644     444     444 rw---   [ anon ]
00007fd12dff0000       8       0       0 -----   [ anon ]
00007fd12dff2000    3460    1736    1736 rw---   [ anon ]
00007fd12e353000       8       0       0 -----   [ anon ]
00007fd12e355000     132       4       4 rw---   [ anon ]
00007fd12e376000       8       0       0 -----   [ anon ]
00007fd12e378000     388     236     236 rw---   [ anon ]
00007fd12e3d9000       8       0       0 -----   [ anon ]
00007fd12e3db000     132       4       4 rw---   [ anon ]
00007fd12e3fd000       8       0       0 -----   [ anon ]
00007fd12e3ff000     388     256     256 rw---   [ anon ]
00007fd12e460000       8       0       0 -----   [ anon ]
00007fd12e462000     132       4       4 rw---   [ anon ]
00007fd12e483000       8       0       0 -----   [ anon ]
00007fd12e485000   36332     488     488 rw---   [ anon ]
00007fd130800000    2048       0       0 rw---   [ anon ]
00007fd130a00000     908       4       4 rw---   [ anon ]
00007fd130ae3000  267748       0       0 -----   [ anon ]
00007fd14105c000       4       4       4 rw---   [ anon ]
00007fd14105d000  293564       0       0 -----   [ anon ]
00007fd152f0c000       4       4       4 rw---   [ anon ]
00007fd152f0d000   36692       0       0 -----   [ anon ]
00007fd1552e2000       4       4       4 rw---   [ anon ]
00007fd1552e3000    4580       0       0 -----   [ anon ]
00007fd15575c000       4       4       4 rw---   [ anon ]
00007fd15575d000     508       0       0 -----   [ anon ]
00007fd1557dc000     384      60      60 rw---   [ anon ]
00007ffdf2d6a000     132      16      16 rw---   [ stack ]
00007ffdf2d8f000      16       0       0 r----   [ anon ]
00007ffdf2d93000       8       4       0 r-x--   [ anon ]
ffffffffff600000       4       0       0 --x--   [ anon ]
---------------- ------- ------- ------- 
total kB          807436   85216   27584

@rhafer
Copy link
Contributor

rhafer commented Jul 18, 2023

I did not find hint that the binary is virtual memory only:

@wkloucek Actually there is, I think. The Kbytes column has the allocated virtual memory I think if you sum up the Kbytes values of the various maps for the binary, you'll get roughly to the binary size. The RSS column has the parts of it that is currently in RAM. BTW it the system would be under memory pressure it might even page out more unused stuff of the binary.

$ pmap -x 70861
70861:   ./ocis-3.1.0-next.4-linux-amd64 server
Address           Kbytes     RSS   Dirty Mode  Mapping
0000000000400000       4       4       0 r---- ocis-3.1.0-next.4-linux-amd64
0000000000401000   36840   31976       0 r-x-- ocis-3.1.0-next.4-linux-amd64
00000000027fb000   20064    7944       0 r---- ocis-3.1.0-next.4-linux-amd64
0000000003b93000   36260   26852     468 rw--- ocis-3.1.0-next.4-linux-amd64

Though it looks like not the complete binary is in the RSS

When I only start the thumbnails service it looks slighly different:

Yes the whole file is mmaped again (Kbytes is the same as above), but fewer things are currently actively loaded into RAM.

$ pmap -x 73148
73148:   ./ocis-3.1.0-next.4-linux-amd64 thumbnails server
Address           Kbytes     RSS   Dirty Mode  Mapping
0000000000400000       4       4       0 r---- ocis-3.1.0-next.4-linux-amd64
0000000000401000   36840   30248       0 r-x-- ocis-3.1.0-next.4-linux-amd64
00000000027fb000   20064    7052       0 r---- ocis-3.1.0-next.4-linux-amd64
0000000003b93000   36260   20784     460 rw--- ocis-3.1.0-next.4-linux-amd64

BTW, do you have output for the single service thumbnails binary?

I think the more interesting bit however is the memory usage that kubernetes reports about the pods. In the all-in-one vs. the per-service binary case. (I am not sure if that directly reflects the RSS numbers.)

@wkloucek
Copy link
Contributor Author

When building the thumbnails service on my own, it looks different than the one that I got from CI (even I built it inside the owncloudci/golang container)

sudo pmap -x 1914006
[sudo] password for kloucek: 
1914006:   ./services/thumbnails/dist/binaries/thumbnails-testing-linux-amd64 server
Address           Kbytes     RSS   Dirty Mode  Mapping
000000c000000000    4096    4096    4096 rw---   [ anon ]
000000c000400000    4096    3948    3948 rw---   [ anon ]
000000c000800000    4096    2048    2048 rw---   [ anon ]
000000c000c00000   53248       0       0 -----   [ anon ]
000055e8bb44d000   16080   12880       0 r-x-- thumbnails-testing-linux-amd64
000055e8bc401000    6100    6036       0 r---- thumbnails-testing-linux-amd64
000055e8bc9f6000   15192   10160    3588 r---- thumbnails-testing-linux-amd64
000055e8bd8cc000    1268     732     432 rw--- thumbnails-testing-linux-amd64
000055e8bda09000     352     180     180 rw---   [ anon ]
000055e8bee5a000       4       0       0 -----   [ anon ]
000055e8bee5b000       4       4       4 rw---   [ anon ]
00007f0ebc92d000       8       0       0 -----   [ anon ]
00007f0ebc92f000     132       4       4 rw---   [ anon ]
00007f0ebc950000       8       0       0 -----   [ anon ]
00007f0ebc952000     388      28      28 rw---   [ anon ]
00007f0ebc9b3000       8       0       0 -----   [ anon ]
00007f0ebc9b5000     644     196     196 rw---   [ anon ]
00007f0ebca56000       8       0       0 -----   [ anon ]
00007f0ebca58000     132       4       4 rw---   [ anon ]
00007f0ebca79000       8       0       0 -----   [ anon ]
00007f0ebca7b000    1476    1056    1056 rw---   [ anon ]
00007f0ebcbec000       8       0       0 -----   [ anon ]
00007f0ebcbee000     708     356     356 rw---   [ anon ]
00007f0ebcc9f000       8       0       0 -----   [ anon ]
00007f0ebcca1000    1796     376     376 rw---   [ anon ]
00007f0ebce62000       8       0       0 -----   [ anon ]
00007f0ebce64000     388     232     232 rw---   [ anon ]
00007f0ebcec5000       8       0       0 -----   [ anon ]
00007f0ebcec7000     132       8       8 rw---   [ anon ]
00007f0ebcee8000       8       0       0 -----   [ anon ]
00007f0ebceea000     132       8       8 rw---   [ anon ]
00007f0ebcf0b000       8       0       0 -----   [ anon ]
00007f0ebcf0d000   35788     248     248 rw---   [ anon ]
00007f0ebf200000    2048       0       0 rw---   [ anon ]
00007f0ebf400000    1448       4       4 rw---   [ anon ]
00007f0ebf56a000  267748       0       0 -----   [ anon ]
00007f0ecfae3000       4       4       4 rw---   [ anon ]
00007f0ecfae4000  293564       0       0 -----   [ anon ]
00007f0ee1993000       4       4       4 rw---   [ anon ]
00007f0ee1994000   36692       0       0 -----   [ anon ]
00007f0ee3d69000       4       4       4 rw---   [ anon ]
00007f0ee3d6a000    4580       0       0 -----   [ anon ]
00007f0ee41e3000       4       4       4 rw---   [ anon ]
00007f0ee41e4000     508       0       0 -----   [ anon ]
00007f0ee4263000     384      68      68 rw---   [ anon ]
00007f0ee42c3000      80      80       0 r---- ld-musl-x86_64.so.1
00007f0ee42d7000     304     304       0 r-x-- ld-musl-x86_64.so.1
00007f0ee4323000     216     100       0 r---- ld-musl-x86_64.so.1
00007f0ee4359000       4       4       4 r---- ld-musl-x86_64.so.1
00007f0ee435a000       4       4       4 rw--- ld-musl-x86_64.so.1
00007f0ee435b000      12      12      12 rw---   [ anon ]
00007fffdcf74000     132      16      16 rw---   [ stack ]
00007fffdcf98000      16       0       0 r----   [ anon ]
00007fffdcf9c000       8       4       0 r-x--   [ anon ]
ffffffffff600000       4       0       0 --x--   [ anon ]
---------------- ------- ------- ------- 
total kB          754108   43212   16936

When looking at Kubernetes, we can clearly see that Kubernetes is displaying a number that reflects the actual used memory (not the virtual one). This issue seems like noise around nothing.
I'm sorry about that!

POD                                            CPU REQUESTS   CPU LIMITS   CPU UTIL   MEMORY REQUESTS   MEMORY LIMITS   MEMORY UTIL
antivirus-64c8d85684-c4k2d                     50m (0%)       0m (0%)      1m (0%)    700Mi (1%)        700Mi (1%)      26Mi (0%)
antivirus-64c8d85684-fxlmv                     50m (0%)       0m (0%)      1m (0%)    700Mi (1%)        700Mi (1%)      27Mi (0%)
appprovider-bycs-office-78f97576f7-29vvs       30m (0%)       0m (0%)      1m (0%)    100Mi (0%)        100Mi (0%)      29Mi (0%)
appregistry-54d549d99-v7qmx                    30m (0%)       0m (0%)      1m (0%)    100Mi (0%)        100Mi (0%)      29Mi (0%)
audit-57589975b7-khpbb                         10m (0%)       0m (0%)      1m (0%)    100Mi (0%)        100Mi (0%)      26Mi (0%)
audit-57589975b7-xms8z                         10m (0%)       0m (0%)      1m (0%)    100Mi (0%)        100Mi (0%)      26Mi (0%)
authmachine-cdb56f957-t4n76                    100m (0%)      0m (0%)      1m (0%)    100Mi (0%)        100Mi (0%)      28Mi (0%)
authmachine-cdb56f957-tphn6                    100m (0%)      0m (0%)      1m (0%)    100Mi (0%)        100Mi (0%)      29Mi (0%)
eventhistory-cc4465d96-6kfxp                   30m (0%)       0m (0%)      1m (0%)    100Mi (0%)        100Mi (0%)      27Mi (0%)
eventhistory-cc4465d96-8vqb8                   30m (0%)       0m (0%)      1m (0%)    100Mi (0%)        100Mi (0%)      28Mi (0%)
frontend-5bf49cdf-ljzb4                        100m (0%)      0m (0%)      1m (0%)    200Mi (0%)        200Mi (0%)      29Mi (0%)
frontend-5bf49cdf-lvtt4                        100m (0%)      0m (0%)      1m (0%)    200Mi (0%)        200Mi (0%)      30Mi (0%)
gateway-5fb65cc8ff-jnmfd                       500m (3%)      0m (0%)      1m (0%)    500Mi (0%)        500Mi (0%)      41Mi (0%)
gateway-5fb65cc8ff-lbcjf                       500m (3%)      0m (0%)      1m (0%)    500Mi (0%)        500Mi (0%)      41Mi (0%)
graph-b9d79b9db-7fl45                          100m (0%)      0m (0%)      1m (0%)    100Mi (0%)        100Mi (0%)      30Mi (0%)
graph-b9d79b9db-rw55r                          100m (0%)      0m (0%)      1m (0%)    100Mi (0%)        100Mi (0%)      30Mi (0%)
groups-885c9568-5s6jc                          30m (0%)       0m (0%)      1m (0%)    100Mi (0%)        100Mi (0%)      27Mi (0%)
groups-885c9568-qbmft                          30m (0%)       0m (0%)      1m (0%)    100Mi (0%)        100Mi (0%)      27Mi (0%)
notifications-589b4f8f49-qxt6r                 30m (0%)       0m (0%)      1m (0%)    100Mi (0%)        100Mi (0%)      26Mi (0%)
ocdav-565b8b67b-9pfl9                          100m (0%)      0m (0%)      1m (0%)    200Mi (0%)        200Mi (0%)      30Mi (0%)
ocdav-565b8b67b-sqdzk                          100m (0%)      0m (0%)      1m (0%)    200Mi (0%)        200Mi (0%)      30Mi (0%)
ocs-85dd77df44-7dw49                           30m (0%)       0m (0%)      1m (0%)    100Mi (0%)        100Mi (0%)      28Mi (0%)
ocs-85dd77df44-b6rf8                           30m (0%)       0m (0%)      1m (0%)    100Mi (0%)        100Mi (0%)      28Mi (0%)
policies-58b65cc888-78c6v                      50m (0%)       0m (0%)      1m (0%)    100Mi (0%)        100Mi (0%)      32Mi (0%)
policies-58b65cc888-fm5bq                      50m (0%)       0m (0%)      1m (0%)    100Mi (0%)        100Mi (0%)      30Mi (0%)
postprocessing-7cdc9894d9-69vhl                30m (0%)       0m (0%)      1m (0%)    100Mi (0%)        100Mi (0%)      26Mi (0%)
postprocessing-7cdc9894d9-7kmft                30m (0%)       0m (0%)      1m (0%)    100Mi (0%)        100Mi (0%)      27Mi (0%)
proxy-7cbdc54f5-mdz8f                          200m (1%)      0m (0%)      1m (0%)    200Mi (0%)        200Mi (0%)      33Mi (0%)
proxy-7cbdc54f5-vrl7m                          200m (1%)      0m (0%)      1m (0%)    200Mi (0%)        200Mi (0%)      31Mi (0%)
search-5dfdf5559f-kzmvq                        500m (3%)      0m (0%)      1m (0%)    2000Mi (3%)       2000Mi (3%)     33Mi (0%)
settings-5cd7bf69c7-9f682                      50m (0%)       0m (0%)      1m (0%)    100Mi (0%)        100Mi (0%)      33Mi (0%)
settings-5cd7bf69c7-d8nwb                      50m (0%)       0m (0%)      1m (0%)    100Mi (0%)        100Mi (0%)      32Mi (0%)
sharing-d4447b584-897m8                        200m (1%)      0m (0%)      1m (0%)    250Mi (0%)        250Mi (0%)      30Mi (0%)
sharing-d4447b584-d4sb4                        200m (1%)      0m (0%)      1m (0%)    250Mi (0%)        250Mi (0%)      31Mi (0%)
storagepubliclink-847c9b7988-fwjjn             100m (0%)      0m (0%)      1m (0%)    100Mi (0%)        100Mi (0%)      27Mi (0%)
storagepubliclink-847c9b7988-pkkvv             100m (0%)      0m (0%)      1m (0%)    100Mi (0%)        100Mi (0%)      28Mi (0%)
storageshares-fc8b9985b-xt9dz                  100m (0%)      0m (0%)      1m (0%)    100Mi (0%)        100Mi (0%)      30Mi (0%)
storageshares-fc8b9985b-z9k4x                  100m (0%)      0m (0%)      1m (0%)    100Mi (0%)        100Mi (0%)      29Mi (0%)
storagesystem-7bcd546768-h49v5                 100m (0%)      0m (0%)      1m (0%)    300Mi (0%)        300Mi (0%)      34Mi (0%)
storagesystem-7bcd546768-mg9lg                 100m (0%)      0m (0%)      1m (0%)    300Mi (0%)        300Mi (0%)      33Mi (0%)
storageusers-c44966d7f-564bx                   400m (2%)      0m (0%)      1m (0%)    1500Mi (2%)       1500Mi (2%)     34Mi (0%)
storageusers-c44966d7f-jszwv                   400m (2%)      0m (0%)      1m (0%)    1500Mi (2%)       1500Mi (2%)     32Mi (0%)
store-97fcdf6fc-csfqn                          100m (0%)      0m (0%)      1m (0%)    200Mi (0%)        200Mi (0%)      28Mi (0%)
thumbnails-9bdcbfc55-7g8c4                     100m (0%)      0m (0%)      1m (0%)    200Mi (0%)        200Mi (0%)      31Mi (0%)
userlog-557f8cd58c-nf78p                       30m (0%)       0m (0%)      1m (0%)    100Mi (0%)        100Mi (0%)      28Mi (0%)
userlog-557f8cd58c-tz6hz                       30m (0%)       0m (0%)      1m (0%)    100Mi (0%)        100Mi (0%)      29Mi (0%)
users-676c5cc5b6-4gv6n                         30m (0%)       0m (0%)      1m (0%)    100Mi (0%)        100Mi (0%)      29Mi (0%)
users-676c5cc5b6-4v6tn                         30m (0%)       0m (0%)      1m (0%)    100Mi (0%)        100Mi (0%)      28Mi (0%)
web-69d9fcfd7c-t2xcw                           50m (0%)       0m (0%)      1m (0%)    100Mi (0%)        100Mi (0%)      28Mi (0%)
web-69d9fcfd7c-tsb7t                           50m (0%)       0m (0%)      1m (0%)    100Mi (0%)        100Mi (0%)      30Mi (0%)
webdav-7c777bf599-hgfxp                        30m (0%)       0m (0%)      1m (0%)    100Mi (0%)        100Mi (0%)      29Mi (0%)
webdav-7c777bf599-tsf5l                        30m (0%)       0m (0%)      1m (0%)    100Mi (0%)        100Mi (0%)      28Mi (0%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Category:Enhancement Add new functionality
Projects
None yet
Development

No branches or pull requests

2 participants