Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

poor container startup performance #582

Open
frankii91 opened this issue Sep 18, 2024 · 0 comments
Open

poor container startup performance #582

frankii91 opened this issue Sep 18, 2024 · 0 comments
Labels

Comments

@frankii91
Copy link

the topic doesn't fit anywhere, however the issue of the first start-up and efficiency is rather important for first-time users, especially those who are looking for a solution to their problem.... as I think I found it but I don't know yet...... the first start-up is tragic and slow.... and it could be faster...

  1. slow file downloads from the network.. I understand..
    but
  2. lack of an efficient data importer to the database.. this is already a software issue... and if you have a powerful processor..... e.g. i9-14900k and a very powerful disk array.... and the load on the cores during import is much lower than 30% FOR EACH CORE, this is rather a mistake... for server environments this is a serious mistake... with such simple activities it should be 99% use of the maximum power of the available environment...

composer file:
services:
nominatim:
container_name: nominatim
image: mediagis/nominatim:4.4
ports:
- "8282:8080"
environment:
# see https://github.com/mediagis/nominatim-docker/tree/master/4.4#configuration for more options
# https://download.geofabrik.de/europe/poland.html
# https://download.geofabrik.de/europe.html

  PBF_URL: https://download.geofabrik.de/europe/poland-latest.osm.pbf
  REPLICATION_URL: https://download.geofabrik.de/europe/poland-updates
  NOMINATIM_PASSWORD: 123
  IMPORT_WIKIPEDIA: false
  THREADS: 28
volumes:
  - nominatim-data:/var/lib/postgresql/14/main
  - nominatim-flatnode:/nominatim/flatnode
shm_size: 2gb

volumes:
nominatim-data:
nominatim-flatnode:

data ps axu:
root@7ccdd362d19d:/app# ps axu
USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND
root 1 0.0 0.0 4364 1280 ? Ss 19:11 0:00 /bin/bash -ex /app/start.sh
root 20 0.0 0.0 4364 1536 ? S 19:11 0:00 /bin/bash -ex /app/init.sh
postgres 40 0.0 0.0 2241488 8960 ? Ss 19:52 0:00 /usr/lib/postgresql/14/bin/postgres -D /var/lib/postgresql/14/main -c config_file=/etc/postgresql/14/main/postgresql.conf
postgres 42 0.6 3.2 2244700 2144076 ? Ss 19:52 0:13 postgres: 14/main: checkpointer
postgres 43 0.1 3.2 2241624 2119168 ? Ss 19:52 0:02 postgres: 14/main: background writer
postgres 44 1.1 0.0 2241488 17920 ? Ss 19:52 0:23 postgres: 14/main: walwriter
postgres 45 0.0 0.0 2242152 3324 ? Ss 19:52 0:00 postgres: 14/main: autovacuum launcher
postgres 46 0.1 0.0 73616 2044 ? Ss 19:52 0:02 postgres: 14/main: stats collector
postgres 47 0.0 0.0 2241908 2560 ? Ss 19:52 0:00 postgres: 14/main: logical replication launcher
root 82 0.0 0.0 7240 1536 ? S 19:52 0:00 sudo -E -u nominatim nominatim import --osm-file /nominatim/data.osm.pbf --threads 28
nominat+ 83 55.2 0.4 368108 306792 ? R 19:52 19:04 python3 /usr/local/bin/nominatim import --osm-file /nominatim/data.osm.pbf --threads 28
root 139 0.0 0.0 2892 1024 pts/0 Ss 19:54 0:00 /bin/sh -c [ -e /bin/bash ] && (/bin/bash || exit 0) || /bin/sh
root 145 0.0 0.0 2892 256 pts/0 S 19:54 0:00 /bin/sh -c [ -e /bin/bash ] && (/bin/bash || exit 0) || /bin/sh
root 146 0.0 0.0 4628 1536 pts/0 S 19:54 0:00 /bin/bash
postgres 261 0.4 3.2 2301948 2100052 ? Ss 20:05 0:06 postgres: 14/main: nominatim nominatim [local] idle
postgres 867 7.6 1.8 2244080 1223948 ? Ss 20:06 1:33 postgres: 14/main: nominatim nominatim [local] idle
postgres 1277 0.7 3.4 2377800 2238412 ? Ss 20:10 0:08 postgres: 14/main: nominatim nominatim [local] idle in transaction
postgres 1280 23.2 3.2 2256864 2156044 ? Rs 20:10 4:00 postgres: 14/main: nominatim nominatim [local] SELECT
postgres 1441 20.3 2.5 2286244 1687560 ? Ss 20:26 0:08 postgres: 14/main: nominatim nominatim [local] idle
postgres 1442 20.0 2.5 2285932 1680688 ? Ss 20:26 0:08 postgres: 14/main: nominatim nominatim [local] idle
postgres 1443 20.3 2.5 2285344 1679168 ? Ss 20:26 0:08 postgres: 14/main: nominatim nominatim [local] idle
postgres 1444 20.3 2.5 2285784 1681864 ? Ss 20:26 0:08 postgres: 14/main: nominatim nominatim [local] idle
postgres 1445 19.1 2.5 2286536 1674704 ? Ss 20:26 0:08 postgres: 14/main: nominatim nominatim [local] idle
postgres 1446 19.8 2.5 2284908 1680740 ? Ss 20:26 0:08 postgres: 14/main: nominatim nominatim [local] idle
postgres 1447 19.7 2.5 2284776 1681960 ? Ss 20:26 0:08 postgres: 14/main: nominatim nominatim [local] idle
postgres 1448 19.2 2.5 2284884 1676088 ? Rs 20:26 0:08 postgres: 14/main: nominatim nominatim [local] UPDATE
postgres 1449 19.7 2.5 2285516 1680488 ? Rs 20:26 0:08 postgres: 14/main: nominatim nominatim [local] UPDATE
postgres 1450 18.0 2.5 2285044 1689620 ? Rs 20:26 0:07 postgres: 14/main: nominatim nominatim [local] UPDATE
postgres 1451 20.0 2.5 2285180 1684420 ? Rs 20:26 0:08 postgres: 14/main: nominatim nominatim [local] UPDATE
postgres 1452 20.5 2.5 2285252 1679248 ? Rs 20:26 0:08 postgres: 14/main: nominatim nominatim [local] UPDATE
postgres 1453 20.8 2.5 2286664 1692280 ? Ss 20:26 0:08 postgres: 14/main: nominatim nominatim [local] idle
postgres 1454 21.1 2.5 2285184 1695880 ? Ss 20:26 0:08 postgres: 14/main: nominatim nominatim [local] idle
postgres 1455 20.8 2.5 2284872 1688316 ? Ss 20:26 0:08 postgres: 14/main: nominatim nominatim [local] idle
postgres 1456 19.5 2.5 2285224 1678128 ? Ss 20:26 0:08 postgres: 14/main: nominatim nominatim [local] idle
postgres 1457 18.9 2.5 2288660 1694696 ? Ss 20:26 0:07 postgres: 14/main: nominatim nominatim [local] idle
postgres 1458 20.4 2.5 2286380 1691084 ? Ss 20:26 0:08 postgres: 14/main: nominatim nominatim [local] idle
postgres 1459 20.9 2.5 2286624 1683924 ? Ss 20:26 0:08 postgres: 14/main: nominatim nominatim [local] idle
postgres 1460 20.5 2.5 2285304 1687212 ? Ss 20:26 0:08 postgres: 14/main: nominatim nominatim [local] idle
postgres 1461 20.6 2.5 2285168 1684024 ? Ss 20:26 0:08 postgres: 14/main: nominatim nominatim [local] idle
postgres 1462 21.1 2.5 2285028 1681544 ? Ss 20:26 0:08 postgres: 14/main: nominatim nominatim [local] idle
postgres 1463 20.0 2.5 2286820 1691892 ? Ss 20:26 0:08 postgres: 14/main: nominatim nominatim [local] idle
postgres 1464 19.7 2.5 2284840 1678152 ? Ss 20:26 0:08 postgres: 14/main: nominatim nominatim [local] idle
postgres 1465 18.5 2.5 2286308 1686156 ? Ss 20:26 0:07 postgres: 14/main: nominatim nominatim [local] idle
postgres 1466 20.5 2.5 2284908 1691124 ? Ss 20:26 0:08 postgres: 14/main: nominatim nominatim [local] idle
postgres 1467 19.9 2.5 2284840 1678496 ? Ss 20:26 0:08 postgres: 14/main: nominatim nominatim [local] idle
postgres 1468 19.7 2.5 2285176 1684280 ? Ss 20:26 0:08 postgres: 14/main: nominatim nominatim [local] idle
postgres 1470 7.6 2.3 3291808 1522700 ? Ss 20:27 0:01 postgres: 14/main: autovacuum worker nominatim
root 1471 0.0 0.0 7064 2816 pts/0 R+ 20:27 0:00 ps axu

@frankii91 frankii91 added the bug label Sep 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant