-
Notifications
You must be signed in to change notification settings - Fork 4
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Improve docker compose setup #110
Conversation
@@ -1,6 +1,7 @@ | |||
.PHONY: start | |||
start: | |||
docker compose up --build -d | |||
docker stats envio-indexer |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
can see the cpu usage, memory usage in the terminal
MAX_QUEUE_SIZE: 50_000 | ||
MAX_BATCH_SIZE: 10_000 | ||
# these variables can be skips if hasura is not necessary |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
reduce the batch size and queue size to limit processing. Smaller sizes here reduce indexing speed
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@MJYoung114 do you think you can leave a comment on how these numbers scale against memory/cpu? It would help us benchmark requirements on the paper prior to a deployment 🙏
} | ||
|
||
|
||
check_hasura_health |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Does this require hasura to be up? We don't have it enabled and likely prefer to not have it running. Should we instead consider something like psql $POSTGRES_URI -c "select max(log_index) > 0 from event_sync_state"
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hey @stas I don't it's necessary for the postgres! I've added some new docker files here regarding hydra where I've removed the hasura and this check is no longer needed!
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
No description provided.