Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support a read-only mode #2982

Open
davidjgoss opened this issue Nov 19, 2024 · 0 comments
Open

Support a read-only mode #2982

davidjgoss opened this issue Nov 19, 2024 · 0 comments
Assignees
Milestone

Comments

@davidjgoss
Copy link
Contributor

It can sometimes be desirable to run Marquez in a read-only mode. For example, if you have a read replica of your database and want to scale querying separately from ingestion, you might deploy one or more instances of Marquez pointed at your reader. Currently if you do this you'll an error starting with:

org.jdbi.v3.core.statement.UnableToExecuteStatementException: org.postgresql.util.PSQLException: ERROR: cannot execute INSERT in a read-only transaction

This is because Marquez does an upsert operation for the default namespace at startup. So for a true reader to work we need a way to disable this. It would also make sense to disable non-GET endpoints.

One idea discussed was to move the namespace creation to a Flyway script. However, we decided on adding a new readOnly flag in the Marquez config file, which will drive the above mentioned changes in behaviour.

@davidjgoss davidjgoss added this to the 0.51.0 milestone Nov 19, 2024
@davidjgoss davidjgoss self-assigned this Nov 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant