Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tune solr for realtime searching #526

Closed
byxorna opened this issue Mar 10, 2017 · 0 comments · Fixed by #529
Closed

Tune solr for realtime searching #526

byxorna opened this issue Mar 10, 2017 · 0 comments · Fixed by #529
Assignees

Comments

@byxorna
Copy link
Contributor

byxorna commented Mar 10, 2017

Solr is pretty much the default configuration, which causes a bunch of issues at scale, like indexing falling behind and not reflecting changes to assets in searches.

  1. Solr indexers fall behind on doc update storms (i.e. set attribute on every asset)
  2. commits must be written to disk before being searchable, increasing lag between write and read visibility
  3. asset updates may be triggering a manual commit instead of leveraging autocommit to properly batch commits

We should tune for improved autocommit, and look at softautocommit as well. Perhaps using the commitWithin solr facility may also provide some relief.

https://wiki.apache.org/solr/SolrConfigXml?#Update_Handler_Section
https://wiki.apache.org/solr/NearRealtimeSearch

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant