Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Reworking search: tokenization, handling of quoted literal search, and postgres fuzziness #2351

Merged
merged 36 commits into from
May 28, 2023
Merged

Reworking search: tokenization, handling of quoted literal search, and postgres fuzziness #2351

merged 36 commits into from
May 28, 2023

Commits on May 28, 2023

  1. Creating postgres migration script and starting to set up to detect d… 

    …atabase
    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    2df3731 View commit details
    Browse the repository at this point in the history

  2. non-working placeholders for postgres pg_tgrm

    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    72e70f5 View commit details
    Browse the repository at this point in the history

  3. First draft of some indexes

    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    a8b7ea8 View commit details
    Browse the repository at this point in the history

  4. non-working commit of postgres indexing

    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    80d1b5b View commit details
    Browse the repository at this point in the history

  5. Further non-working edits to db-centric fuzzy search

    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    3fe9da0 View commit details
    Browse the repository at this point in the history

  6. update alembic for extensions

    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    04f9896 View commit details
    Browse the repository at this point in the history

  7. More non-working setup

    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    54c1cac View commit details
    Browse the repository at this point in the history

  8. Move db type check to init_db

    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    d4c7256 View commit details
    Browse the repository at this point in the history

  9. fix typo in db name check

    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    853c43f View commit details
    Browse the repository at this point in the history

  10. Add sqlite token search and postgres full text search

    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    86c6fca View commit details
    Browse the repository at this point in the history

  11. reorder search to hit exact matches faster

    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    1378be7 View commit details
    Browse the repository at this point in the history

  12. Add settings and docs for POSTGRES_LANGUAGE (full text search)

    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    4ddaa8f View commit details
    Browse the repository at this point in the history

  13. Use user-specified POSTGRES_LANGUAGE in search

    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    22256af View commit details
    Browse the repository at this point in the history

  14. fix fuzzy search typo

    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    98f6a28 View commit details
    Browse the repository at this point in the history

  15. Remove full text search and instead order by trigram match

    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    e64082f View commit details
    Browse the repository at this point in the history

  16. cleaner adding of indices, remove fulltext

    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    3346811 View commit details
    Browse the repository at this point in the history

  17. Cleanup old import of getting app settings

    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    41dda03 View commit details
    Browse the repository at this point in the history

  18. Fix typo in index

    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    53e7fa0 View commit details
    Browse the repository at this point in the history

  19. Fix some alembic fuzzy typos

    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    236e166 View commit details
    Browse the repository at this point in the history

  20. Remove diagnostic printing from alembic migration

    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    adce758 View commit details
    Browse the repository at this point in the history

  21. Fix mixed up commutator for trigram operator and relax criteria

    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    021bb2b View commit details
    Browse the repository at this point in the history

  22. forgot to remove query debug

    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    0ee9d55 View commit details
    Browse the repository at this point in the history

  23. sort only on name

    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    8f1d1da View commit details
    Browse the repository at this point in the history

  24. token and fuzzy search tests

    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    81947f4 View commit details
    Browse the repository at this point in the history

  25. Refactor recipe search test to avoid rare random string cross-matches.

    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    ba250c4 View commit details
    Browse the repository at this point in the history

  26. Add ability to quote parts of search for exact match

    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    605b2de View commit details
    Browse the repository at this point in the history

  27. Remove internal punctuation, unless it's quoted for literal search

    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    54aad08 View commit details
    Browse the repository at this point in the history

  28. Add tests for special character removal and literal search

    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    6cfe202 View commit details
    Browse the repository at this point in the history

  29. Remove the outer double quotes from searches, but leave internal sing… 

    …le quotes alone.
    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    dfc602b View commit details
    Browse the repository at this point in the history

  30. Update tests to avoid intra-test name collisions

    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    37b2ba6 View commit details
    Browse the repository at this point in the history

  31. Fixing leftovers highlighted by lint

    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    2a4a6a1 View commit details
    Browse the repository at this point in the history

  32. cleanup linting and mypy errors

    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    e7d7da9 View commit details
    Browse the repository at this point in the history

  33. Fix test cross-matching on dirty db (leftovers from bulk import)

    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    0eccb76 View commit details
    Browse the repository at this point in the history

  34. forgot to cleanup something when debugging mypy errors

    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    7492a7f View commit details
    Browse the repository at this point in the history

  35. re-order pg_trgm loading in postgres

    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    2095a47 View commit details
    Browse the repository at this point in the history

  36. address comments

    @jecorn @hay-kot
    jecorn authored and hay-kot committed May 28, 2023
    Configuration menu
    Copy the full SHA
    dc2d56c View commit details
    Browse the repository at this point in the history