Skip to content
This repository has been archived by the owner on Mar 21, 2024. It is now read-only.

Search API - Remove/Rename confusing fields #135

Merged
merged 5 commits into from
Jul 7, 2022

Conversation

gmourier
Copy link
Member

@gmourier gmourier commented Mar 28, 2022

🤖 API Diff

Why?

nbHits / exhaustiveNbHits / exhaustiveFacetsCount

We found that nbHits response field is confusing for multiple users who expect to get the number exact of hits which is not the case.

One of the most problematic consequences is the users rely on the nbHits value to build finished pagination. We had to create an issue to avoid this, cf meilisearch/documentation#561

This specification is intended to make it clearer that the number returned is an estimate and thus discourages users from building finite pagination for their search experience.

Since exhaustiveFacetsCount and exhaustiveNbHits are always returning false and do not seem to help users understand the engine's behavior, they are removed.

matches/ _matchesInfo

Related Discussion

facetsDistribution

Related Discussion

API Changes

  • Rename nbHits response parameter to estimatedTotalHits
  • Delete exhaustiveNbHits response parameter
  • Delete exhaustiveFacetsCount response parameter
  • matches request parameter is renamed showMatchesPosition
  • _matchesInfo response parameter is renamed _matchesPosition
  • facetsDistribution request parameter is renamed facets
  • facetsDistribution response parameter is renamed facetDistribution

Telemetry Changes

  • Add a facets telemetry node
  • Rename formatting.matches to formatting.show_matches_position

@gmourier gmourier added v0.28 In Progress Feature specification is in elaboration. Important changes can still occurs in the specification. labels Mar 28, 2022
@gmourier gmourier mentioned this pull request Mar 30, 2022
1 task
@gmourier gmourier changed the title Search API - Pagination - Remove/Rename confusing fields for search results pagination Search API - Pagination - Remove/Rename confusing fields for search results browsing Mar 31, 2022
@gmourier gmourier added Q3:2022 Ready For Review Feature specification must be reviewed. OpenAPI Update OpenAPI specification. and removed Q2:2022 In Progress Feature specification is in elaboration. Important changes can still occurs in the specification. labels Apr 21, 2022
@github-actions
Copy link

github-actions bot commented Apr 21, 2022

🚨 Breaking API change detected:

Modified (2)

  • GET /indexes/{indexUid}/search
    • Query parameters added: facets, showMatchesPosition
    • [Breaking] Query parameters removed: facetsDistribution, matches
    • Response modified: 200
      • Body attributes added: estimatedTotalHits, facetDistribution
      • [Breaking] Body attributes removed: nbHits, exhaustiveNbHits, facetsDistribution, exhaustiveFacetsCount
      • Body attribute modified: hits
  • POST /indexes/{indexUid}/search
    • Body modified
      • Body attributes added: showMatchesPosition, facets
      • [Breaking] Body attributes removed: matches, facetsDistribution
    • Response modified: 200
      • Body attributes added: estimatedTotalHits, facetDistribution
      • [Breaking] Body attributes removed: nbHits, exhaustiveNbHits, facetsDistribution, exhaustiveFacetsCount
      • Body attribute modified: hits

View documentation diff

Powered by Bump

@gmourier gmourier requested review from curquiza and bidoubiwa and removed request for curquiza and bidoubiwa April 21, 2022 10:56
@gmourier gmourier added In Progress Feature specification is in elaboration. Important changes can still occurs in the specification. and removed Ready For Review Feature specification must be reviewed. labels Apr 21, 2022
@gmourier gmourier changed the title Search API - Pagination - Remove/Rename confusing fields for search results browsing Search API - Remove/Rename confusing fields for search results browsing Apr 21, 2022
@gmourier gmourier changed the title Search API - Remove/Rename confusing fields for search results browsing Search API - Remove/Rename confusing fields Apr 21, 2022
@gmourier gmourier force-pushed the remove-confusing-fields-for-pagination branch from 4990f2a to 813d638 Compare May 16, 2022 11:40
@gmourier gmourier added Ready For Review Feature specification must be reviewed. Telemetry Update the telemetry collect. and removed In Progress Feature specification is in elaboration. Important changes can still occurs in the specification. labels May 17, 2022
@gmourier
Copy link
Member Author

gmourier commented May 17, 2022

Signal @meilisearch/docs-team, @meilisearch/core-team; a telemetry node is renamed, and one is added. See the Telemetry Changes section in the PR first comment.

Thanks to those who participated in the discussions. 🧃

Copy link
Contributor

@bidoubiwa bidoubiwa left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 🔥🔥🔥

bidoubiwa
bidoubiwa previously approved these changes May 18, 2022
Copy link
Contributor

@bidoubiwa bidoubiwa left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 🔥

bidoubiwa
bidoubiwa previously approved these changes May 18, 2022
Copy link
Contributor

@bidoubiwa bidoubiwa left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🔥🔥🔥🔥🔥🔥🔥🔥 lgtm

@gmourier gmourier force-pushed the remove-confusing-fields-for-pagination branch from fc57b35 to 953f3c2 Compare July 7, 2022 11:03
@gmourier gmourier merged commit 61fd59c into develop Jul 7, 2022
@gmourier gmourier deleted the remove-confusing-fields-for-pagination branch July 7, 2022 11:04
gmourier added a commit that referenced this pull request Jul 7, 2022
* Rename nbHits, remove exhaustive* boolean fields

* Rename approximativeNbHits to estimatedTotalHits

* Update open-api.yaml

* Apply naming changes for facet distribution and showing matches position

* Add a telemetry for facet distribution usage
gmourier added a commit that referenced this pull request Jul 11, 2022
* Bump open-api.yml to v0.28

* Telemetry - Add `x-meilisearch-client` query parameter (#145)

* Introduce the x-meilisearch-client query parameter

* Update text/0034-telemetry-policies.md

Co-authored-by: Bruno Casali <brunoocasali@gmail.com>

* Update text/0034-telemetry-policies.md

Co-authored-by: Bruno Casali <brunoocasali@gmail.com>

Co-authored-by: Bruno Casali <brunoocasali@gmail.com>

* GeoSearch — Support string type for `_geo` `lat` and `lng` fields (#83)

* Update specification to support string type for _geo lat and lng fields

* mention types mixing for _geo object

* Tasks API - Rename `uid` to `taskUid` in the `202 - Accepted` Summarized Task Response (#144)

* Rename 202 uid to taskUid

* Update text/0060-tasks-api.md

Co-authored-by: cvermand <33010418+bidoubiwa@users.noreply.github.com>

Co-authored-by: cvermand <33010418+bidoubiwa@users.noreply.github.com>

* Tasks API - Seek/Keyset based pagination (#115)

* Move cursor based pagination spec to tasks API spec

* remove pagination as a future capability

* Clarify boundaries for limit query parameter

* Update OpenApi specification

* Remove limit field boundaries

* Apply suggestions from code review

Co-authored-by: Clément Renault <renault.cle@gmail.com>

* Update open-api.yml and removes cursor term mentions

* Update text/0060-tasks-api.md

Co-authored-by: Tommy <68053732+dichotommy@users.noreply.github.com>

* Remove  route mention in seek-keyset pagination section

Co-authored-by: Clément Renault <renault.cle@gmail.com>
Co-authored-by: Tommy <68053732+dichotommy@users.noreply.github.com>

* Tasks API - Filter tasks list by `type`/`status`/`indexUid` (#116)

* move filtering tasks by status/type parameter to task api spec

* Update specification

* Add details about case-sensitivy + rework error message

* Introducing naming changes plus make the specification a source of truth instead of a changelog

* Remove a future possibility being introduced

* misc - replace createIndex to the right type and add the missing type field to the 202 Response resource

* Dumps API - Make dump creation an asynchronous task (#139)

* wip

* Make a dump creation a visible asynchronous task

* Add precisions

* Update open-api.yml

* Add ommited type field for summarized task response

* Add future possibilities

* Apply suggestions from code review

Co-authored-by: cvermand <33010418+bidoubiwa@users.noreply.github.com>

* Precise that indexUid can be null

* Precise priorization of dumpCreation task over other task types

* Keep taskUid for 202 response

* remove dumps.get API key action

Co-authored-by: cvermand <33010418+bidoubiwa@users.noreply.github.com>

* Search API - Remove/Rename confusing fields (#135)

* Rename nbHits, remove exhaustive* boolean fields

* Rename approximativeNbHits to estimatedTotalHits

* Update open-api.yaml

* Apply naming changes for facet distribution and showing matches position

* Add a telemetry for facet distribution usage

* API Guideline - Return list of API resources under a `results` array (#138)

* Place list of documents under a results array on /documents

* Add results array for indexes object list

* Add the future of indexes pagination

* Update open-api.yml

* Fix typo

* Apply suggestions from code review

Co-authored-by: cvermand <33010418+bidoubiwa@users.noreply.github.com>

* Add offset/limit pagination for indexes and API keys

* Try to add multipe refs to a response object

Co-authored-by: cvermand <33010418+bidoubiwa@users.noreply.github.com>

* Remove name field (#140)

* Documents API - `displayedAttributes` should not impact the documents API / Rename `attributesToRetrieve` to `fields` (#143)

* Specifies that displayedAttributes setting does not impact the GET documents endpoint

* Rename attributeToRetrieve to fields on /documents

* Add a future possibily to rejectt a field from a document in the given response

* Precise behavior details about fields query parameter

* Add fields query parameter on GET /indexes/{index}/documents/{docId}

* API Keys - Determinist API Keys + Security changes (#148)

* Add an uid to make API Keys determinists, plus add a non-unique human readable name field to ease reading information

* Describe errors for uid and name fields

* Apply suggestions from code review

Co-authored-by: Bruno Casali <brunoocasali@gmail.com>

* misc: add precisions

* Reorganize route descriptions

* Update error_code when API Key already exists for a given uid

* Apply suggestions from code review

Co-authored-by: Many the fish <legendre.maxime.isn@gmail.com>

* Add new keys actions, remove master-key changes, introduce a new error for immutable field and update tenant token

* Update open-api spec

* Update immutable_field error message

* Apply suggestions from code review

Co-authored-by: Many the fish <legendre.maxime.isn@gmail.com>

* Mention that the Default Admin API Key can manage keys

* Specify that the JWT Tenant Token must be enrypted with the API Key value

* Update the spec regarding the description of the Admin API Key to be up-to-date

* Add uid_or_key url param to update and delete a key

* Update text/0085-api-keys.md

Co-authored-by: Many the fish <legendre.maxime.isn@gmail.com>

* Update text/0085-api-keys.md

Co-authored-by: Many the fish <legendre.maxime.isn@gmail.com>

Co-authored-by: Bruno Casali <brunoocasali@gmail.com>
Co-authored-by: Many the fish <legendre.maxime.isn@gmail.com>
Co-authored-by: Kerollmops <clement@meilisearch.com>

* Geosearch - Enhance lat/lng format error messages (#149)

* Update the geosearch error message

* misc: organiser error message in the right specification

Co-authored-by: Guillaume Mourier <guillaume@meilisearch.com>

* Introduces HTTP Verbs changesto be compliant regarding a Rest API (#152)

* Telemetry - Replace `x-meilisearch-client` query parameter by `X-Meilisearch-Client` header (#150)

* Removes x-meilisearch-client, replace it by a header

* Remove capslock

* fix typo (#151)

* Mention telemetry.meilisearch.com (#153)

* update ranking rules error message (#154)

* Misc — Update dump versions compatibility table (#156)

* Update dump table

* Update text/0105-dumps-api.md

* Settings API - Customize the hard limits for `pagination` and `faceting` (#157)

* Introduces specification files

* Update files name

* branch telemetry

* Update open-api.yml

* Update text/0034-telemetry-policies.md

Co-authored-by: Clément Renault <renault.cle@gmail.com>

* update open-api.yml

* Update text/157-faceting-setting-api.md

Co-authored-by: Clément Renault <renault.cle@gmail.com>

* Rename limitedTo to maxTotalHits

* Specify order of returned facet

Co-authored-by: Clément Renault <renault.cle@gmail.com>

* Add dumpCreation task type to OpenAPI.yml

* Tasks filtering params to be in query instead of path on OpenAPI spec

Co-authored-by: Bruno Casali <brunoocasali@gmail.com>
Co-authored-by: cvermand <33010418+bidoubiwa@users.noreply.github.com>
Co-authored-by: Clément Renault <renault.cle@gmail.com>
Co-authored-by: Tommy <68053732+dichotommy@users.noreply.github.com>
Co-authored-by: Many the fish <legendre.maxime.isn@gmail.com>
Co-authored-by: Kerollmops <clement@meilisearch.com>
Co-authored-by: Tamo <tamo@meilisearch.com>
Co-authored-by: ad hoc <postma.marin@protonmail.com>
Co-authored-by: Clémentine Urquizar - curqui <clementine@meilisearch.com>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
OpenAPI Update OpenAPI specification. Q3:2022 Ready For Review Feature specification must be reviewed. Telemetry Update the telemetry collect. v0.28
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants