search.md

Search

The Realm object has a searchIndex property, which in turn as a search(...) method. This is the method used to issue queries and get search results (card instance JSON-API representations) from the realm index.

Note that search results are only as good as the most recent index, so if indexing is not working, or some cards are failing to be indexed, you may not get the results you expect.

Search Queries

The SearchIndex#search(...) method has one required argument, a search query. The simplest query is an empty object ({}), which returns all cards in the index.

Filters

The Query object may have a filter property, which controls which cards are included in the result set.

• type: allow specification of a particular card type. Also includes descendant cards in this card's adoption chain.

• eq: allows specifying a card with a specific field value

• range: allows specifying a card with a field value that is gt, gte, lt, or lte a specific value

• any: allows an "OR" union of other filters

• every: allows an "AND" union of other filters

• not: allow negating another filter

• contains: allows you to specify a card that has a field value containing a specific value.

• on: may be used with eq,range and every to limit results to a particular card type. on provides the card type context for a field. This is how we can disambiguate, for example, between a Company.name field and a Country.name field. Simply providing a predicate to filter by the name field isnt enough. You need to say which card's name field you want to filter by -- this is the function of on.

Nested fields may be specified using a dot (.) notation.

Boxel's ability to filter containsMany and linksToMany fields is quite limited currently. Say for instance we have a card Company with a Department field that is a linksToMany field. There would be no easy way to express a filter that returns all the companies that have more than 5 departments. Better support for plural field predicate filtering is something we would like to improve in the future.

A note about the efficiency around linked fields in search results: Currently, the search index doesn't cache linked fields. Those are, for the time being, considered volatile and will be loaded at the time the search request is made. When we build up the search doc for a card with nested fields we will accurately reflect that as well as the dependent cards. When the dependent cards are updated, we invalidate the all the cards that consume them and rebuild their search docs -- so searches will be correct. We don't, however, cache the JSON API documents for these cards in the index -- rather we cache just the JSON API resource (i.e. without the included part of the JSON API document). When serving the card search results from the realm, we reconstruct the included part of the JSON API document each time.

Examples

let { data: matching } = await indexer.search({
  filter: {
    type: { module: `https://my.realm/article`, name: 'Article' },
  },
});

let { data: matching } = await indexer.search({
  filter: {
    on: { module: `https://my.realm/post`, name: 'Post' },
    range: { views: { lte: 10, gt: 5 }, 'author.posts': { gte: 1 } },
  },
});

let { data: matching } = await indexer.search({
  filter: {
    on: { module: `https://my.realm/booking`, name: 'Booking' },
    eq: { 'hosts.firstName': 'Arthur' },
  },
});

let { data: matching } = await indexer.search({
  filter: {
    on: { module: `https://my.realm/article`, name: 'Article' },
    not: { eq: { 'author.firstName': 'Carl' } },
  },
});

let { data: matching } = await indexer.search({
  filter: {
    any: [
      {
        on: { module: `https://my.realm/article`, name: 'Article' },
        eq: { 'author.firstName': 'Kafka' },
      },
      {
        on: { module: `https://my.realm/book`, name: 'Book' },
        eq: { 'author.firstName': 'Kafka' },
      },
    ],
  },
});

let { data: matching } = await indexer.search({
  filter: {
    on: {
      module: `https://my.realm/post`,
      name: 'Post',
    },
    every: [
      { eq: { title: 'Card 1' } },
      { not: { eq: { 'author.firstName': 'Cardy' } } },
    ],
  },
});

let { data: matching } = await indexer.search({
  filter: {
    on: { module: `https://my.realm/person`, name: 'Person' },
    contains: { firstName: 'Carl' },
  },
});

Sort Order

The Query object may have a sort property, which controls the order in which results are returned.

A sort is an array property value where each item is an object that consists of on, by, and optionally direction. The array is the order in which the sort is applied.

• on: The card type being sorted
• by: The field name to be sorted on. Nested fields may be supported using a dot (.) notation.
• direction: asc or desc, default is asc

Examples

let { data: matching } = await indexer.search({
  sort: [
    {
      by: 'author.firstName',
      on: { module: `https://my.realm/article`, name: 'Article' },
      direction: 'desc',
    },
  ],
  filter: { type: { module: `https://my.realm/post`, name: 'Post' } },
});

let { data: matching } = await indexer.search({
  sort: [
    {
      by: 'editions',
      on: { module: `https://my.realm/book`, name: 'Book' },
      direction: 'desc',
    },
    {
      by: 'author.lastName',
      on: { module: `https://my.realm/book`, name: 'Book' },
    },
  ],
  filter: { type: { module: `https://my.realm/book`, name: 'Book' } },
});

Pagination -- Future feature

This doesn't exist yet and we will likely tackle this when we build a database-backed index.

HTTP API

The TypeScript API described above is exposed as an HTTP endpoint by the realm server at /_search at a realm root. The query object should be stringify'd and sent as the query string. An Accept header of application/vnd.card+json must be sent.

Example

import { stringify } from 'qs';

let query: Query = {
  filter: {
    on: {
      module: `https://my.realm/person`,
      name: 'Person',
    },
    eq: {
      firstName: 'Van Gogh',
    },
  },
};

let response = await request
  .get(`/_search?${stringify(query)}`)
  .set('Accept', 'application/vnd.card+json');