Skip to content

Views-driven search API with pluggable search backends.

Notifications You must be signed in to change notification settings

das-peter/searchlight

 
 

Repository files navigation

Searchlight

Searchlight is a refactored version of the early experiment sphinx_views, an attempt to build a views-driven search implementation specific to Sphinx. Searchlight is designed to use search backends in a pluggable and interchangeable manner. There are currently two backend plugins available for Searchlight: Sphinx and Apache Solr.

Goals

Searchlight is rather different from any of the existing advanced tech search implementations in Drupal out there currently. In no particular order, some goals that set it apart:

  • Each Drupal site should be able to define its own schema and index configuration. We're Views-centric, not node-centric, so anything that has been properly exposed to Views is fair game.
  • We think there is a lot of common ground between good search solutions, enough so that there can be a lot of shared interface points. We want search backends to be as swappable as possible, to the point where you can take a site that's using backend A and switch to backend B without rebuilding your Views, etc.

Installation, requirements & setup

Please see INSTALL.markdown for full instructions on installing and setting up one of the Search backend services and Searchlight.

Status

This is not ready for production deployment. If you're reading this it should be because you're curious and are willing to get burned.

Current features

  • Swappable backend plugins. Currently supports Sphinx and Apache Solr.
  • The ability to define multiple datasources and choose which datasource is active for a given base table / entity type.
  • A Views search filter, argument and relevance sort.
  • Faceted search through configurable search environments.
  • Drush-based search configuration writing, indexing and service dispatching.
  • Full exportables & Features module integration through CTools export API.

Terminology

  • A backend is a CTools plugin class that interfaces with a specific search technology.
  • A datasource is a backend-agnostic representation of a search datasource (aka index). Each datasource belongs to a Views base table (e.g. node, users, comments) and defines what and how data related to those entities should be indexed.
  • A field is a data element exposed to the search backend. Each field is referenced by the views alias generated for it in its datasource view, and contains additional metadata like its datatype (int, text, timestamp, etc.). Each datasource contains definitions of one or more fields.
  • A multivalue is a field that may have multiple values per entitiy record. In Searchlight, these are modeled using Multivalue views displays that can be referenced by a datasource.
  • An environment is a CTools configuration object that allows administrators to define the search experience for a given portion of their site. For example, they can choose which facets to display and customize different settings related to them.

The backend API

The backend is a base class that defines the methods each implementing backend must provide. The methods fall roughly into these categories:

  • General settings management. Form and default settings methods are available for each backend and are saved to a drupal variable per backend through a system settings form. These are for generic sitewide settings, e.g. what port to use to connect to the Sphinx daemon.
  • Views handler settings. Each backend may have particular quirks. Searchlight provides a single "meta" views filter handler and argument handler that calls the backend's settings to provide backend-specific options. You should provide sensible default values in case someone switches between backends on the fly -- if you have good defaults, everything should continue to work.
  • Views execution & query translation. The base backend class provides the main views interface point for result set replacement and query object translation. This is where the magic happens and hopefully implementers will never have to override this logic. An example of what happens here - I can take a WHERE table.aliased_field IN ('%s', '%s') clause on the Views query object, and translate it into parameters for the search backend like ->setFilter($field, $operator, $args).
  • Search query methods. These are the main methods the backend is responsible for implementing. They include things like: initClient(), setFilter(), setSort().
  • Facet builiding, rendering. Facets represent a group of user-story driven queries (generally groupby's with a certain sort, like count desc or timestamp desc) and interface patterns. Backends will need to implement the query logic but ideally the UI and rendering methods can be left alone.

About

Views-driven search API with pluggable search backends.

Resources

Stars

Watchers

Forks

Packages

No packages published

Languages

  • PHP 97.5%
  • JavaScript 2.5%