Skip to content

Latest commit

 

History

History
34 lines (27 loc) · 914 Bytes

README.md

File metadata and controls

34 lines (27 loc) · 914 Bytes

optimizely-crawler

Description

Optimizely Crawler is a reference guide to explain how to get data from GraphQL into SearchStax Site Search.

Features

  • Connect to GraphQL and get the data
  • Extract the required fields
  • HTML cleanup
  • Upload data to SearchStax Site Search

Installation

To run the Optimizely Crawler Reference Guide, follow these steps:

  1. Clone the repository: 
    git clone https://github.com/yourusername/optimizely-crawler.git
  2. Navigate to the project directory: 
    cd optimizely-crawler
  3. Install the required dependencies: 
    pip install -r requirements.txt
  4. Create a .env file and add the Optimizely Singlekey and SearchStax Site Search Auth token. (See the .env.example file)

Usage

To use the Optimizely Crawler reference guide:

  1. Run the python notebook
  2. Update the Ingest API URL in code block 40.