optimizely-crawler

Description

Optimizely Crawler is a reference guide to explain how to get data from GraphQL into SearchStax Site Search.

Features

• Connect to GraphQL and get the data
• Extract the required fields
• HTML cleanup
• Upload data to SearchStax Site Search

Installation

To run the Optimizely Crawler Reference Guide, follow these steps:

1. Clone the repository:

   git clone https://github.com/yourusername/optimizely-crawler.git

2. Navigate to the project directory:

   cd optimizely-crawler

3. Install the required dependencies:

   pip install -r requirements.txt

4. Create a .env file and add the Optimizely Singlekey and SearchStax Site Search Auth token. (See the .env.example file)

Usage

To use the Optimizely Crawler reference guide:

1. Run the python notebook
2. Update the Ingest API URL in code block 40.