Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Docs Release 2024-05-007 #354

Merged
merged 26 commits into from
May 22, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
26 commits
Select commit Hold shift + click to select a range
7bf2542
[add] - run llm widget
May 13, 2024
593dd98
adding runllm to main override
merlin-quix May 13, 2024
8f3a643
adding widget to correct location
merlin-quix May 13, 2024
229dceb
remove search?
May 15, 2024
b039397
pretify file and comment search section
May 15, 2024
fbe3e96
clean out the header
May 15, 2024
9a7bee7
Update main.html
merlin-quix May 16, 2024
983b111
Remove references to binary data in APIs and SDK
May 21, 2024
1842384
Merge pull request #348 from quixio/chore/58600
tbedford May 21, 2024
75b18b9
[add] - make sure instructions on installing and updating qs are avai…
May 21, 2024
60b39ba
[add] - instructions / update qs in cloud
May 21, 2024
1fead4a
[chore] - make code samples a link
May 21, 2024
96c20ea
[chore] - make quix cloud a link
May 21, 2024
2dbd7b6
Merge pull request #349 from quixio/feature/sc-58477/add-tips-on-inst…
tbedford May 21, 2024
6d09384
[update] - changelog for hotfix
May 21, 2024
c39e0ff
Merge pull request #350 from quixio/update-changelog-20240521-1
tbedford May 21, 2024
702f065
[chore] - remove cloud first option
May 21, 2024
72a9089
[wip] - modify start page
May 21, 2024
175cf4f
[fix] - make qs 2.5 work with public kafka
May 22, 2024
24c21c3
revert html changes
SteveRosam May 22, 2024
d3fa718
[wip] - tweak pitch text
May 22, 2024
adbc72a
fix search
SteveRosam May 22, 2024
6c7e711
Merge pull request #353 from quixio/bug/sc-58944/fix-connection-to-pu…
tbedford May 22, 2024
486c5e9
Merge pull request #351 from quixio/feature/sc-58853/remove-cloud-opt…
tbedford May 22, 2024
76a0b7c
Merge branch 'dev' into run-llm
tbedford May 22, 2024
99d6ebc
Merge pull request #330 from quixio/run-llm
tbedford May 22, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 6 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,12 @@ This is the Quix Cloud changelog for the current year.

See [here](https://github.com/quixio/quix-docs/wiki/Docs-Releases) for the docs changelog.

## 2024-05-02-cli-beta-hf | 21 MAY 2024

`BUG FIXES`

- Users were unable to sign up for serverless plans

## 2024-05-01-cli-beta | 15 MAY 2024

`NEW FEATURES`
Expand Down
2 changes: 1 addition & 1 deletion RUNNING-DOCS-LOCALLY.md
Original file line number Diff line number Diff line change
Expand Up @@ -39,5 +39,5 @@ To view the docs locally:
git clone https://github.com/quixio/quix-docs.git
```
3. Change into the docs directory you cloned (there will be a `mkdocs.yml` file there).
4. Run `mkdocs serve`.
4. Run `mkdocs serve --no-directory-urls`.
5. Navigate your browser to `localhost:8000` to view the docs.
2 changes: 1 addition & 1 deletion docs/apis/portal-api/setup.md
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ To obtain a PAT, log in to Quix, and click on your profile icon in the top right

Alternatively, log in to Quix, and click `Settings` in the main left-hand navigation. Then, for a specific environment, click `APIs and tokens`.

In the `APIs and tokens` dialog, you can click `Personal Access Tokens` to generate PATs, or a Streaming Token for use with the Quix Streams client library.
In the `APIs and tokens` dialog, you can click `Personal Access Tokens` to generate PATs, or a Streaming Token (SDK Token) for use with the Quix Streams client library.

## Get environment ID

Expand Down
1 change: 0 additions & 1 deletion docs/apis/query-api/aggregate-tags.md
Original file line number Diff line number Diff line change
Expand Up @@ -69,7 +69,6 @@ Standard aggregation functions are provided including `max`, `count`, and `sprea
]
},
"stringValues": {},
"binaryValues": {},
"tagValues": {
"LapNumber": [
"3.0",
Expand Down
3 changes: 1 addition & 2 deletions docs/apis/query-api/raw-data.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@ You can filter by a number of different factors but, at minimum, you’ll need t
}
```

In this example, we’re requesting a single numeric parameter, `Speed`. Each array of parameters is indexed based on parameter type, which can be `numericParameters`, `stringParameters` or `binaryParameters`. Parameters are returned in a union, so if you request several, you’ll get back all parameters that match.
In this example, we’re requesting a single numeric parameter, `Speed`. Each array of parameters is indexed based on parameter type, which can be `numericParameters` or `stringParameters`. Parameters are returned in a union, so if you request several, you’ll get back all parameters that match.

### Example

Expand All @@ -45,7 +45,6 @@ If you just had a single parameter value in the stored data, the response from t
]
},
"stringValues": {},
"binaryValues": {},
"tagValues": {},
}
```
Expand Down
2 changes: 1 addition & 1 deletion docs/apis/query-api/setup.md
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ To obtain a PAT, log in to Quix, and click on your profile icon in the top right

Alternatively, log in to Quix, and click `Settings` in the main left-hand navigation. Then, for a specific environment, click `APIs and tokens`.

In the `APIs and tokens` dialog, you can click `Personal Access Tokens` to generate PATs, or a Streaming Token for use with the Quix Streams client library.
In the `APIs and tokens` dialog, you can click `Personal Access Tokens` to generate PATs, or a Streaming Token (SDK Token) for use with the Quix Streams client library.

## Get environment ID

Expand Down
2 changes: 1 addition & 1 deletion docs/apis/streaming-reader-api/setup.md
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ To obtain a PAT, log in to Quix, and click on your profile icon in the top right

Alternatively, log in to Quix, and click `Settings` in the main left-hand navigation. Then, for a specific environment, click `APIs and tokens`.

In the `APIs and tokens` dialog, you can click `Personal Access Tokens` to generate PATs, or a Streaming Token for use with the Quix Streams client library.
In the `APIs and tokens` dialog, you can click `Personal Access Tokens` to generate PATs, or a Streaming Token (SDK Token) for use with the Quix Streams client library.

## Get environment ID

Expand Down
10 changes: 1 addition & 9 deletions docs/apis/streaming-writer-api/send-data.md
Original file line number Diff line number Diff line change
Expand Up @@ -22,14 +22,13 @@ You should replace `${topicName}` with the name of the topic your stream belongs

### Example request

Your payload should include an array of `timestamps` with one timestamp for each item of data you’re sending. Actual data values should be keyed on their name, in the object that corresponds to their type, one of `numericValues`, `stringValues`, or `binaryValues`. The payload is in this structure:
Your payload should include an array of `timestamps` with one timestamp for each item of data you’re sending. Actual data values should be keyed on their name, in the object that corresponds to their type, one of `numericValues` or `stringValues`. The payload is in this structure:

```json
{
"timestamps": [...],
"numericValues": {...},
"stringValues": {...},
"binaryValues": {...},
"tagValues": {...}
}
```
Expand Down Expand Up @@ -130,13 +129,6 @@ connection.start().then(async () => {
"!"
]
},
"binaryValues": {
"BinaryParameter1": [
btoa("Hello"), // send binary array as base64
btoa("World"),
btoa("!")
]
},
"tagValues": {
"Tag1": [
"A",
Expand Down
2 changes: 1 addition & 1 deletion docs/apis/streaming-writer-api/setup.md
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ To obtain a PAT, log in to Quix, and click on your profile icon in the top right

Alternatively, log in to Quix, and click `Settings` in the main left-hand navigation. Then, for a specific environment, click `APIs and tokens`.

In the `APIs and tokens` dialog, you can click `Personal Access Tokens` to generate PATs, or a Streaming Token for use with the Quix Streams client library.
In the `APIs and tokens` dialog, you can click `Personal Access Tokens` to generate PATs, or a Streaming Token (SDK Token) for use with the Quix Streams client library.

## Get environment ID

Expand Down
2 changes: 1 addition & 1 deletion docs/develop/authentication/personal-access-token.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,4 +6,4 @@ To obtain a PAT, log in to Quix, and click on your profile icon in the top right

Alternatively, log in to Quix, and click `Settings` in the main left-hand navigation. Then, for a specific environment, click `APIs and tokens`.

In the `APIs and tokens` dialog, you can click `Personal Access Tokens` to generate PATs, or a Streaming Token for use with the Quix Streams client library.
In the `APIs and tokens` dialog, you can click `Personal Access Tokens` to generate PATs, or a Streaming Token (SDK Token) for use with the Quix Streams client library.
8 changes: 4 additions & 4 deletions docs/develop/authentication/streaming-token.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,25 +8,25 @@ A streaming token is a type of bearer token that can be used to authenticate you

As streaming tokens are scoped to a specific environment, it means you can specify a topic name, even if that same topic name is used across multiple environments. This is because the topic ID is automatically used for you, based on the streaming token used. For example, if you had a topic called `f1-data` in production and development environments, you could simply use the topic name of `f1-data` in your code, regardless of the environment you're connecting to. In production, the topic ID might be `orgname-projectname-prod-f1-data`, and in development it might be `orgname-projectname-dev-f1-data`, however, the correct topic ID is automatically used by Quix Streams, as the environment is identified in the token, and therefore the correct prefix to the topic name can be generated.

## How to get a streaming token
## How to get a streaming token (SDK Token)

You can access these tokens by logging into Quix and clicking on `Settings` in the main left-hand navigation. Select your environment, and then click on `APIs and tokens` and then click on `Streaming Tokens`.

If you are looking for a bearer token to access the Quix APIs, such as the Portal API, you can select `Personal Access Tokens`. These are custom JWTs.

## How to use a streaming token
## How to use a streaming token (SDK Token)

The streaming token is primarily used to authenticate the [Quix Streams client library](https://quix.io/docs/quix-streams/introduction.html).

When using Quix Streams in Quix Cloud, you no longer need to provide all broker credentials manually, they’ll be acquired when needed and set up automatically.

!!! warning

Streaming tokens do not have an expiration date. Treat them as you would a password. If you think they’re exposed, rotate them.
Streaming Tokens (SDK Tokens) do not have an expiration date. Treat them as you would a password. If you think they’re exposed, rotate them.

## Rotating your token

If you suspect your streaming token may have been exposed, best practice is to rotate it. Within the `Streaming token` dialog, click `rotate them` to display the `Rotating streaming tokens` dialog. Two tokens are then displayed.
If you suspect your streaming token (SDK Token) may have been exposed, best practice is to rotate it. Within the `Streaming token` dialog, click `rotate them` to display the `Rotating streaming tokens` dialog. Two tokens are then displayed.

Having two keys lets you update your services without interruption, as both `Token 1` and `Token 2` are always valid. Rotating deactivates `Token 1`, `Token 2` takes its place and a new `Token 2` is generated.

Expand Down
14 changes: 14 additions & 0 deletions docs/develop/integrate-data/overview.md
Original file line number Diff line number Diff line change
Expand Up @@ -38,3 +38,17 @@ When using the Streaming Writer API you can use the HTTP interface if a continou
## Integrations

There is also a [section](../../integrations/overview.md) in this documentation providing more information on specific integrations you can use for connecting Quix with products such as InfluxDB.

## Installing Quix Streams

To install Quix Streams with `pip`:

```
python3 -m pip install quixstreams
```

!!! tip

If you already have Quix Streams installed, make sure you are using the latest version with `python -m pip install quixstreams -U` or `python3 -m pip install quixstreams -U`, depending on how your system is set up.

Note that if you're using Quix Cloud, then make sure the latest version of Quix Streams is available by adding it to the `requirements.txt` file, if it's not already been included as part of the code sample you are using.
18 changes: 17 additions & 1 deletion docs/develop/integrate-data/quix-streams.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,22 @@
# Using Quix Streams to ingest data

You can use Quix Streams to push and pull data to and from Quix, as well as use it to transform data.
You can use Quix Streams to push and pull data to and from Quix, as well as use it to transform data.

## Installing Quix Streams

To install Quix Streams with `pip`:

```
python3 -m pip install quixstreams
```

!!! tip

If you already have Quix Streams installed, make sure you are using the latest version with `python -m pip install quixstreams -U` or `python3 -m pip install quixstreams -U`, depending on how your system is set up.

Note that if you're using Quix Cloud, then make sure the latest version of Quix Streams is available by adding it to the `requirements.txt` file, if it's not already been included as part of the code sample you are using.

## Example code

Some example code showing Quix Streams pushing data into Quix is shown here:

Expand Down
16 changes: 15 additions & 1 deletion docs/develop/integrate-data/read-csv.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,9 +6,23 @@ When you need to load data from a CSV file into a Quix service, one possibility

Another option is to read the CSV file on some other system, such as your laptop, and publish that data into a Quix topic using the Quix Streams client library.

## Installing Quix Streams

To install Quix Streams with `pip`:

```
python3 -m pip install quixstreams
```

!!! tip

If you already have Quix Streams installed, make sure you are using the latest version with `python -m pip install quixstreams -U` or `python3 -m pip install quixstreams -U`, depending on how your system is set up.

Note that if you're using Quix Cloud, then make sure the latest version of Quix Streams is available by adding it to the `requirements.txt` file, if it's not already been included as part of the code sample you are using.

## Streaming token

You'll need a streaming token to authenticate with Quix if you're going to run a command-line program that publishes or subscribes to a Quix topic.
You'll need a streaming token (SDK token) to authenticate with Quix if you're going to run a command-line program that publishes or subscribes to a Quix topic.

!!! note

Expand Down
7 changes: 7 additions & 0 deletions docs/get-started/install-cloud.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
# Install Quix Streams in Quix Cloud

If you're using [Quix Cloud](../quix-cloud/overview.md), then Quix Streams will be installed for you as long as it is in the `requirements.txt` file for the application you are building. This is typically the case if you are using a Quix predefined [code sample](../develop/code-samples.md).

If you want to use Quix Streams in your application, ensure it is added to the `requirements.txt` file as illustrated here:

![Install Quix Streams](../images/quix-streams-requirements.png)
7 changes: 6 additions & 1 deletion docs/get-started/install.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,6 +16,10 @@ To install Quix Streams with `pip`:
python3 -m pip install quixstreams
```

!!! tip

If you already have Quix Streams installed, make sure you are using the latest version with `python -m pip install quixstreams -U` or `python3 -m pip install quixstreams -U`, depending on how your system is set up.

## Step 2: Create a simple app

You'll now create a simple app to test your installation. You'll connect to a Quix public Kafka broker and consume and print messages.
Expand All @@ -29,7 +33,8 @@ import uuid
# Connect to the public Quix hosted broker to consume data
app = Application(
broker_address="publickafka.quix.io:9092", # Kafka broker address
consumer_group=str(uuid.uuid4()) # Kafka consumer group
consumer_group=str(uuid.uuid4()), # Kafka consumer group
producer_extra_config={'enable.idempotence': False}
)

input_topic = app.topic("demo-onboarding-prod-chat", value_deserializer='json')
Expand Down
22 changes: 11 additions & 11 deletions docs/get-started/welcome.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,24 +5,24 @@ description: Welcome to the Quix Developer documentation. This documentation inc

# Welcome

<p style="font-size: 1rem;">Quix is a complete platform for developing, deploying, and monitoring stream processing pipelines. You develop your <b>pipeline services in Python</b> using Quix Streams, and deploy them to containers managed in Kubernetes with a single click. You can develop and manage services on the command line, and also manage and visualize your pipelines in Quix Cloud.</p>
<p style="font-size: 1rem;">Quix is a complete platform for developing, deploying, and monitoring stream processing pipelines. You can build producer/consumer/transform apps with Quix Streams and Python, build and test pipelines with the Quix CLI, and then deploy, manage and observe the pipelines in Quix Cloud.</p>

<div class="grid cards" markdown>

- __I'm comfortable on the command line__
## Workflow summary

---
Your Quix workflow:

Start building your stream processing pipeline on the command line with Quix Streams and the Quix CLI.
1. Develop your applications locally in Python with Quix Streams, the Quix CLI, and your IDE of choice.
2. Test and debug your pipeline locally with the Quix CLI and Docker.
3. Deploy to Quix Cloud for scalability and observability.

[Install Quix Streams :octicons-arrow-right-24:](./install.md)
<div class="grid cards" markdown>

- __I'd rather use the Cloud__
- __Get started!__

---

You can sign up to [Quix Cloud for free](https://portal.platform.quix.io/self-sign-up){target=_blank}, and then build a stream processing pipeline with Quix Streams and Quix Cloud in under ten minutes.
Start building your stream processing pipeline locally on the command line with Quix Streams.

[Quix Cloud Quickstart :octicons-arrow-right-24:](../quix-cloud/quickstart.md)
[Install Quix Streams :octicons-arrow-right-24:](./install.md)

</div>
</div>
Binary file added docs/images/quix-streams-requirements.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
17 changes: 17 additions & 0 deletions docs/javascripts/runllm-widget.js
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
document.addEventListener("DOMContentLoaded", function() {
var script = document.createElement('script');
script.defer = true;
script.type = 'module';
script.id = 'runllm-widget-script';
script.src = 'https://cdn.jsdelivr.net/npm/@runllm/search-widget@stable/dist/run-llm-search-widget.es.js';
script.setAttribute('version', 'stable');
script.setAttribute('runllm-preset', 'mkdocs');
script.setAttribute('runllm-server-address', 'https://api.runllm.com');
script.setAttribute('runllm-assistant-id', '111');
script.setAttribute('runllm-position', 'BOTTOM_RIGHT');
script.setAttribute('runllm-keyboard-shortcut', 'Mod+j');
script.setAttribute('runllm-slack-community-url', 'https://quix.io/slack-invite');
script.setAttribute('runllm-name', 'RunLLM');

document.head.appendChild(script);
});
11 changes: 2 additions & 9 deletions docs/kb/glossary.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,12 +14,6 @@ Applications in Quix exist inside the Git branch associated with an [environment

Read more about [applications](../create/overview.md).

## Binary data

Quix also supports any binary blob data.

With this data you can stream, process and store any type of audio, image, video or lidar data, or anything that isn’t supported with time series, event, or metadata types.

## Code Samples

Quix contains a large number of [open source](https://github.com/quixio/quix-samples){target=_blank} Code Samples. You can use these to quickly build out your stream processing pipeline. Generally the code samples are divided into three main categories: source, transform, destination. You can access the Code Samples from within the UI by using the navigation menu as show here:
Expand Down Expand Up @@ -48,11 +42,10 @@ Read more about [data ingestion](../develop/integrate-data/overview.md).

## Data types

Quix supports time series data, events, metadata, and blobs with the following data types:
Quix supports time series data, events and metadata with the following data types:

* Numeric (double precision)
* String (UTF-8)
* Binary data (blobs)

## Deployment

Expand Down Expand Up @@ -194,7 +187,7 @@ A type of [connector](../connectors/index.md) where data is published to a Quix

## Stream

A stream is a collection of data (time series data, events, binary blobs and metadata) that belong to a single session of a single source. For example:
A stream is a collection of data (time series data, events and metadata) that belong to a single session of a single source. For example:

* One journey for one car
* One game session for one player
Expand Down
2 changes: 1 addition & 1 deletion docs/quix-cloud/quickstart.md
Original file line number Diff line number Diff line change
Expand Up @@ -85,7 +85,7 @@ You use the `psutil` module to retrieve the CPU load on your laptop.

## Get your SDK token

To obtain your token, go to `Settings` in your default environment, and then click on the `APIs and tokens` tab. You can obtain the `Streaming Token` from there.
To obtain your token, go to `Settings` in your default environment, and then click on the `APIs and tokens` tab. You can obtain the Streaming Token (SDK Token) from there.

## Set your token

Expand Down
1 change: 0 additions & 1 deletion docs/tutorials/clickstream/clickstream-producer.md
Original file line number Diff line number Diff line change
Expand Up @@ -55,7 +55,6 @@ If you look at the messages in the `Messages` view, you'll see data has the foll
"VD55179433"
]
},
"BinaryValues": {},
"TagValues": {}
}
```
Expand Down
1 change: 0 additions & 1 deletion docs/tutorials/clickstream/data-enrichment.md
Original file line number Diff line number Diff line change
Expand Up @@ -58,7 +58,6 @@ The enriched data format:
"F"
]
},
"BinaryValues": {},
"TagValues": {}
}
```
Expand Down
1 change: 0 additions & 1 deletion docs/tutorials/computer-vision/add-service.md
Original file line number Diff line number Diff line change
Expand Up @@ -126,7 +126,6 @@ To create the transform:
"iVBOR/snip/QmCC"
]
},
"BinaryValues": {},
"TagValues": {
"parent_streamId": [
"JamCams_00002.00820"
Expand Down
5 changes: 0 additions & 5 deletions docs/tutorials/computer-vision/object-detection.md
Original file line number Diff line number Diff line change
Expand Up @@ -60,11 +60,6 @@ Objects are detected in the frame by the YOLOv8 code. Data is published to the o
]
},
"StringValues": {},
"BinaryValues": {
"image": [
"(Binary of 152.47 KB)"
]
},
"TagValues": {}
}
```
Expand Down
1 change: 0 additions & 1 deletion docs/tutorials/computer-vision/other-services.md
Original file line number Diff line number Diff line change
Expand Up @@ -125,7 +125,6 @@ The max vehicles service takes the total vehicle count and finds the maximum val
]
},
"StringValues": {},
"BinaryValues": {},
"TagValues": {
"window_start": [
"2023-09-06 12:08:12.394372"
Expand Down
1 change: 0 additions & 1 deletion docs/tutorials/computer-vision/web-ui.md
Original file line number Diff line number Diff line change
Expand Up @@ -101,7 +101,6 @@ The data read from the topic is as follows:
"iVBO…to/v37HG18UyZ1Qz/fby/<snipped>+yXUGc5UVWZfIHnX0iqM6aEAAAAASUVORK5CYII="
]
},
"BinaryValues": {},
"TagValues": {
"parent_streamId": [
"JamCams_00001.02500"
Expand Down
Loading
Loading