Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update/clarify S3 gateway config notes #5390

Merged
merged 3 commits into from
Apr 17, 2023
Merged

Update/clarify S3 gateway config notes #5390

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
af6f042
Update/clarify S3 gateway config notes
Mar 6, 2023
612d94a
Move ssl note to new section
Mar 28, 2023
fd743d2
Refine presentation of s3_use_ssl
rmoff Apr 17, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 16 additions & 0 deletions docs/integrations/duckdb.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,15 +18,31 @@ Querying data in lakeFS from DuckDB is similar to querying data in S3 from DuckD

### Configure the lakeFS S3 Gateway endpoint

If not loaded already, install and load the HTTPFS extension:

```sql
INSTALL httpfs;
LOAD httpfs;
```

Then run the following to configure the connection.

```sql
SET s3_region='us-east-1';
SET s3_endpoint='lakefs.example.com';
SET s3_access_key_id='AKIAIOSFODNN7EXAMPLE';
SET s3_secret_access_key='wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY';
SET s3_url_style='path';

-- Uncomment in case the endpoint listen on non-secure, for example running lakeFS locally.
-- SET s3_use_ssl=false;
```

* `s3_endpoint` is the host (and port, if necessary) of your lakeFS server
* `s3_access_key_id` and `s3_secret_access_key` are the access credentials for your lakeFS user
* `s3_url_style` needs to be set to `path`
* `s3_region` is the S3 region on which your bucket resides. If local storage, or not S3, then just set it to `us-east-1`.

### Querying Data

Once configured, you can query data using the lakeFS S3 Gateway using the following URI pattern:
Expand Down