Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update to v4.1.0 alpha.4 #7

Closed
wants to merge 44 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
44 commits
Select commit Hold shift + click to select a range
323bc86
chore(arrow): Support WKT and WKB geoarrow encodings (v4.1) (#2798)
ibgreen Nov 21, 2023
207ff3f
Convert GetImageParameters to WMSGetMapParameters (#2799)
felixpalmer Nov 22, 2023
5a701cd
chore: update package.json keywords (#2797)
ibgreen Nov 22, 2023
54063a8
feat(flatgeobuf): Extract arrow compatible schema (#2801)
ibgreen Nov 22, 2023
81bf66e
feat(website): Add GeoArrow example (#2802)
ibgreen Nov 22, 2023
c50b76a
docs(las): Mark LAS v1.4 as not supported (#2804)
ibgreen Nov 25, 2023
c3d1ae9
chore(website): minor touches (#2805)
ibgreen Nov 25, 2023
32f1e28
feat(website): Add Shapefile and KML examples (#2806)
ibgreen Nov 26, 2023
2391140
chore(website): polish (#2807)
ibgreen Nov 26, 2023
617d83d
GLTF: inline emod function to remove loaders.gl/math dependency (#2808)
felixpalmer Nov 27, 2023
77f3c1c
chore(parquet): GeoParquetLoader, collect the parquet loader zoo in o…
ibgreen Nov 28, 2023
8a35c9a
fix(GeoArrow): handle tessellation error & improve mean centers (#2803)
lixun910 Nov 28, 2023
20ca6f9
chore: typescript 5.3 (#2810)
ibgreen Nov 29, 2023
a017cbd
chore: upgrade to vite 5 (#2812)
ibgreen Nov 29, 2023
358d23b
docs: fgb and tilejson docs, streamline fgbloader exports (#2811)
ibgreen Nov 29, 2023
bf60df8
fix(tile-converter): trailing slash Removing from path in i3s-server …
dariaterekhova-actionengine Nov 29, 2023
0884690
fix: wms example (#2814)
ibgreen Nov 29, 2023
b8faecf
feat: merge 4.1 dev into master (#2818)
dariaterekhova-actionengine Dec 1, 2023
6a4d3da
v4.1.0-alpha.1
dariaterekhova-actionengine Dec 5, 2023
b677f33
feat(arrow): Triangulate on worker (#2789)
ibgreen Dec 5, 2023
a248382
v4.1.0-alpha.2
ibgreen Dec 6, 2023
9f8593d
fix(crypto): Reuse of Hash instance failures (#2824)
ibgreen Dec 7, 2023
08eddf1
fix(crypto): crc32 algorithm fix (#2819)
dariaterekhova-actionengine Dec 7, 2023
c5ec864
feat(zip): Added append and truncate functionality (#2800)
dariaterekhova-actionengine Dec 7, 2023
f28f8f6
chore: ensure all Writers have an encode() method (#2826)
ibgreen Dec 7, 2023
36c07ab
chore: Start adopting SPDX license headers (#2828)
ibgreen Dec 8, 2023
61c23c3
fix: webpack bson bundling issue (#2831)
ibgreen Dec 8, 2023
5ea153d
fix(zip): Local file header generation implemented (#2832)
dariaterekhova-actionengine Dec 11, 2023
dcdc498
fix: Fix version injection (#2834)
ibgreen Dec 11, 2023
3a6cd8b
fix(json): Fix row-object and array-object shape inference (#2833)
ibgreen Dec 11, 2023
9b35787
fix(3d-tiles): Fix implicit tileset subtree parsing (#2823)
Kaapp Dec 11, 2023
e3d76c8
chore(deps): bump vite from 4.4.9 to 4.5.1 (#2822)
dependabot[bot] Dec 11, 2023
d726f52
fix(mvt): TileJSONLoader options.maxValues default (#2835)
ibgreen Dec 12, 2023
e8fc44b
feat(mvt): Add templateUrl etc to MVTSource. (#2837)
ibgreen Dec 12, 2023
b78075a
v4.1.0-alpha.3
ibgreen Dec 12, 2023
f682b5c
feat(GeoArrow): add optional delay between batches in parseArrowInBat…
lixun910 Dec 12, 2023
d8d3dc6
feat(geotiff): RGB GeoTIFFLoader (#2839)
giovannicimolin Dec 13, 2023
c924636
feat(geotiff): Fix GeoTIFFLoader (#2841)
ibgreen Dec 13, 2023
fb722ae
fix(loader-utils): Guard against infinite recursion (#2838)
ibgreen Dec 13, 2023
469be97
chore(website): Add I3S Building Scene Layer as a separate example (#…
maxkuznetsov-actionengine Dec 15, 2023
460e4ab
fix(3d-tiles): loadExplicitBitstream use offset+length to extract fro…
justinmanley Dec 15, 2023
cf08322
feat(zip): adding file to the end of zip archive implementation (#2842)
dariaterekhova-actionengine Dec 15, 2023
b18ba1d
v4.1.0-alpha.4
ibgreen Dec 15, 2023
ca8fd65
Update sensat/loaders.gl to v4.1.0-alpha.4.
justinmanley Dec 18, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
45 changes: 44 additions & 1 deletion CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,48 @@
# CHANGELOG for loaders.gl

## v4.1

### v4.1.0-alpha.3

- feat(mvt): Add templateUrl etc to MVTSource. (#2837)
- fix(mvt): TileJSONLoader options.maxValues default (#2835)
- chore(deps): bump vite from 4.4.9 to 4.5.1 (#2822)
- fix(3d-tiles): Fix implicit tileset subtree parsing (#2823)
- fix(json): Fix row-object and array-object shape inference (#2833)
- fix: Fix version injection (#2834)
- fix(zip): Local file header generation implemented (#2832)
- fix: webpack bson bundling issue (#2831)
- chore: Start adopting SPDX license headers (#2828)
- chore: ensure all Writers have an encode() method (#2826)
- feat(zip): Added append and truncate functionality (#2800)
- fix(crypto): crc32 algorithm fix (#2819)
- fix(crypto): Reuse of Hash instance failures (#2824)

### v4.1.0-alpha.2

- feat(arrow): Triangulate on worker (#2789)

### v4.1.0-alpha.1

- feat(zip): cd header and zip64 info generation implemented (#2792)
- fix: wms example (#2814)
- fix(tile-converter): trailing slash Removing from path in i3s-server (#2813)
- docs: fgb and tilejson docs, streamline fgbloader exports (#2811)
- chore: upgrade to vite 5 (#2812)
- chore: typescript 5.3 (#2810)
- fix(GeoArrow): handle tessellation error & improve mean centers (#2803)
- chore(parquet): GeoParquetLoader, collect the parquet loader zoo in one file (#2809)
- GLTF: inline emod function to remove loaders.gl/math dependency (#2808)
- chore(website): polish (#2807)
- feat(website): Add Shapefile and KML examples (#2806)
- chore(website): minor touches (#2805)
- docs(las): Mark LAS v1.4 as not supported (#2804)
- feat(website): Add GeoArrow example (#2802)
- feat(flatgeobuf): Extract arrow compatible schema (#2801)
- chore: update package.json keywords (#2797)
- Convert GetImageParameters to WMSGetMapParameters (#2799)
- chore(arrow): Support WKT and WKB geoarrow encodings (v4.1) (#2798)

## v4.0

### v4.0.4
Expand Down Expand Up @@ -2152,7 +2195,7 @@
- core: Fixes to `parse` (#345)
- docs: front page update
- core: Add error handling to `parse*` functions (#342)
- core: Name workers for debugger (#339)
- core: Name workers for easier debugging (#339)
- fix bug with read property match of undefined (#340) (#341)
- Fix tranformMatrix regression (#338)
- Add back DracoWorkerLoader (#337)
Expand Down
37 changes: 21 additions & 16 deletions babel.config.cjs
Original file line number Diff line number Diff line change
@@ -1,22 +1,27 @@
// @ts-ignore
const {getBabelConfig} = require('ocular-dev-tools/configuration');

module.exports = getBabelConfig({
const config = getBabelConfig({
react: true,
plugins: [
// inject __VERSION__ from package.json
'version-inline'
],
ignore: [
// Don't transpile workers, they are transpiled separately
'**/*.worker.js',
'**/workers/*.js',
// Don't transpile files in libs, we use this folder to store external,
// already transpiled and minified libraries and scripts.
// e.g. draco, basis, las-perf etc.
/src\/libs/,
// babel can't process .d.ts
/\.d\.ts$/
],
overrides: {
plugins: [
// inject __VERSION__ from package.json
'version-inline'
],
ignore: [
// Don't transpile workers, they are transpiled separately
'**/*.worker.js',
'**/workers/*.js',
// Don't transpile files in libs, we use this folder to store external,
// already transpiled and minified libraries and scripts.
// e.g. draco, basis, las-perf etc.
/src\/libs/,
// babel can't process .d.ts
/\.d\.ts$/
]
},
// Set to true to print the config to console.
debug: false
});

module.exports = config;
197 changes: 103 additions & 94 deletions docs/docs-sidebar.json
Original file line number Diff line number Diff line change
Expand Up @@ -9,100 +9,6 @@
"upgrade-guide"
]
},
{
"type": "category",
"label": "Developer Guide",
"items": [
{
"type": "category",
"label": "Basics",
"items": [
"developer-guide/using-loaders",
"developer-guide/using-writers",
"developer-guide/loader-categories",
"developer-guide/using-worker-loaders",
"developer-guide/using-streaming-loaders",
"developer-guide/node"
]
},
{
"type": "category",
"label": "Advanced Topics",
"items": [
"developer-guide/dependencies",
"developer-guide/creating-loaders-and-writers",
"developer-guide/composite-loaders",
"developer-guide/error-handling",
"developer-guide/dev-env"
]
},
{
"type": "category",
"label": "Concepts",
"items": [
"developer-guide/concepts/javascript-apis",
"developer-guide/concepts/binary-data",
"developer-guide/concepts/streaming",
"developer-guide/concepts/async-iterators",
"developer-guide/concepts/worker-threads"
]
}
]
},
{
"type": "category",
"label": "Tutorials",
"items": [
{
"type": "category",
"label": "I3S",
"items": [
"modules/i3s/recipes/building-scene-layer",
"modules/i3s/recipes/attribute-driven-colorization"
]
}
]
},
{
"type": "category",
"label": "Formats",
"items": [
"formats/README",
"modules/arrow/formats/arrow",
"modules/arrow/formats/geoarrow",
"modules/bson/formats/bson",
"modules/csv/formats/csv",
"modules/pcd/formats/pcd",
"modules/ply/formats/ply",
"modules/json/formats/geojson",
"modules/json/formats/geojson-geometry",
"modules/gltf/formats/glb",
"modules/gltf/formats/gltf",
"modules/geopackage/formats/geopackage",
"modules/kml/formats/kml",
"modules/kml/formats/gpx",
"modules/kml/formats/tcx",
"modules/las/formats/las",
"modules/mvt/formats/mvt",
"modules/mvt/formats/tilejson",
"modules/parquet/formats/parquet",
"modules/parquet/formats/geoparquet",
"modules/pmtiles/formats/pmtiles",
"modules/shapefile/formats/shapefile",
"modules/textures/formats/compressed-textures",
"modules/wms/formats/csw",
"modules/wms/formats/wms",
"modules/wms/formats/wmts",
"modules/wms/formats/wfs",
"modules/wms/formats/gml",
"modules/lerc/formats/lerc",
"modules/wkt/formats/wkt",
"modules/wkt/formats/wkb",
"modules/wkt/formats/wkt-crs",
"modules/xml/formats/xml",
"modules/zip/formats/zip"
]
},
{
"type": "category",
"label": "Loader Catalog",
Expand Down Expand Up @@ -131,13 +37,15 @@
"modules/3d-tiles/api-reference/cesium-ion-loader",
"modules/arrow/api-reference/arrow-loader",
"modules/arrow/api-reference/arrow-writer",
"modules/arrow/api-reference/geoarrow-loader",
"modules/bson/api-reference/bson-loader",
"modules/bson/api-reference/bson-writer",
"modules/csv/api-reference/csv-loader",
"modules/draco/api-reference/draco-loader",
"modules/draco/api-reference/draco-writer",
"modules/flatgeobuf/api-reference/flatgeobuf-loader",
"modules/geopackage/api-reference/geopackage-loader",
"modules/geotiff/api-reference/geotiff-loader",
"modules/gltf/api-reference/gltf-loader",
"modules/gltf/api-reference/gltf-writer",
"modules/gltf/api-reference/glb-loader",
Expand Down Expand Up @@ -184,6 +92,102 @@
"modules/zip/api-reference/zip-writer"
]
},
{
"type": "category",
"label": "Formats",
"items": [
"formats/README",
"modules/arrow/formats/arrow",
"modules/arrow/formats/geoarrow",
"modules/bson/formats/bson",
"modules/csv/formats/csv",
"modules/pcd/formats/pcd",
"modules/ply/formats/ply",
"modules/flatgeobuf/formats/flatgeobuf",
"modules/json/formats/geojson",
"modules/json/formats/geojson-geometry",
"modules/gltf/formats/glb",
"modules/gltf/formats/gltf",
"modules/geopackage/formats/geopackage",
"modules/geotiff/formats/geotiff",
"modules/kml/formats/kml",
"modules/kml/formats/gpx",
"modules/kml/formats/tcx",
"modules/las/formats/las",
"modules/mvt/formats/mvt",
"modules/mvt/formats/tilejson",
"modules/parquet/formats/parquet",
"modules/parquet/formats/geoparquet",
"modules/pmtiles/formats/pmtiles",
"modules/shapefile/formats/shapefile",
"modules/textures/formats/compressed-textures",
"modules/wms/formats/csw",
"modules/wms/formats/wms",
"modules/wms/formats/wmts",
"modules/wms/formats/wfs",
"modules/wms/formats/gml",
"modules/lerc/formats/lerc",
"modules/wkt/formats/wkt",
"modules/wkt/formats/wkb",
"modules/wkt/formats/wkt-crs",
"modules/xml/formats/xml",
"modules/zip/formats/zip"
]
},
{
"type": "category",
"label": "Developer Guide",
"items": [
{
"type": "category",
"label": "Basics",
"items": [
"developer-guide/using-loaders",
"developer-guide/using-writers",
"developer-guide/loader-categories",
"developer-guide/using-worker-loaders",
"developer-guide/using-streaming-loaders",
"developer-guide/node"
]
},
{
"type": "category",
"label": "Advanced Topics",
"items": [
"developer-guide/dependencies",
"developer-guide/creating-loaders-and-writers",
"developer-guide/composite-loaders",
"developer-guide/error-handling",
"developer-guide/dev-env"
]
},
{
"type": "category",
"label": "Concepts",
"items": [
"developer-guide/concepts/javascript-apis",
"developer-guide/concepts/binary-data",
"developer-guide/concepts/streaming",
"developer-guide/concepts/async-iterators",
"developer-guide/concepts/worker-threads"
]
}
]
},
{
"type": "category",
"label": "Tutorials",
"items": [
{
"type": "category",
"label": "I3S",
"items": [
"modules/i3s/recipes/building-scene-layer",
"modules/i3s/recipes/attribute-driven-colorization"
]
}
]
},
{
"type": "category",
"label": "Submodule API Reference",
Expand Down Expand Up @@ -275,6 +279,11 @@
"label": "@loaders.gl/draco",
"items": ["modules/draco/README"]
},
{
"type": "category",
"label": "@loaders.gl/geotiff",
"items": ["modules/geotiff/README"]
},
{
"type": "category",
"label": "@loaders.gl/gltf",
Expand Down
1 change: 1 addition & 0 deletions docs/modules/arrow/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,7 @@ npm install @loaders.gl/core @loaders.gl/arrow
| -------------------------------------------------------------------- |
| [`ArrowLoader`](/docs/modules/arrow/api-reference/arrow-loader) |
| [`ArrowWorkerLoader`](/docs/modules/arrow/api-reference/arrow-loader) |
| [`GeoArrowLoader`](/docs/modules/arrow/api-reference/geoarrow-loader) |

| Writer |
| -------------------------------------------------------------- |
Expand Down
2 changes: 0 additions & 2 deletions docs/modules/arrow/api-reference/arrow-loader.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,8 +2,6 @@

![arrow-logo](../images/apache-arrow-small.png)

> The Arrow loaders are still under development.

The `ArrowLoader` parses the Apache Arrow columnar table format.

| Loader | Characteristic |
Expand Down
33 changes: 33 additions & 0 deletions docs/modules/arrow/api-reference/geoarrow-loader.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
# GeoArrowLoader

![arrow-logo](../images/apache-arrow-small.png)

<p class="badges">
<img src="https://img.shields.io/badge/From-v4.1-blue.svg?style=flat-square" alt="From-v4.1" />
</p>

The `GeoArrowLoader` parses Apache Arrow columnar table format files, and looks for `GeoArrow` type extensions to parse geometries from the table.

| Loader | Characteristic |
| --------------------- | ------------------------------------------------------------------------- |
| File Format | [IPC: Encapsulated Message Format](https://arrow.apache.org/docs/format/Columnar.html#serialization-and-interprocess-communication-ipc) |
| Data Format | [Geometry Table](/docs/specifications/category-table) |
| File Extension | `.arrow` |
| File Type | Binary |
| Decoder Type | `load`, `parse`, `parseSync`, `parseInBatches` |
| Worker Thread Support | Yes |
| Streaming Support | Yes |

## Usage

```typescript
import {GeoArrowLoader} from '@loaders.gl/arrow';
import {load} from '@loaders.gl/core';

const data = await load(url, GeoArrowLoader, options);
```

## Options

| Option | Type | Default | Description |
| ------ | ---- | ------- | ----------- |
Loading