v1.18.0

Quick Start

Visit the Brim Data download page to find the package for your platform.

Zed is distributed as a TGZ/ZIP file of command line executables for each supported platform. To install, unpack with with the appropriate utility for your platform. For example, on Linux:

curl -OL https://github.com/brimdata/zed/releases/download/v1.18.0/zed-v1.18.0.linux-amd64.tar.gz
tar xzvf zed-v1.18.0.linux-amd64.tar.gz

If you've installed the Zui desktop app and want to work with its Zed lake from the command line, we recommend using the Zed executables included with the app to ensure compatibility. See this Zui docs article for their location.

Release Notes

• Improve the error message shown to a user when a zed command is run but there's no pool/branch set for use (#5198)
• Improve the performance of the load operator by removing an unnecessary/inefficient merge (#5200)
• Improve the sort operator to allow different ordering for each key (#5203, #5262)
• Update the Zeek reference shaper docs to incorporate changes for Zeek v7.0.0 logs (#5212)
• Update the summarize operator docs to show the use of by without an aggregate function (#5216)
• Update the grok function docs with additional examples and guidance (#5243)
• Update the Lateral Subquery docs with an emphasis on when primitive values or arrays are returned by Lateral Expressions (#5264)
• The terms "pipeline" and "branch" are now used throughout the Zed docs instead of "dataflow" and "leg" (#5272)
• Add docs for lake output format and zed ls (#5187)
• Add docs for the top operator (#5276)
• Add fluentd integration docs (#5190, #5195)
• Add a strftime function to format time values into strings (#5197, #5204)
• Add a DATESTAMP_ISO8601 pattern for use with the grok function (#5232)
• Fix an issue where CSV files without a final newline could not be read (#5185)
• Fix an issue where comparisons against union values produced incorrect results (#5210)
• Fix an issue where concurrent Zed lake operations could cause a service crash (#5279)

v1.17.0

Quick Start

Visit the Brim Data download page to find the package for your platform.

Zed is distributed as a TGZ/ZIP file of command line executables for each supported platform. To install, unpack with with the appropriate utility for your platform. For example, on Linux:

curl -OL https://github.com/brimdata/zed/releases/download/v1.17.0/zed-v1.17.0.linux-amd64.tar.gz
tar xzvf zed-v1.17.0.linux-amd64.tar.gz

If you've installed the Zui desktop app and want to work with its Zed lake from the command line, we recommend using the Zed executables included with the app to ensure compatibility. See this Zui docs article for their location.

Release Notes

• Improve the performance of multi-pool searches (e.g., from * | "MyFilter") (#5174)
• Reduce the amount of memory consumed by the merge operator and merge-dependent operations, such as compaction (#5171)
• Add the -pool flag to zed manage (#5164)
• Fix an issue where the lake API was not providing query descriptions for Zed programs that contain scopes (#5152)
• Fix an issue where attempts to use the load operator in zq caused a panic (#5162)
• Fix a parser issue with collisions between the names of user-defined operators and functions and some built-in operators (#5161)
• Fix an issue where using null values in math caused a panic (#5163)

v1.16.0

Highlights

For a walk through the highlights, see the June 2024 Release blog post.

Quick Start

Visit the Brim Data download page to find the package for your platform.

Zed is distributed as a TGZ/ZIP file of command line executables for each supported platform. To install, unpack with with the appropriate utility for your platform. For example, on Linux:

curl -OL https://github.com/brimdata/zed/releases/download/v1.16.0/zed-v1.16.0.linux-amd64.tar.gz
tar xzvf zed-v1.16.0.linux-amd64.tar.gz

If you've installed the Zui desktop app and want to work with its Zed lake from the command line, we recommend using the Zed executables included with the app to ensure compatibility. See this Zui docs article for their location.

Release Notes

• Improve ZNG scanning performance (#5101, #5103)
• Improve the error message shown when zq is invoked with a single argument that's not a valid query and doesn't contain a source (#5119)
• Update Zeek integration docs, including reference shaper changes for Zeek v6.2.0 data (#5106)
• String literals now use the "f-string" format f"{ <expr> }" instead of the previous ${ <expr> } (#5123)
• Prototype SQL support has been dropped from the Zed language (full SQL support is expected at a later date) (#5109)
• Empty objects and arrays in JSON output are now consistently printed on a single line (#5127)
• Enable colorized ZSON and JSON by default when output is to a terminal (#5114)
• Add JSON pretty print functionality (with color if supported by terminal) when activated via -J flag or setting format and the -pretty flag (#5096)
• Add a Grafana integration doc that points to the GitHub repo for the Zed data source plugin for Grafana (#5141)
• Fix an issue where stateful expressions inside of lateral queries could generate incorrect results (#5069)
• Fix an issue where stateful expressions inside user-defined functions could generate incorrect results (#5093)
• Fix an issue where the Go library examples failed to compile and run (#5095, #5147)

v1.15.0

Quick Start

Visit the Brim Data download page to find the package for your platform.

Zed is distributed as a TGZ/ZIP file of command line executables for each supported platform. To install, unpack with with the appropriate utility for your platform. For example, on Linux:

curl -OL https://github.com/brimdata/zed/releases/download/v1.15.0/zed-v1.15.0.linux-amd64.tar.gz
tar xzvf zed-v1.15.0.linux-amd64.tar.gz

If you've installed the Zui desktop app and want to work with its Zed lake from the command line, we recommend using the Zed executables included with the app to ensure compatibility. See this Zui docs article for their location.

Release Notes

• Improve the error message when reading NDJSON data with an incomplete last line (#5055)
• Improve the error message when math operators are applied to complex types (e.g., attempting to concatenate arrays with +) (#5059)
• Improve the error message when zq is called with a single argument that's neither a file nor a valid Zed query (#5053)
• Increase the buffer size for line input format to 25 MB (#5045, #5048)
• The body of a user-defined operator is now a scope that can include locally-defined statements (#5074)
• The nameof() function now supports type values (#5081)
• Fix an issue where yield inside a switch inside an over caused a panic (#5058)
• Fix an issue where accessing a variable inside a switch inside an over inside a switch caused a panic (#5080)
• Fix an issue where using over in an expression context caused a panic (#5079)
• Fix an issue where math and join matches involving float16 and float32 types could yield incorrect results (#5086)

v1.14.0

Quick Start

Visit the Brim Data download page to find the package for your platform.

Zed is distributed as a TGZ/ZIP file of command line executables for each supported platform. To install, unpack with with the appropriate utility for your platform. For example, on Linux:

curl -OL https://github.com/brimdata/zed/releases/download/v1.14.0/zed-v1.14.0.linux-amd64.tar.gz
tar xzvf zed-v1.14.0.linux-amd64.tar.gz

If you've installed the Zui desktop app and want to work with its Zed lake from the command line, we recommend using the Zed executables included with the app to ensure compatibility. See this Zui docs article for their location.

Release Notes

• Add the -manage flag to zed serve to have the Zed service process initiate maintenance tasks on a regular interval (#5017)
• Fix an issue where the Python client would not allow loading to a pool with / in its name (#5020)
• Fix an issue where pools with KSUID-like names could not be accessed by name (#5019)
• Fix a reference counting issue that could cause a Zed service panic (#5029, #5030)

v1.13.0

Quick Start

Visit the Brim Data download page to find the package for your platform.

Zed is distributed as a TGZ/ZIP file of command line executables for each supported platform. To install, unpack with with the appropriate utility for your platform. For example, on Linux:

curl -OL https://github.com/brimdata/zed/releases/download/v1.13.0/zed-v1.13.0.linux-amd64.tar.gz
tar xzvf zed-v1.13.0.linux-amd64.tar.gz

If you've installed the Zui desktop app and want to work with its Zed lake from the command line, we recommend using the Zed executables included with the app to ensure compatibility. See this Zui docs article for their location.

Release Notes

• Improve the error message when zed manage -monitor is attempted on a local lake (#4979)
• The zed serve log now includes version, storage root, and auth info at startup (#4988)
• Add docs for the zed manage command to compact data for improved performance (#4961)
• Add the ability to cast to Zed's type type (#4980, #4985)
• Add the ability to yield a Zed error literal (#4998)
• Fix an issue with accessing values inside complex literals (#4953)
• Fix an issue where cast of an empty string to a duration value incorrectly yielded 0s (#4965)
• Fix an issue where a zed vacuum on a large amount of data could crash the Zed service (#4974)
• Fix an issue where some IPv6 values of Zed's net type were not parsed correctly in Zed queries (#4992)
• Fix an issue where output of certain union-typed values was not consistent (#4995)
• Fix an issue where parsing of type literals inside of type literals was incorrectly permitted (#4996)
• Fix an issue where the grok() function would panic when encountering optional fields (#5010)

v1.12.0

Quick Start

Visit the Brim Data download page to find the package for your platform.

Zed is distributed as a TGZ/ZIP file of command line executables for each supported platform. To install, unpack with with the appropriate utility for your platform. For example, on Linux:

curl -OL https://github.com/brimdata/zed/releases/download/v1.12.0/zed-v1.12.0.linux-amd64.tar.gz
tar xzvf zed-v1.12.0.linux-amd64.tar.gz

If you've installed the Zui desktop app and want to work with its Zed lake from the command line, we recommend using the Zed executables included with the app to ensure compatibility. See this Zui docs article for their location.

Release Notes

• Zed CSV output now handles records with the same field names but different types (#4889)
• The grep() function now accepts variables as pattern arguments (#4887)
• Prevent the creation of multi-key pools in Zed lakes (support for this will be added later) (#4903)
• Zed CLI help can now be invoked via --help and is printed to stdout instead of stderr (#4907)
• Symbols (e.g., const and type) may no longer be redefined within the same scope (#4930)
• Set types can now be sliced (#4939)
• Canceled client requests to the Zed lake API are now logged at info level without stack traces (#4947)
• Add support for TSV input/output (useful for spreadsheet data) (#4891, #4913, #4912)
• Add a grok() function for parsing text lines (such as logs) into records (#4827)
• Fix an issue where switch operators could not be chained back-to-back in a Zed pipeline (#4926)
• Fix a panic that occurred if the from operator was attempted in Zed run with zq (#4936)
• Fix an "invalid union tag" panic that could occur when using the collect() aggregate function (#4932)

v1.11.1

Quick Start

Visit the Brim Data download page to find the package for your platform.

Zed is distributed as a TGZ/ZIP file of command line executables for each supported platform. To install, unpack with with the appropriate utility for your platform. For example, on Linux:

curl -OL https://github.com/brimdata/zed/releases/download/v1.11.1/zed-v1.11.1.linux-amd64.tar.gz
tar xzvf zed-v1.11.1.linux-amd64.tar.gz

If you've installed the Zui desktop app and want to work with its Zed lake from the command line, we recommend using the Zed executables included with the app to ensure compatibility. See this Zui docs article for their location.

Release Notes

• Fix an issue where loading and querying certain data caused a panic (#4877)

v1.11.0

Quick Start

Visit the Brim Data download page to find the package for your platform.

Zed is distributed as a TGZ/ZIP file of command line executables for each supported platform. To install, unpack with with the appropriate utility for your platform. For example, on Linux:

curl -OL https://github.com/brimdata/zed/releases/download/v1.11.0/zed-v1.11.0.linux-amd64.tar.gz
tar xzvf zed-v1.11.0.linux-amd64.tar.gz

If you've installed the Zui desktop app and want to work with its Zed lake from the command line, we recommend using the Zed executables included with the app to ensure compatibility. See this Zui docs article for their location.

Release Notes

• Introduce new logic for the zed CLI command to locate the lake (#4758, #4787, #4811)
• Cast expressions now behave more like function calls (#4805)
• Reduce the amount of memory needed to store a Zed value (#4812)
• Add support for unicode in keywords and identifiers (#4799, #4796)
• Add support for dynamic field paths in "left-hand side" contexts with put, cut, and rename operators (#4795, #4802, #4832)
• Add a map() function that applies a function to each element of an array or set. To avoid a naming clash, the aggregate function previously called map() is now called collect_map() (#4806, #4856, #4860)
• Fix an issue where a record expression with duplicate fields caused a panic (#4789)
• Fix an issue where valid ZNG input might not be read successfully via auto-detection (#4790)
• Fix an issue where null values could cause join to produce incorrect output (#4801)
• Fix a zq issue where a call to a user-defined operator included via -I could fail (#4808)
• Fix an issue where running zed commands on a system with many CPU cores caused an internal error (#4826)
• Fix an encoding issue that caused different map values to be rendered the same in Zui (#4853)

v1.10.0

Quick Start

Visit the Brim Data download page to find the package for your platform.

Zed is distributed as a TGZ/ZIP file of command line executables for each supported platform. To install, unpack with with the appropriate utility for your platform. For example, on Linux:

curl -OL https://github.com/brimdata/zed/releases/download/v1.10.0/zed-v1.10.0.linux-amd64.tar.gz
tar xzvf zed-v1.10.0.linux-amd64.tar.gz

If you've installed the Zui desktop app and want to work with its Zed lake from the command line, we recommend using the Zed executables included with the app to ensure compatibility. See this Zui docs article for their location.

Release Notes

• Sorting is now performed automatically on join inputs when needed (explicit sort no longer required) (#4770)
• Various query performance improvements (#4736, #4737, #4739, #4740, #4783, #4785)
• join now works correctly when data inputs are sorted in descending order (#4767)
• Reduce memory consumption during delete -where operations (#4734)
• Fix a null-handling issue that caused incorrect query results after pool compaction (#4735, #4753)
• Allow writing of vectors when compacting objects in a pool (#4756, #4757)
• Ensure query runtime errors are logged and made available through a new Query Status lake API endpoint (#4763, #4765, #4766, #4769)
• Add an example to the where docs showing inverse containment logic (#4761)
• Add an example to the cut docs that includes setting a default value for a field (#4773, #4776)
• Boolean not and ! now both work the same in expressions and search expressions (#4768)
• The zed command now returns a hint mentioning init if no lake exists at the expected path (#4786)