Bump explorer from 0.6.1 to 0.8.0

[dependabot]

Bumps explorer from 0.6.1 to 0.8.0.

Release notes

Sourced from explorer's releases.

v0.8.0

Added

• Add explode/2 to Explorer.DataFrame. This function is useful to expand the contents of a {:list, inner_dtype} series into a "inner_dtype" series.

• Add the new series functions all?/1 and any?/1, to work with boolean series.

• Add support for the "struct" dtype. This new dtype represents the struct dtype from Polars/Arrow.

• Add map/2 and map_with/2 to the Explorer.Series module. This change enables the usage of the Explore.Query features in a series.

• Add sort_by/2 and sort_with/2 to the Explorer.Series module. This change enables the usage of the lazy computations and the Explorer.Query module.

• Add unnest/2 to Explorer.DataFrame. It works by taking the fields of a "struct" - the new dtype - and transform them into columns.

• Add pairwise correlation - Explorer.DataFrame.correlation/2 - to calculate the correlation between numeric columns inside a data frame.

• Add pairwise covariance - Explorer.DataFrame.covariance/2 - to calculate the covariance between numeric columns inside a data frame.

• Add support for more integer dtypes. This change introduces new signed and unsigned integer dtypes:

  • {:s, 8}, {:s, 16}, {:s, 32}
  • {:u, 8}, {:u, 16}, {:u, 32}, {:u, 64}.

  The existing :integer dtype is now represented as {:s, 64}, and it's still the default dtype for integers. But series and data frames can now work with the new dtypes. Short names for these new dtypes can be used in functions like Explorer.Series.from_list/2. For example, {:u, 32} can be represented with the atom :u32.

  This may bring more interoperability with Nx, and with Arrow related things, like ADBC and Parquet.

• Add ewm_standard_deviation/2 and ewm_variance/2 to Explorer.Series. They calculate the "exponentially weighted moving" variance and standard deviation.

• Add support for :skip_rows_after_header option for the CSV reader functions.

• Support {:list, numeric_dtype} for Explorer.Series.frequencies/1.

• Support pins in cond, inside the context of Explorer.Query.

• Introduce the :null dtype. This is a special dtype from Polars and Apache Arrow to represent "all null" series.

• Add Explorer.DataFrame.transpose/2 to transpose a data frame.

Changed

• Rename the functions related to sorting/arranging of the Explorer.DataFrame. Now arrange_with is named sort_with, and arrange is sort_by.

  The sort_by/3 is a macro and it is going to work using the Explorer.Query module. On the other side, the sort_with/2 uses a callback function.

• Remove unnecessary casts to {:s, 64} now that we support more integer dtypes.

... (truncated)

Changelog

Sourced from explorer's changelog.

[v0.8.0] - 2024-01-20

Added

• Add explode/2 to Explorer.DataFrame. This function is useful to expand the contents of a {:list, inner_dtype} series into a "inner_dtype" series.

• Add the new series functions all?/1 and any?/1, to work with boolean series.

• Add support for the "struct" dtype. This new dtype represents the struct dtype from Polars/Arrow.

• Add map/2 and map_with/2 to the Explorer.Series module. This change enables the usage of the Explore.Query features in a series.

• Add sort_by/2 and sort_with/2 to the Explorer.Series module. This change enables the usage of the lazy computations and the Explorer.Query module.

• Add unnest/2 to Explorer.DataFrame. It works by taking the fields of a "struct" - the new dtype - and transform them into columns.

• Add pairwise correlation - Explorer.DataFrame.correlation/2 - to calculate the correlation between numeric columns inside a data frame.

• Add pairwise covariance - Explorer.DataFrame.covariance/2 - to calculate the covariance between numeric columns inside a data frame.

• Add support for more integer dtypes. This change introduces new signed and unsigned integer dtypes:

  • {:s, 8}, {:s, 16}, {:s, 32}
  • {:u, 8}, {:u, 16}, {:u, 32}, {:u, 64}.

  The existing :integer dtype is now represented as {:s, 64}, and it's still the default dtype for integers. But series and data frames can now work with the new dtypes. Short names for these new dtypes can be used in functions like Explorer.Series.from_list/2. For example, {:u, 32} can be represented with the atom :u32.

  This may bring more interoperability with Nx, and with Arrow related things, like ADBC and Parquet.

• Add ewm_standard_deviation/2 and ewm_variance/2 to Explorer.Series. They calculate the "exponentially weighted moving" variance and standard deviation.

• Add support for :skip_rows_after_header option for the CSV reader functions.

• Support {:list, numeric_dtype} for Explorer.Series.frequencies/1.

• Support pins in cond, inside the context of Explorer.Query.

... (truncated)

Commits

• e0e242b Release v0.8 (#834)
• dca030a Prepare change log for the upcoming v0.8 (#831)
• fa98081 Update Series.from_list/2 doc about nils (#832)
• 5bf9bab Fix functions with result/dtypes mismatch (#830)
• 2ecf0ff Improve documentation about encoding option (#793)
• 1e6f621 Bump h2 from 0.3.22 to 0.3.24 in /native/explorer (#829)
• ed7cdbb Improve coverage on concat_rows
• 84b14b4 Document :null dtype
• 9af7799 Improve docs
• e0dda8e Fix DF.concat_rows/2 to consider new numeric dtypes (#827)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[dependabot]

Superseded by #46.