From 3835fee37ba7470922515eaabc52aa4f3e7814cb Mon Sep 17 00:00:00 2001 From: Elliezza Date: Fri, 3 May 2024 11:31:29 +0800 Subject: [PATCH 1/3] Include new posts --- docs/en/blog_post/20240503_OpenmldbRelease.md | 56 +++++++++++++++++++ docs/en/blog_post/index.rst | 4 +- docs/zh/blog_post/20240503_OpenmldbRelease.md | 43 ++++++++++++++ docs/zh/blog_post/index.rst | 4 +- 4 files changed, 105 insertions(+), 2 deletions(-) create mode 100644 docs/en/blog_post/20240503_OpenmldbRelease.md create mode 100644 docs/zh/blog_post/20240503_OpenmldbRelease.md diff --git a/docs/en/blog_post/20240503_OpenmldbRelease.md b/docs/en/blog_post/20240503_OpenmldbRelease.md new file mode 100644 index 00000000000..70465e50492 --- /dev/null +++ b/docs/en/blog_post/20240503_OpenmldbRelease.md @@ -0,0 +1,56 @@ +# OpenMLDB v0.9.0 Release: Major Upgrade in SQL Capabilities Covering the Entire Feature Servicing Process + +OpenMLDB has just released a new version v0.9.0, including SQL syntax extensions, MySQL protocol compatibility, TiDB storage support, online feature computation, feature signatures, and more. Among these, the most noteworthy features are the MySQL protocol and ANSI SQL compatibility, along with the extended SQL syntax capabilities. + +Firstly, MySQL protocol compatibility allows OpenMLDB users to access OpenMLDB clusters using any MySQL client, not limited to GUI applications like NaviCat or Sequal Ace but also Java JDBC MySQL Driver, Python SQLAlchemy, Go MySQL Driver, and various programming language SDKs. For more information, you can refer to “[**Ultra High-Performance Database OpenM(ysq)LDB: Seamless Compatibility with MySQL Protocol and Multi-Language MySQL Client**](https://openmldb.medium.com/ultra-high-performance-database-openm-ysq-ldb-seamless-compatibility-with-mysql-protocol-and-d3f60210feea)”. + +Secondly, the new version significantly expands SQL capabilities, especially implementing OpenMLDB’s unique request mode and stored procedure execution within standard SQL syntax. Compared to traditional SQL databases, OpenMLDB covers the entire machine learning process, including offline and online modes. In online mode, users can input sample data, and get feature results through SQL feature extraction. On the contrary, in the past, we needed to deploy SQL as a stored procedure through the `Deploy` command and then perform online feature computation through SDKs or HTTP interfaces. The new version adds `SELECT CONFIG` and `CALL` statements, allowing users to directly specify request mode and sample data in SQL to compute feature results, as shown below: + +``` +-- Execute online request mode query for action (10, "foo", timestamp(4000)) +SELECT id, count(val) over (partition by id order by ts rows between 10 preceding and current row) +FROM t1 +CONFIG (execute_mode = 'online', values = (10, "foo", timestamp(4000))) +``` +You can also use the ANSI SQL `CALL` statement to invoke stored procedures with sample rows as parameters, as shown below: + +``` +-- Execute online request mode query for action (10, "foo", timestamp(4000)) +DEPLOY window_features SELECT id, count(val) over (partition by id order by ts rows between 10 preceding and current row) +FROM t1; + +CALL window_features(10, "foo", timestamp(4000)) +``` +For detailed release notes, please refer to: [https://github.com/4paradigm/OpenMLDB/releases/tag/v0.9.0](https://github.com/4paradigm/OpenMLDB/releases/tag/v0.9.0) + +Please feel free to download and explore the latest release. Your feedback is highly valued and appreciated. We encourage you to share your thoughts and suggestions to help us improve and enhance the platform. Thank you for your support! + +## Release Date + +April 25, 2024 + +## Release Note + +[https://github.com/4paradigm/OpenMLDB/releases/tag/v0.9.0](https://github.com/4paradigm/OpenMLDB/releases/tag/v0.9.0) + +## Highlighted Features + +* Added support for the latest version of SQLAlchemy 2, seamlessly integrating with popular Python frameworks such as Pandas and Numpy. + +* Expanded support for more data backends, integrating TiDB’s distributed file storage capability with OpenMLDB’s high-performance in-memory feature computation capability. + +* Enhanced ANSI SQL support, fixed `first_value` semantics, supported `MAP` type and feature signatures, and added offline mode support for `INSERT` statements. + +* Added support for MySQL protocol, allowing access to OpenMLDB clusters using MySQL clients like NaviCat, Sequal Ace, and various MySQL SDKs for programming languages. + +* Extended SQL syntax support, enabling online feature computation directly through `SELECT CONFIG` or `CALL` statements. + +-------------------------------------------------------------------------------------------------------------- + +**For more information on OpenMLDB:** +* Official website: [https://openmldb.ai/](https://openmldb.ai/) +* GitHub: [https://github.com/4paradigm/OpenMLDB](https://github.com/4paradigm/OpenMLDB) +* Documentation: [https://openmldb.ai/docs/en/](https://openmldb.ai/docs/en/) +* Join us on [**Slack**](https://join.slack.com/t/openmldb/shared_invite/zt-ozu3llie-K~hn9Ss1GZcFW2~K_L5sMg)! + +> _This post is a re-post from [OpenMLDB Blogs](https://openmldb.medium.com/)._ diff --git a/docs/en/blog_post/index.rst b/docs/en/blog_post/index.rst index d3c1097677b..9a474e094cb 100644 --- a/docs/en/blog_post/index.rst +++ b/docs/en/blog_post/index.rst @@ -11,4 +11,6 @@ OpenMLDB Blogs Ultra High-Performance Database OpenM(ysq)LDB: Seamless Compatibility with MySQL Protocol and Multi-Language MySQL Client <20240322_Openmysqldb.md> - Comparative Analysis of Memory Consumption: OpenMLDB vs Redis Test Report <20240402_OpenmldbVsRedis.md> \ No newline at end of file + Comparative Analysis of Memory Consumption: OpenMLDB vs Redis Test Report <20240402_OpenmldbVsRedis.md> + + OpenMLDB v0.9.0 Release: Major Upgrade in SQL Capabilities Covering the Entire Feature Servicing Process <20240503_OpenmldbRelease.md> \ No newline at end of file diff --git a/docs/zh/blog_post/20240503_OpenmldbRelease.md b/docs/zh/blog_post/20240503_OpenmldbRelease.md new file mode 100644 index 00000000000..4c05469e780 --- /dev/null +++ b/docs/zh/blog_post/20240503_OpenmldbRelease.md @@ -0,0 +1,43 @@ +# OpenMLDB v0.9.0 发布：SQL 能力大升级覆盖特征上线全流程 + +## 发布日期 + +25 April 2024 + +## Release note + +[https://github.com/4paradigm/OpenMLDB/releases/tag/v0.9.0](https://github.com/4paradigm/OpenMLDB/releases/tag/v0.9.0) + + +## 亮点特性 +- 增加最新版 SQLAlchemy 2 的支持，无缝集成 Pandas 和 Numpy 等常用 Python 框架。 +- 支持更多数据后端，融合 TiDB 的分布式文件存储能力以及 OpenMLDB 内存高性能特征计算能力。 +- 完善 ANSI SQL 支持，修复 first_value 语义，支持 MAP 类型和特征签名，离线模式支持 INSERT 语句。 +- 支持 MySQL 协议，可用 NaviCat、Sequal Ace 及各种编程语言的 MySQL SDK 访问 OpenMLDB 集群。 +- 支持 SQL 语法拓展，通过 SELECT CONFIG 或 CALL 语句直接进行在线特征计算。 + + +社区朋友们大家好！OpenMLDB 正常发布了一个新的版本 v0.9.0，包含了 SQL 语法拓展、MySQL 协议兼容、TiDB 存储支持、在线执行特征计算、特征签名等功能，其中最值得关注和分享的就是对 MySQL 协议和 ANSI SQL 兼容的特性，以及本地拓展的 SQL 语法能力。 +首先 MySQL 协议兼容让 OpenMLDB 的用户，可以使用任意的 MySQL 客户端来访问 OpenMLDB 集群，不仅限于 NaviCat、Sequal Ace 等 GUI 应用，还可以使用 Java JDBC MySQL Driver、Python SQLAlchemy、Go MySQL Driver 等各种编程语言的 SDK。更多介绍可以参考 《超高性能数据库 OpenM(ysq)LDB：无缝兼容 MySQL 协议 和多语言 MySQL 客户端》 。 +其次新版本极大拓展了 SQL 的能力，尤其是在标准 SQL 语法上实现了 OpenMLDB 特有的请求模式和存储过程的执行。相比于传统的 SQL 数据库，OpenMLDB 覆盖机器学习的全流程，包含离线模式和在线模式，在线模式下支持用户传入单行样本数据，通过 SQL 特征抽取返回特征结果。过去我们需要先通过 Deploy 命令部署 SQL 成存储过程，然后通过 SDK 或 HTTP 接口进行在线特征计算。新版本加入了SELECT CONFIG 和 CALL 语句，用户在 SQL 中直接指定请求模式和请求样本就可以计算得到特征结果，示例如下。 + +``` +-- 执行请求行为 (10, "foo", timestamp(4000)) 的在线请求模式 query +SELECT id, count (val) over (partition by id order by ts rows between 10 preceding and current row) +FROM t1 +CONFIG (execute_mode = 'online', values = (10, "foo", timestamp (4000))) +``` + +也可以通过 ANSI SQL 的 CALL语句，以样本行作为参数传入进行存储过程的调用，示例如下。 + +``` +-- 执行请求行为 (10, "foo", timestamp(4000)) 的在线请求模式 query +DEPLOY window_features SELECT id, count (val) over (partition by id order by ts rows between 10 preceding and current row) +FROM t1; + + +CALL window_features(10, "foo", timestamp(4000)) +``` + +详细的 release note 参照： [https://github.com/4paradigm/OpenMLDB/releases/tag/v0.9.0](https://github.com/4paradigm/OpenMLDB/releases/tag/v0.9.0) +欢迎大家下载试用，提供意见。 \ No newline at end of file diff --git a/docs/zh/blog_post/index.rst b/docs/zh/blog_post/index.rst index ba6dea6b5de..2e4e22491e7 100644 --- a/docs/zh/blog_post/index.rst +++ b/docs/zh/blog_post/index.rst @@ -12,4 +12,6 @@ 超高性能数据库 OpenM(ysq)LDB：无缝兼容 MySQL 协议 和多语言 MySQL 客户端 <20240322_Openmysqldb.md> - OpenMLDB vs Redis 内存占用量测试报告 <20240402_OpenmldbVsRedis.md> \ No newline at end of file + OpenMLDB vs Redis 内存占用量测试报告 <20240402_OpenmldbVsRedis.md> + + OpenMLDB v0.9.0 发布：SQL 能力大升级覆盖特征上线全流程 <20240503_OpenmldbRelease.md> \ No newline at end of file From a0b052403c212e47ec2146adfc16bae21fb316ac Mon Sep 17 00:00:00 2001 From: Elliezza Date: Fri, 3 May 2024 12:04:08 +0800 Subject: [PATCH 2/3] update links --- docs/en/blog_post/20240503_OpenmldbRelease.md | 2 +- docs/zh/blog_post/20240503_OpenmldbRelease.md | 11 ++++++----- 2 files changed, 7 insertions(+), 6 deletions(-) diff --git a/docs/en/blog_post/20240503_OpenmldbRelease.md b/docs/en/blog_post/20240503_OpenmldbRelease.md index 70465e50492..adac57fa0c2 100644 --- a/docs/en/blog_post/20240503_OpenmldbRelease.md +++ b/docs/en/blog_post/20240503_OpenmldbRelease.md @@ -2,7 +2,7 @@ OpenMLDB has just released a new version v0.9.0, including SQL syntax extensions, MySQL protocol compatibility, TiDB storage support, online feature computation, feature signatures, and more. Among these, the most noteworthy features are the MySQL protocol and ANSI SQL compatibility, along with the extended SQL syntax capabilities. -Firstly, MySQL protocol compatibility allows OpenMLDB users to access OpenMLDB clusters using any MySQL client, not limited to GUI applications like NaviCat or Sequal Ace but also Java JDBC MySQL Driver, Python SQLAlchemy, Go MySQL Driver, and various programming language SDKs. For more information, you can refer to “[**Ultra High-Performance Database OpenM(ysq)LDB: Seamless Compatibility with MySQL Protocol and Multi-Language MySQL Client**](https://openmldb.medium.com/ultra-high-performance-database-openm-ysq-ldb-seamless-compatibility-with-mysql-protocol-and-d3f60210feea)”. +Firstly, MySQL protocol compatibility allows OpenMLDB users to access OpenMLDB clusters using any MySQL client, not limited to GUI applications like NaviCat or Sequal Ace but also Java JDBC MySQL Driver, Python SQLAlchemy, Go MySQL Driver, and various programming language SDKs. For more information, you can refer to "[**Ultra High-Performance Database OpenM(ysq)LDB: Seamless Compatibility with MySQL Protocol and Multi-Language MySQL Client**](20240322_Openmysqldb.md)". Secondly, the new version significantly expands SQL capabilities, especially implementing OpenMLDB’s unique request mode and stored procedure execution within standard SQL syntax. Compared to traditional SQL databases, OpenMLDB covers the entire machine learning process, including offline and online modes. In online mode, users can input sample data, and get feature results through SQL feature extraction. On the contrary, in the past, we needed to deploy SQL as a stored procedure through the `Deploy` command and then perform online feature computation through SDKs or HTTP interfaces. The new version adds `SELECT CONFIG` and `CALL` statements, allowing users to directly specify request mode and sample data in SQL to compute feature results, as shown below: diff --git a/docs/zh/blog_post/20240503_OpenmldbRelease.md b/docs/zh/blog_post/20240503_OpenmldbRelease.md index 4c05469e780..e2edfe23712 100644 --- a/docs/zh/blog_post/20240503_OpenmldbRelease.md +++ b/docs/zh/blog_post/20240503_OpenmldbRelease.md @@ -12,14 +12,15 @@ ## 亮点特性 - 增加最新版 SQLAlchemy 2 的支持，无缝集成 Pandas 和 Numpy 等常用 Python 框架。 - 支持更多数据后端，融合 TiDB 的分布式文件存储能力以及 OpenMLDB 内存高性能特征计算能力。 -- 完善 ANSI SQL 支持，修复 first_value 语义，支持 MAP 类型和特征签名，离线模式支持 INSERT 语句。 +- 完善 ANSI SQL 支持，修复 `first_value` 语义，支持 MAP 类型和特征签名，离线模式支持 `INSERT` 语句。 - 支持 MySQL 协议，可用 NaviCat、Sequal Ace 及各种编程语言的 MySQL SDK 访问 OpenMLDB 集群。 -- 支持 SQL 语法拓展，通过 SELECT CONFIG 或 CALL 语句直接进行在线特征计算。 +- 支持 SQL 语法拓展，通过 `SELECT CONFIG` 或 `CALL` 语句直接进行在线特征计算。 社区朋友们大家好！OpenMLDB 正常发布了一个新的版本 v0.9.0，包含了 SQL 语法拓展、MySQL 协议兼容、TiDB 存储支持、在线执行特征计算、特征签名等功能，其中最值得关注和分享的就是对 MySQL 协议和 ANSI SQL 兼容的特性，以及本地拓展的 SQL 语法能力。 -首先 MySQL 协议兼容让 OpenMLDB 的用户，可以使用任意的 MySQL 客户端来访问 OpenMLDB 集群，不仅限于 NaviCat、Sequal Ace 等 GUI 应用，还可以使用 Java JDBC MySQL Driver、Python SQLAlchemy、Go MySQL Driver 等各种编程语言的 SDK。更多介绍可以参考 《超高性能数据库 OpenM(ysq)LDB：无缝兼容 MySQL 协议 和多语言 MySQL 客户端》 。 -其次新版本极大拓展了 SQL 的能力，尤其是在标准 SQL 语法上实现了 OpenMLDB 特有的请求模式和存储过程的执行。相比于传统的 SQL 数据库，OpenMLDB 覆盖机器学习的全流程，包含离线模式和在线模式，在线模式下支持用户传入单行样本数据，通过 SQL 特征抽取返回特征结果。过去我们需要先通过 Deploy 命令部署 SQL 成存储过程，然后通过 SDK 或 HTTP 接口进行在线特征计算。新版本加入了SELECT CONFIG 和 CALL 语句，用户在 SQL 中直接指定请求模式和请求样本就可以计算得到特征结果，示例如下。 +首先 MySQL 协议兼容让 OpenMLDB 的用户，可以使用任意的 MySQL 客户端来访问 OpenMLDB 集群，不仅限于 NaviCat、Sequal Ace 等 GUI 应用，还可以使用 Java JDBC MySQL Driver、Python SQLAlchemy、Go MySQL Driver 等各种编程语言的 SDK。更多介绍可以参考 《[超高性能数据库 OpenM(ysq)LDB：无缝兼容 MySQL 协议 和多语言 MySQL 客户端](20240322_Openmysqldb.md)》 。 + +其次新版本极大拓展了 SQL 的能力，尤其是在标准 SQL 语法上实现了 OpenMLDB 特有的请求模式和存储过程的执行。相比于传统的 SQL 数据库，OpenMLDB 覆盖机器学习的全流程，包含离线模式和在线模式，在线模式下支持用户传入单行样本数据，通过 SQL 特征抽取返回特征结果。过去我们需要先通过 Deploy 命令部署 SQL 成存储过程，然后通过 SDK 或 HTTP 接口进行在线特征计算。新版本加入了 `SELECT CONFIG` 和 `CALL` 语句，用户在 SQL 中直接指定请求模式和请求样本就可以计算得到特征结果，示例如下。 ``` -- 执行请求行为 (10, "foo", timestamp(4000)) 的在线请求模式 query @@ -28,7 +29,7 @@ FROM t1 CONFIG (execute_mode = 'online', values = (10, "foo", timestamp (4000))) ``` -也可以通过 ANSI SQL 的 CALL语句，以样本行作为参数传入进行存储过程的调用，示例如下。 +也可以通过 ANSI SQL 的 `CALL`语句，以样本行作为参数传入进行存储过程的调用，示例如下。 ``` -- 执行请求行为 (10, "foo", timestamp(4000)) 的在线请求模式 query From 996241c6089b1a1924d4fa7b2cb49955d31801ef Mon Sep 17 00:00:00 2001 From: Elliezza Date: Fri, 3 May 2024 12:12:24 +0800 Subject: [PATCH 3/3] minor change --- docs/zh/blog_post/20240503_OpenmldbRelease.md | 3 +-- 1 file changed, 1 insertion(+), 2 deletions(-) diff --git a/docs/zh/blog_post/20240503_OpenmldbRelease.md b/docs/zh/blog_post/20240503_OpenmldbRelease.md index e2edfe23712..60cb65d3e39 100644 --- a/docs/zh/blog_post/20240503_OpenmldbRelease.md +++ b/docs/zh/blog_post/20240503_OpenmldbRelease.md @@ -20,7 +20,7 @@ 社区朋友们大家好！OpenMLDB 正常发布了一个新的版本 v0.9.0，包含了 SQL 语法拓展、MySQL 协议兼容、TiDB 存储支持、在线执行特征计算、特征签名等功能，其中最值得关注和分享的就是对 MySQL 协议和 ANSI SQL 兼容的特性，以及本地拓展的 SQL 语法能力。 首先 MySQL 协议兼容让 OpenMLDB 的用户，可以使用任意的 MySQL 客户端来访问 OpenMLDB 集群，不仅限于 NaviCat、Sequal Ace 等 GUI 应用，还可以使用 Java JDBC MySQL Driver、Python SQLAlchemy、Go MySQL Driver 等各种编程语言的 SDK。更多介绍可以参考 《[超高性能数据库 OpenM(ysq)LDB：无缝兼容 MySQL 协议 和多语言 MySQL 客户端](20240322_Openmysqldb.md)》 。 -其次新版本极大拓展了 SQL 的能力，尤其是在标准 SQL 语法上实现了 OpenMLDB 特有的请求模式和存储过程的执行。相比于传统的 SQL 数据库，OpenMLDB 覆盖机器学习的全流程，包含离线模式和在线模式，在线模式下支持用户传入单行样本数据，通过 SQL 特征抽取返回特征结果。过去我们需要先通过 Deploy 命令部署 SQL 成存储过程，然后通过 SDK 或 HTTP 接口进行在线特征计算。新版本加入了 `SELECT CONFIG` 和 `CALL` 语句，用户在 SQL 中直接指定请求模式和请求样本就可以计算得到特征结果，示例如下。 +其次新版本极大拓展了 SQL 的能力，尤其是在标准 SQL 语法上实现了 OpenMLDB 特有的请求模式和存储过程的执行。相比于传统的 SQL 数据库，OpenMLDB 覆盖机器学习的全流程，包含离线模式和在线模式，在线模式下支持用户传入单行样本数据，通过 SQL 特征抽取返回特征结果。过去我们需要先通过 `Deploy` 命令部署 SQL 成存储过程，然后通过 SDK 或 HTTP 接口进行在线特征计算。新版本加入了 `SELECT CONFIG` 和 `CALL` 语句，用户在 SQL 中直接指定请求模式和请求样本就可以计算得到特征结果，示例如下。 ``` -- 执行请求行为 (10, "foo", timestamp(4000)) 的在线请求模式 query @@ -36,7 +36,6 @@ CONFIG (execute_mode = 'online', values = (10, "foo", timestamp (4000))) DEPLOY window_features SELECT id, count (val) over (partition by id order by ts rows between 10 preceding and current row) FROM t1; - CALL window_features(10, "foo", timestamp(4000)) ```