0.5.1 Release

0.5.1 Release
更新日期：2024年11月22日
中文版

更新

• State Backend接口标准化
• 优化Quick Start体验
• 新增Demo Case

修复

• Rust CStore指定rustc依赖版本为1.73.0
• DSL增加数据验证逻辑以优化Demo Case卡住问题
• 框架修复编译warning问题

文档

• 添加社区治理指南
• 优化Quick Start文档

英文版
Main Improvements

• Standardization of the State Backend interface
• Optimization of the Quick Start experience
• Addition of new Demo Cases

Fix

• Specified rustc dependency version as 1.73.0 for Rust CStore
• Added data validation logic in DSL to address the issue of Demo Cases getting stuck
• Resolved compilation warning issues in the framework

Refine Docs

• Added a Community Governance Guide
• Improved the Quick Start documentation

0.5 Release

0.5 Release
更新日期：2024年5月28日
中文版

更新

• Console支持OLAP图即席查询
• Console支持基于LLM大模型的自然语言图分析
• Console支持一键删除图
• Console支持数据集成功能
• 框架支持大模型系列接口
• 框架支持本地环境下Dashboard
• 框架支持K8S高可用选举master机制
• 框架调整K8S运行管理机制
• 框架支持调度器监听事件
• 框架增加redis服务发现支持
• 框架优化JDBC协议
• 框架集群ID增加随机前缀
• 框架支持上报k8s部分事件
• DSL支持Pulsar
• DSL增加三角计数UDGA图算法
• DSL支持部分字符串函数处理BinaryString类型
• DSL kafka连接器支持Json数据格式

修复

• 框架修复运行时部分场景批次windowId未更新问题
• 框架修复k8s container初始化参数错误
• 框架修复退出后资源未能全部释放问题
• DSL修复自定义算法中载入state的错误
• DSL修复内存图冗余的meta信息保存
• DSL修复批模式下图版本不能正确持久化问题
• DSL修复kafka不能从最新下标消费问题
• 存储修复OSS连接超时阻塞问题
• 修复socket.sh中的报错
• log4j-core升至2.17.1
• opendal升至0.43.0

文档

• 优化用户文档，README
• 增加合作伙伴
• 调整联系方式
• K8S operator文档中增加KHOP作为快速体验用例

英文版
Main Improvements

• Console now supports OLAP graph ad-hoc queries.
• Console now supports natural language graph analysis based on the LLM.
• Console now supports one-click deletion of graphs.
• Console now supports data integration.
• Framework now supports a large model series of interfaces.
• Framework now supports Dashboard in local environments.
• Framework introduces K8S high availability master election mechanism.
• Framework adjusts K8S runtime management mechanism.
• Framework now supports scheduler event listening.
• Framework adds Redis service discovery support.
• Framework optimizes JDBC protocol.
• Framework cluster ID now includes a random prefix.
• Framework now supports reporting of certain K8S events.
• DSL now supports Pulsar.
• DSL introduces a Triangle Counting UDGA graph algorithm.
• DSL now supports partial string functions for handling BinaryString types.
• DSL Kafka connector now supports JSON data format.

Fix

• Framework fixes runtime scenarios where batch windowId was not updated.
• Framework fixes errors with K8S container initialization parameters.
• Framework fixes issues where resources were not fully released upon exit.
• DSL fixes errors loading state in custom algorithms.
• DSL fixes the issue of redundant meta information saved in memory graphs.
• DSL fixes the issue where graph versions could not be correctly persisted in batch mode.
• DSL fixes the issue with Kafka not consuming from the latest index.
• State fixes OSS connection timeout blocking issue.
• Fixes errors in socket.sh.
• Upgrades log4j-core to 2.17.1.
• Upgrades opendal to 0.43.0.

Refine Docs

• Optimizes user documentation, README.
• Adds partners.
• Adjusts contact information.
• Adds KHOP as a quick experience case in the K8S operator documentation.

0.4 Release

Main Improvements

• Add a new graph state：self-developed Rust language engine CStore
• Framework supports graph OLAP
• Framework switched to BRPC
• Framework supports K8S Operator for quick job submission
• Framework added job-level Dashboard
• Framework optimized FO in K8S environment
• Framework added support for Prometheus as monitoring metrics storage
• Framework added job lifecycle supervisor
• Framework added RESTful API on Master to expose runtime metrics
• Framework supports heartbeat check and registration for Driver and containers after FO
• Framework optimized heartbeat detection mechanism
• DSL supports complex multi-level SQL Join queries automatically converted to graph queries
• DSL supports different names for vertex and edge metadata fields in the graph
• DSL supports incremental graph algorithms
• DSL supports getting graph Schema in graph algorithm implementations
• DSL trim function supports BinaryString type
• DSL supports partial SQL filter conditions pushed into graph matching execution, and supports merging multiple filter conditions
• DSL supports Date type
• Console supports uploading custom plugin packages
• Console added plugin manager
• File Connector added S3 support
• Added built-in KHop UDGA implementation

Bug Fix

• Framework fixed issues caused by incorrect BRPC configuration
• Framework fixed issues with failed asynchronous RPC
• Framework fixed job Meta information save conflicts in multi-threading
• Framework fixed errors in execution plan generation caused by multiple graph queries
• Console fixed jar package upload file format validation exception
• Console fixed redis plugin issues
• DSL fixed several issues with the implementation logic of loopUtil
• DSL fixed NPE issues caused by Null as a literal
• DSL fixed numeric truncation errors caused by type conversion and optimized the implementation of Cast
• Docker Image packaging script fixed copy error issues

Refine Docs

• Optimize the project introduction
• Add quick guide content to the documentation entry page
• Add QuickStart for quick submission using K8S Operator

中文版

更新

• 存储新增自研Rust语言引擎CStore
• Framework支持图OLAP
• Framework更换BRPC
• Framework支持K8S Operator快速提交
• Framework增加作业级别的Dashboard
• Framework优化K8S环境中的FO
• Framework增加支持Prometheus作为监控指标存储
• Framework增加作业全生命周期监视
• Framework在Master上增加RESTful API以公开运行时指标
• Framework在FO后，Driver和容器支持检查并注册心跳
• Framework优化了心跳探测机制
• DSL支持复杂多级的SQL Join查询自动转图查询处理
• DSL支持图中点边元数据类型不同名称
• DSL支持增量图算法
• DSL支持图算法获取图Schema
• DSL trim函数支持BinaryString类型
• DSL支持部分SQL过滤条件推入图匹配执行，支持合并多个过滤条件
• DSL 支持Date数据类型
• Console支持上传自定义插件包
• Console增加插件管理器
• 文件Connector增加S3支持
• 增加内置KHop的UDGA实现

修复

• 框架修复BRPC配置错误导致的问题
• 框架修复异步RPC失败的问题
• 框架修复多线程下作业Meta信息保存冲突问题
• 框架修复多个图查询导致的执行计划生成错误问题
• 前端修复jar包上传文件格式验证异常的问题
• 前端修复redis插件问题
• DSL修复loopUtil实现逻辑的若干问题
• DSL修复Null作为字面量导致的NPE问题
• DSL修复类型转换导致的数值截断错误问题，优化Cast的实现
• 镜像打包脚本修复copy错误的问题

文档

• 优化项目简介
• 增加文档入口页快速指引内容
• 增加K8S Operator快速提交的QuickStart

0.3 Release

Main Improvements

• Supports automatic conversion of partial SQL Join statements based on graph definition to GQL execution
• Graph definition supports edge association endpoint types
• Supports reading CSV format files
• Added configuration to convert full-graph traversal to streaming traversal
• DSL supports termination of graph computation based on global aggregation
• Framework supports graph computation with global aggregation
• Framework supports asynchronous event submission
• Framework supports asynchronous shuffle
• Encoder supports Tuple/Triple types
• Console interface supports internationalization
• Console supports task reset
• Console updates vertex and edge management module
• Supports distinct deduplication in stream data
• Simplifies static and dynamic graph definition in DSL
• Local file writing adds built-in writer
• Supports HBase Connector
• Optimizes path merging and parameterized invocation logic in DSL runtime

Bug Fix

• Fixed issue with checkpoint not being performed for individual window jobs
• Fixed NPE error when UDGA encounters non-existing vertices
• Fixed yarn build error when packaging geaflow-web image
• Fixed error of JDBC connector not finding plugin type
• Fixed precision error when casting String to numeric types
• Fixed algorithm logic in built-in PageRank test

Refine Docs

• Updated quick start documentation
• Updated simplified performance report
• Added internationalized interface screenshots to documentation
• Added GeaFlow overall architecture diagram
• Added link navigations in Readme

0.2 Release

Main Improvements

• Support run user defined algorithm on dynamic graphs
• Instr/IndexOf support BinaryString as input parameter
• Support JDBC connector
• Concat/ConcatWs support BinaryString as input parameter
• Support create temporary table/graph
• Support config node/java process port
• Support create function in console
• Support hudi connector
• Support type registration optimization for Kryo serializer
• Support HBase Sink Connector
• Support finish in UDGA interface
• Add api job backend module

Bug Fix

• Fix exception when running graph algorithm after insert data to graph
• Fix compile on windows
• Fix kafka start time parse exception
• Fix Result Error in PageRank and SSSP
• Fix status to be finished when batch task completed
• Fix Oss plugin not found when using oss as the graph storage
• Fix shuffle timer leakage
• Fix traversal operator parallelism