…and participating in approvals (#2168)

* feat(collaboration): support database resource role (#1782)

* feat(database-owner):
1. Add the owner role to the database, supporting approval workflow to use the owner role of the database.
2. Add variables for integrating external approval.
such as:
database.owner.accounts
database.owner.ids
database.owner.names
database.name
environment.name
task.description
risk.level

2024-02-29

* feat(database-owner):
1. Add the owner role to the database, supporting approval workflow to use the owner role of the database.
2. Add variables for integrating external approval.
such as:
database.owner.accounts
database.owner.ids
database.owner.names
database.name
environment.name
task.description
risk.level

2024-02-29

* feat(database-owner):
1. Add the owner role to the database, supporting approval workflow to use the owner role of the database.
2. Add variables for integrating external approval.
such as:
database.owner.accounts
database.owner.ids
database.owner.names
database.name
environment.name
task.description
risk.level

2024-02-29

* feat(database-owner):
1. Add the owner role to the database, supporting approval workflow to use the owner role of the database.
2. Add variables for integrating external approval.
such as:
database.owner.accounts
database.owner.ids
database.owner.names
database.name
environment.name
task.description
risk.level
odc.task.url
3. Adjust the database permission request form, and split the form when applying for multiple databases.

2024-03-06

* feat(database-owner):
1. Add the owner role to the database, supporting approval workflow to use the owner role of the database.
2. Add variables for integrating external approval.
such as:
database.owner.accounts
database.owner.ids
database.owner.names
database.name
environment.name
task.description
risk.level
odc.task.url
3. Adjust the database permission request form, and split the form when applying for multiple databases.

2024-03-06

* feat(database-owner):
1. Add the owner role to the database, supporting approval workflow to use the owner role of the database.
2. Add variables for integrating external approval.
such as:
database.owner.accounts
database.owner.ids
database.owner.names
database.name
environment.name
task.description
risk.level
odc.task.url
3. Adjust the database permission request form, and split the form when applying for multiple databases.

2024-03-07

* feat(database-owner):
1. Add the owner role to the database, supporting approval workflow to use the owner role of the database.
2. Add variables for integrating external approval.
such as:
database.owner.accounts
database.owner.ids
database.owner.names
database.name
environment.name
task.description
risk.level
odc.task.url
3. Adjust the database permission request form, and split the form when applying for multiple databases.

2024-03-08

* feat(database-owner):
1. Add the owner role to the database, supporting approval workflow to use the owner role of the database.
2. Add variables for integrating external approval.
such as:
database.owner.accounts
database.owner.ids
database.owner.names
database.name
environment.name
task.description
risk.level
odc.task.url
3. Adjust the database permission request form, and split the form when applying for multiple databases.

2024-03-08

* feat(database-owner):
1. Add the owner role to the database, supporting approval workflow to use the owner role of the database.
2. Add variables for integrating external approval.
such as:
database.owner.accounts
database.owner.ids
database.owner.names
database.name
environment.name
task.description
risk.level
odc.task.url
3. Adjust the database permission request form, and split the form when applying for multiple databases.

2024-03-08

* modify migrate script version number

* update submodule

* refine codes and fix some issues

* refine

* fix a bug

* response to CR

---------

Co-authored-by: isadba <chinafenghao@hotmail.com>

…es and logical table expression generation (#2166)

* logical table expression init

* try TDD and build up TDD environment

* add new implementation

* add ut cases

* casecade impl

* database and table casecade

* more implementation

* code clean

* delete code

* upload ordered map

* fix regex

* refactor

* stash

* code format

* schema comparing stash

* schema structure comparing done

* add unit cases

* enhancement

* refactor

* rename method

* add ut

* add ut cases

* add more and more ut cases~

* rename variables

* response to comments

* response to comments

* response to comments

merge from main into dev/4.3.x

)

* add persistence layer impl

* add service layer empty impl

* add service impl

* fix unit tests and refine codes

* modify migrate script version number

* rename classes and table

* fix ut

* feat(ob-sql-parser): init ob 430 antlr g4

* fix compile error

* fix logic error

* fix some unit test cases

* remove new hints

* remove new hints

* fix some error

* fix one UT

* fix partition UT

* fix expr UT

* fix table element UT

* lexer for ob 4.3.0 oracle mode

* parser for ob 4.3.0 oracle mode

* fix unit testing

* response to CR comments

* response to CR comments

* response to CR comments

* response to CR comments

* response to CR comments

* fix UT

* ob-sql-parser version 1.2.1 to 1.3.0

* ob-sql-parser version 1.2.1 to 1.3.0

* support build graph by V$OB_SQL_PLAN

* use DO to build graph instead of query

* set title by objectName

* format code

* response to CR comments

* move UT

* update license

* response to CR comments

* format code

* remove reference for SqlProfileData

* update license

…ETRY datatype (#2232)

…se changes (#1848)

* complete the controller and dao layers

* complete the controller and dao layers

* Complete the code for the template section

* complete the controller and dao layers

* modify the code formate

* modify the code format

* add property projectId

* add property for req and resp

* feat(iam): password strength match oceanbase style

allow more special characters,
and now only 3 types required

* more change password scenarios

* CODEOWNERS add i18n rule

* refine log output for invalid initial password

* refine log output for invalid initial password

* response to CR comment

* typo

* fix: UT connect miss timeout

)

* db object synchornizer impl

* db column synchronizer impl

* add jdbc lock during sync

* db schema sync impl

* fix JPA method

* disable sync SEQUENCE for OB MySQL mode

* add log output

* refine: add batch create size (200) to avoid slow sql

* refine sync strategy

* fix circular reference

* fix circular reference

* fix some issues

* fix some issues

* add log output

* decrease pool size to 16

* refine codes

* refine codes

* fix some issues

* fix batchCreate transaction

* using fuzzy search

* fix sync data when batch create data source

* fix ut

* response to CR

* use plugin impl

* do not sync individual datasource

* skip unsupported object type

* response to CR

* fix unit test

* use TransactionTemplate

* refine schedule

…return (#2246)

* add AsyncExecuteContext for sql async execution

* use queue instead of list

* response to CR comments

* add sql text into async resp

* response to CR comments

* fix typo

* format code

* add SqlExecutionListener to listen execute status

* add SqlExecutionListener to listen execute status

* set trace id to null when starting

* response to CR

* fix an error

* response to CR comments

* response to CR comments

* fix wrong method name

* response to CR comments

* antlr innit

* init antlr4 grammer

* logical table expression parse

* expression parse

* delete unused comment

* refact

* add unit test cases

* add exception handler and ut cases

* fix i18m

* add ut

* fix ut

* refactor .g4 and add ut cases

* rename interface method

* refact dependency management

* fix

* add more error codes

* rename error codes

* refactor parser

* response to comments

…2300)

* add ColumnGroup and ElementFactory

* support column group in create table

* support column group in create index

* support column group in alter table

* refactor column group

* fix mysql parser

* fix oracle parser

* fix UT

* complete UT

* response to CR comments

* add override annotation

…group (#2349)

* support edit column group

* fix NPE

* support get column group by parser

* add UT

* fix NPE

* use Object instead of String

* fix UT

* support get column groups in accessor

* add support for structure compare and shadow table

* response to CR and fix UT

* format code

* response to CR comments

…plicated name (#2355)

* add unique_identifier in collaboration_project

* delete index idx_collaboration_project_unique_identifier

…ect (#2377)

* migrate history uniqueIdentifier in collaboration_project

* modify unique key name

* fix ut test

* response to reveiw

* Synchronize the table structure based on the results from the table structure comparator.

* code format

* Supports synchronizing only partial structures.

* fix NPE

* close datasource

…om_main_into_dev43x

merge from main into dev/4.3.x

* feat：

* feat：support data check before data delete

* feat：support data check before data delete

* feat：support data check before data delete

* feat：support data check before data delete

* feat：support data check before data delete

* builds: supports build web in arm64 (#2380)

* builds: supports build web in arm64 (#2386)

* 1. support build web in arm64

* fix download url format

---------

Co-authored-by: IL MARE <yh263208@oceanbase.com>

* add build arm artifact

* fix

---------

Co-authored-by: niyuhang <32453647+Niyuhang2@users.noreply.github.com>
Co-authored-by: IL MARE <yh263208@oceanbase.com>

* Supports viewing subtask details.

* delete ScheduleTaskMapper.java

* correct field name.

* several bug fix

* rename task unit to task shard

* add primary key

* fix function not found

* response comments.

* response comments.

* code format

* response comments

* response comments

* Added new entities DlmJob and DlmJobStatistic.

* code format

* resolve conflict.

* fix dlm job factory

* upgrade migrate version

* Task framework enabling mode adaptation.

* data archiving tasks support custom operation partitions

* code format

* resolve conflict

* update sql script

* update dlm job status

* update dlm job status

* response comments

* response comments

* response comments

* response comments

* fix npe

* update table unit start time.

* rename script name

* response comments

merge from main into dev/4.3.0

…is partitioned (#2297)

…e names to lowercase when getTable (#2298)

…onsole (#2417)

* add whitelist for DB permission check

* refine

* response to CR

…e databases change (#2275)

* complete the controller and dao layers

* complete the controller and dao layers

* Complete the code for the template section

* create multiple database change flowinstance

* Added View the details of  multiple database  change flowinstance

* modify code format

* Change the version number to avoid duplication

* add sql check,task log and synchronization of the tasks' progress

* modify code format

* Delete obsolete files

* implement the servic of multiple databases change template

* implement the paging query and multiple databases sqlcheck

* implement the paging query and multiple databases sqlcheck

* Added the duplicate name verification interface and unit test of the template

* modify code format

* builds: fix failed to install pnpm (#2248)

* fix: set pnpm version to v8

* fix: set pnpm version to v8

* Remove redundant code

* Add name for multiple database change flow instance

* modify the code format

* modify view the template list、batch access database、set the risk level and modify the code format

* Add environment objects to viewing  multi-database flow's  response and add database objects for viewing  multi-database sql check's response

* Add a single pre-check node and flow  description for multiple databases

* add the function of viewing multi-database pre-check nodes

* Refine the execution of recorded responses

* Add environment elements to multi-databases response results

* Modify code format

* Limit the number of databases and do not allow duplicate databases

* Fixed error after sql check when the input is '#'

* Solve the problem that multiple database flow cannot be initiated repeatedly

* Fixed NullPointerException  when transferring sql files

* fix execution record display when failure occurs

* modify code format

* enhancement(jpa): add json type (#2211)

* add json type

* remove package-info

* add integrate test

* Modify code format and optimize performance

* Finished ignoring error execution in automatic mode and fixed the issue of checking multiple sql displays

* fix template create and update

* Complete various strategy for creating multi-database workflow

* Reduce redundant code

* Modify the code to conform to odc specifications

* Remove redundant code

* Added a scheduled template task to fix bugs

* modify the code format

* response to cr comments

* Optimize persistence and response objects

* Remove redundant code

* Serialize the databaseList

* modify code format

* delete the redundant code

* modify the code format

* response to cr

* response to cr

---------

Co-authored-by: Xiao Kang <xxk268858@antgroup.com>
Co-authored-by: Ang <43255684+ungreat@users.noreply.github.com>

…bled (#2445)

* support create event when task framework not enabled

* add description for notification

* optimize flowTaskSubmitter

* optimize flowTaskSubmitter

* fix listener

* fix event name

* format code

* rename code

* fix flowNodeStatus

* clean context

* modify for pr comment

* format code

* modify for pr comment

* fix bean

* fix flowTaskInstance

* fix variables

* format code

* modify for pr comment

* format code

* modify for pr comment

* modify for pr comment

* refactor var

* fix status npe

* format code

* several bug fix

* several bug fix

* several bug fix

…2436)

* individual space support object search

* sorted result by matching level

* decrease search size

* do not sort

* fix bug

#2469)

* notification support multiple database change

* avoid insert 'null' into metadb

* response to CR comments

* response to CR comments

… existed project name (#2464)

…config to data transfer (#2455)

* support apply user config in data transfer task

* support apply user config in mysql/oracle

* format code

* fix UT fail

* use AbortPolicy to replace DiscardPolicy

* fix UT failed

* add audit event for mulitple databases

* Add internationalization of multiple databases change

* response to pr comment

* add event of template

* modify the code formate

* format the code

* opt log printing

* add heart beat time

* add heartbeat scan task

* format the code

* format the code

* fix illegal multiple task status

* opt code

* opt code

* optimize code

* opt code

* add switch off

* modify comment

* update heartbeat time when task is started

* add transaction control

* change default heartbeat timeout to 180s

* response to cr comment

…onsole (#2501)

#2231)

* adaption for ALL_TAB_COLS.USER_GENERATED in ob oracle

* upgrade db-browser version

* rename DBSchemaAccessors to DBSchemaAccessorGenerator

* modify OBOracleLessThan400SchemaAccessor

* fix license check

* upgrade db-browser version

* create DBStatsAccessorFactory in db-browser

* add DBObjectEditorGenerator in db-browser

* fix

* response to review

* make create DBObjectEditor as static method

* fix ut test

…ection to an OceanBase backup instance (#2220)

* check backup instance

* response to comments

…e edited (#2511)

* The template adds the ability to edit the database sequences

* Modify template unit tests

* modify the code format

* Add update status logic for viewing templates

* modify the code format

* modify the code format

* modify the code format

* modify the code format

* modify the code format

#2486)

* adapt db-browser

* refine sync columns performance

* fix: big transaction

* fix typo

* revert codes

* adapt to new db-browser

* fix search using blank key

…n is reset (#2528)

* fix concurrent error

* fix close connection error

* change timeout seconds

* fix unit test error

* fix unit test error

* fomat the code

* avoid lock concurrent update

* optimize the code

* fix error

* avoid concurrent problem

* avoid concurrent problem

* optimize the log printing

…get table name is null (#2533)

…tained database (#2542)

* Add database information to the template

* Modify the template's unit tests

…QL (#2523)

…ual space (#2534)

* fix ticket manual execute failed -errorCode=417

* code format

* modify execStrategy comment info

* delete unused code

* fix(flow): create ticket which manual execute failed

* fix(integration): basic auth miss authentication initialization

basic auth miss onAuthenticationSuccess handler process, leads to authorization AccessDenied, and the login record mechanism not works.

* fix format

…e inconsistent (#2497)

* several bug fix

* Fixed the issue of structure synchronization failure in scenarios with inconsistent table names.

* fix create table failed

* add ut

…sponding sql check result (#2584)

* fix case that the database does not match the corresponding sql check result

* modify the code format

* fix task description i18n

* fix

…ring a multi-database change task (#2569)

* Make the display of execution record is consistent with the single database ticket in real time

* modify the code format

* The name of a template can remain unchanged when it is modified

* Allow the name to remain unchanged when the template is modified

* modify the code format

* modify the code format

* Add the volatile  for some properties in  MultipleDatabaseChangeRuntimeFlowableTask

…ace (#2563)

…ist method (#2585)

…se owners (#2590)

…2448)

* adaption for obcloud 24v2

* fix failed to set parentUid

* fix removeFromOrganization in UserService

* response to review

* response to review

* modify internationalization copy

…ting template (#2593)

* optimize error message when creating and updating template

* modify the code format

…2589)

* fix approval

* fix disabled user

* fix

* disabled user cannot approve

* fix ut

…2565)

* several bug fix

* fix rollback failed

)

* fix cannot disable schedule if project is archived.

* terminate schedule if project is archived

* Fixed the failed unit test.

…d continue when error (#2587)

* set --compact-schema for obdumper

* do not throw exception when stopWhenError is true and replaceIfExists is false

* fix oracle not truncate

* add comments for exception handling

…en using database owner (#2625)

* fix approval

* fix

* fix

* refine codes

* change configSystemRepository

* formatter

* add creator_id and last_modifier_id to config entity

* add creator_id and last_modifier_id to config entity

* add creator_id and last_modifier_id to config entity

refactor: pick changes from 43x

…#2595)

* demo

* rename

* rename

* refactor

* opt code

* opt code

* opt code

* opt code

* opt code

* opt code

* opt code

* opt code

* refactor db-browser

* refactor db-browser

* add this

* refactor dbbrowser in odc

* refactor dbbrowser in odc

* add a new method for accessor creating

* failed to connect to ob1479

* make connection id alternative

* remove useless template creation

* fix error

* add datasource field

* temp

* temp

* several bugfix

* several bugfix

… in ob-mysql (#2636)

…mplates (#2639)

…Invalid DB with the same name (#2641)

…tructure (#2648)