Fix][api] Fix multiple threads creating folders will result in multiple identical folders #3554
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
fix [BUG] When editing user information, clear the phone number, the database table t_ds_user.phone is not cleared #2892
merge method updateuser if and fix bug#2892
* fix bug: sqoop mysql import params error * fix bug: sqoop mysql import params error
Fixed selection of tenant value and defalut changed to lower case
fix create table sql exception
* add MicroBenchMark model * add log * fix propertyName * small change * add ut * format * add @test * fix maven compile error * remove enum set method * exclusion microbench ut * small change * Use assembly instead of shade Co-authored-by: dailidong <dailidong66@gmail.com>
…tart (#2913) * fix worker group config no effect * remove codehaus janino jar the license about janino maybe not compatiable with Apache v2 * Merge remote-tracking branch 'upstream/dev-1.3.0' into dev-1.3.0 # Conflicts: # dolphinscheduler-server/src/main/resources/config/install_config.conf * datasource config * Update datasource.properties * fix RunConfig bug * remove param monitor server state * fix table T_DS_ALERT * update h2 database * fix #2910 master server will show exception for some time when it restart
* fix: local param bug * fix: UT bug Co-authored-by: Rubik-W <whm_777@163.com>
* fix bug: send task result to master until success. * fix bug: send task result to master until success. * add sleep * set null if send result failed * set null if send result failed * change max length of username to 39 * test for gc * change version to 1.3.0 * check and add some license files * check and add some license files * revert Co-authored-by: baoliang <baoliang@analysys.com.cn>
* fix worker group config no effect * remove codehaus janino jar the license about janino maybe not compatiable with Apache v2 * Merge remote-tracking branch 'upstream/dev-1.3.0' into dev-1.3.0 # Conflicts: # dolphinscheduler-server/src/main/resources/config/install_config.conf * datasource config * Update datasource.properties * fix RunConfig bug * remove param monitor server state * fix table T_DS_ALERT * update h2 database * fix #2910 master server will show exception for some time when it restart * fix oom when no master is active * fix worker oom when master server restart * fix oom * fix * add UT * fix worker group config no effect
2. remove getMapper method,replace with toList() 3. rewrite toList method,support constructCollectionType. 4. parseObject(resp, Map.class) replace to toMap() method 5. rename JacksonSerialize to JsonSerializer rewrite createArrayNode,createObjectNode method will Affect too many lines ，i will fix it in the next pr.
2. remove getMapper method,replace with toList() 3. rewrite toList method,support constructCollectionType. 4. parseObject(resp, Map.class) replace to toMap() method 5. rename JacksonSerialize to JsonSerializer rewrite createArrayNode,createObjectNode method will Affect too many lines ，i will fix it in the next pr.
* fix the spell and modify logger print format
* [Test][api] Introduce api controller test example * Add controller test
…code (#3437) * [Improvement][api] Introduce logger service interface for clear code * Remove the code smell
… clear code (#3439) * [Improvement][api] Introduce data analysis service interface for clear code * Remove the bad smell * Remove the bad smell
* fix bug Delete invalid field: executorcores Modify verification prompt * fix bug Delete invalid field: executorcores Modify verification prompt * fix bug Delete invalid field: executorcores Modify verification prompt * dag add close button * reset last version * reset last version * dag add close buttion dag add close buttion * update CLICK_SAVE_WORKFLOW_BUTTON xpath * updae CLICK_SAVE_WORKFLOW_BUTTON xpath * updae CLICK_SAVE_WORKFLOW_BUTTON xpath * updae CLICK_SAVE_WORKFLOW_BUTTON xpath * Update CreateWorkflowLocator.java modify submit workflow button * Update CreateWorkflowLocator.java * Update CreateWorkflowLocator.java modify CLICK_ADD_BUTTON * Update CreateWorkflowLocator.java delete print * Update CreateWorkflowLocator.java 1 * Update CreateWorkflowLocator.java 1 * Setting '-XX:+DisableExplicitGC ' causes netty memory leaks in addition update '- XX: largepagesizeinbytes = 128M' to '- XX: largepagesizeinbytes = 10M' * Update dag.vue * Update dag.vue * Update dag.vue * Update CreateWorkflowLocator.java * Revert "Setting '-XX:+DisableExplicitGC ' causes netty memory leaks" This reverts commit 3a2cba7 * Setting '-XX:+DisableExplicitGC ' causes netty memory leaks in addition update '- XX: largepagesizeinbytes = 128M' to '- XX: largepagesizeinbytes = 10M' * Update dolphinscheduler-daemon.sh * `Queue manage` is renamed ` yarn queue manage ` Co-authored-by: dailidong <dailidong66@gmail.com> Co-authored-by: xingchun-chen <55787491+xingchun-chen@users.noreply.github.com>
…finitionService (#3371) * [Improvement-3369][api] Code clean and improvement * Feature: import DATA_LIST static variable
…mporter (#3368) * [Improvement][style] Add code import style automatic formatter * Update checkstyle.xml * Update checkstyle.xml * [Improvement][api] Improve the code style and checkstyle of ds * Update checkstyle.xml
Co-authored-by: rockxsj <junjun@mgtv.com>
…get the application status, you cannot get it if Kerberos authentication is enabled (#3264) * fix bug #3165 get resource.storage.type value toUpperCase * fix bug #3176 optimize Gets the value of this property “resource.storage.type” * fix When you request the URL through applicationID to get the application status, you cannot get it if Kerberos authentication is enabled * fix When you request the URL through applicationID to get the application status, you cannot get it if Kerberos authentication is enabled * fix When you request the URL through applicationID to get the application status, you cannot get it if Kerberos authentication is enabled * fix miss * add KerberosHttpClient fix kerberos bug * fix map init * add juint test * Extraction of public methods * Extraction of public methods * Fix code quality * Fix code quality * Fix code quality * Fix code quality * Fix code quality * Fix code quality * Fix code quality * rebuild test * rebuild test * check style * check style * check style * revert UT POM * Kerberos judgment goes up to hadoopUtils * fix merge * Remove connection pool shutdown Co-authored-by: dailidong <dailidong66@gmail.com>
* [Future#3234][cluster]enhanced load balancing weight-based load balancing algorithm this close # 3234 * remove useless parameter * code smell * load balancing according to work group * add smooth weight round robin * remove unused constants * perfect unit test * code smell * code smell * add work weight config * fix config error * add weight docs to readme.md
* batch copy or move process * batch copy or move process * batch copy or move process * batch copy or move process * batch copy or move process * batch copy or move process * batch copy or move process * batch copy or move process sovle code smell * batch copy or move process sovle code smell * batch copy or move process sovle code smell * batch copy or move process sovle code smell * batch copy or move process sovle code smell * batch copy or move process sovle code smell * batch copy or move process sovle code smell * batch copy or move process sovle code smell * batch copy or move process * batch copy or move process * batch copy or move process * batch copy or move process * batch copy or move process * batch copy or move process * Roll back the package.json file * rerun test * revert blank * resolve conflicts * resolve conflicts * resolve ut error * resolve sonar error Co-authored-by: sunchaohe <sunzhaohe@linklogis.com> Co-authored-by: dailidong <dailidong66@gmail.com>
* dolphinscheduler-api.pom resolve curator-client conflict the ds use curator-client:4.3.0 dependency by curator-frameworke, but hadoop-common use curator-client:2.7.1, so make the ClassNotFoundException ``` Caused by: java.lang.ClassNotFoundException: org.apache.curator.connection.StandardConnectionHandlingPolicy ``` exclue curator-client in hadoop-common to resolve this * resolve curator-client dependency confliction ## What is the purpose of the pull request the ds use curator-client:4.3.0 dependency by curator-frameworke, but hadoop-common use curator-client:2.7.1, so make the ClassNotFoundException ``` Caused by: java.lang.ClassNotFoundException: org.apache.curator.connection.StandardConnectionHandlingPolicy ``` exclue curator-client in hadoop-common to resolve this
* * add presto datasource support update .gitigonre to igonre some files * * use another presto driver * * add LICENSE files about presto-jdbc * * just for test sonar Co-authored-by: rockxsj <junjun@mgtv.com>
…lear code (#3384) * [Improvement][api] Introduce ProjectService interface for more clear code * Fix ci e2e * Update ProcessDefinitionServiceTest.java
…datasource support (#3468) * Feature presto (#1) * * add presto datasource support update .gitigonre to igonre some files * * use another presto driver * * add LICENSE files about presto-jdbc * * just for test sonar Co-authored-by: rockxsj <junjun@mgtv.com> * modify the io.prestosql.jdbc.PrestoDriver to com.facebook.presto.jdbc.PrestoDriver * add presto connection in sql node Co-authored-by: rockxsj <junjun@mgtv.com>
#3532) * [bug-3480][server]fix ds muti-level directory in zk, which lead to fail to assign work * miss whitespace for if statement
* Add task connection * Optimize test cases * Modify variable format * Optimize test cases * Update BrowserCommon.java * Update BrowserCommon.java * Update WorkflowDefineLocator.java Co-authored-by: chenxingchun <438044805@qq.com>
|
please submit PR to dev branch，and one PR solve one issue |
|
because it is your first contribution, please contact my wechat(510570367) or send mail to dev@dolphinscheduler.apache.org when you meet problem. thx |
|
you can close this PR , and re-submit a new PR to dev branch |
…iple identical folders" #3487
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Fixed this bug "multiple threads creating folders will result in multiple identical folders" #3487
If use a solution that adds unique constraints to your database, you will need to make changes in both Mysql and PostgresQL, and your reliance on database features may make certain versions of your database incompatible.