Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: support visit of stage repository #2305

Merged
merged 6 commits into from
Sep 6, 2023
Merged

Conversation

msgui
Copy link
Contributor

@msgui msgui commented Aug 31, 2023

Purpose of the PR

support visit of stage repository

Main Changes

Verifying these changes

  • Trivial rework / code cleanup without any test coverage. (No Need)
  • Already covered by existing tests, such as (please modify tests here).
  • Need tests and can be verified as follows:
    • xxx

Does this PR potentially affect the following parts?

  • Nope
  • Dependencies (add/update license info)
  • Modify configurations
  • The public API
  • Other affects (typed here)

Documentation Status

  • Doc - TODO
  • Doc - Done
  • Doc - No Need

@msgui
Copy link
Contributor Author

msgui commented Aug 31, 2023

Currently, the issue of missing the common1.0.1 package has been fixed.
The current errors are:
1. JDK8 is not supported

  • resolution: Utilizing the 'jdk' tag in the 'activation' section, we restrict the 'pd/store' modules to specified JDK versions. Compilation/runtime will seamlessly choose the appropriate module based on the JDK version.

@imbajin
Copy link
Member

imbajin commented Sep 1, 2023

Currently, the issue of missing the common1.0.1 package has been fixed. The current errors are: 1. JDK8 is not supported 2. Test phase

  • skip the pd/store module while we use java8?
  • list the related test we could choose to skip first

Copy link
Contributor Author

@msgui msgui left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

<profiles>
    <profile>
        <id>stage</id>
        <repositories>
            <repository>
                <id>staged-releases</id>
                <url>https://repository.apache.org/content/groups/staging/</url>
            </repository>
        </repositories>
        <pluginRepositories>
            <pluginRepository>
                <id>staged-releases</id>
                <url>https://repository.apache.org/content/groups/staging/</url>
            </pluginRepository>
        </pluginRepositories>
    </profile>
</profiles>

Fix private repository package issue with 'mvn xxx -P stage
(eg: mvn clean compile -U -Dmaven.javadoc.skip=true -ntp -P stage)

@msgui msgui marked this pull request as ready for review September 2, 2023 14:48
@imbajin
Copy link
Member

imbajin commented Sep 2, 2023

Currently, the issue of missing the common1.0.1 package has been fixed. The current errors are: 1. JDK8 is not supported 2. Test phase

  • skip the pd/store module while we use java8?
  • list the related test we could choose to skip first

the first problem we have to handle them now

like in action add:
if java8
mvn compile -pl hugegraph-server #specify the needed modules
else
mvn compile # all modules

pom.xml Outdated
Comment on lines 114 to 123
<profile>
<id>exclude-jdk11-modules</id>
<activation>
<jdk>11</jdk>
</activation>
<modules>
<module>hugegraph-store</module>
<module>hugegraph-pd</module>
</modules>
</profile>
Copy link
Contributor Author

@msgui msgui Sep 3, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Due to the current support for JDK 11 compilation in the store/pd , it is necessary to exclude these two modules in the JDK 8.

Comment on lines -97 to -98
<module>hugegraph-pd</module>
<module>hugegraph-store</module>
Copy link
Contributor Author

@msgui msgui Sep 3, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

exclude jdk11-only modules cc @VGalaxies

@codecov
Copy link

codecov bot commented Sep 3, 2023

Codecov Report

❗ No coverage uploaded for pull request base (pd-store@c70a294). Click here to learn what that means.
The diff coverage is n/a.

@@             Coverage Diff             @@
##             pd-store    #2305   +/-   ##
===========================================
  Coverage            ?   54.21%           
  Complexity          ?      905           
===========================================
  Files               ?      498           
  Lines               ?    40626           
  Branches            ?     5658           
===========================================
  Hits                ?    22027           
  Misses              ?    16305           
  Partials            ?     2294           

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@msgui
Copy link
Contributor Author

msgui commented Sep 4, 2023

module:PD

Run api test

backed:(memory 11,Cassandra 11,scylladb 11,hbase 11,rocksdb 11,mysql 11,build 11)

ChangeShardNumTest.test3To1:38 » HgStoreClient org.apache.hugegraph.pd.common....

[7677](https://github.com/msgui/incubator-hugegraph/actions/runs/6064456827/job/16452926898?pr=13#step:10:7678)Error:    HgKvStoreTest.deleteTableTest:85 » HgStoreClient org.apache.hugegraph.pd.commo...

[7678](https://github.com/msgui/incubator-hugegraph/actions/runs/6064456827/job/16452926898?pr=13#step:10:7679)Error:    HgKvStoreTest.dropTableTest:131 » HgStoreClient org.apache.hugegraph.pd.common...

[7679](https://github.com/msgui/incubator-hugegraph/actions/runs/6064456827/job/16452926898?pr=13#step:10:7680)Error:    HgKvStoreTest.moveDataPathTest:176 » HgStoreClient org.apache.hugegraph.pd.com...

[7680](https://github.com/msgui/incubator-hugegraph/actions/runs/6064456827/job/16452926898?pr=13#step:10:7681)Error:    HgKvStoreTest.truncateTest:40 » HgStoreClient org.apache.hugegraph.pd.common.P...

[7681](https://github.com/msgui/incubator-hugegraph/actions/runs/6064456827/job/16452926898?pr=13#step:10:7682)Error:    HgSessionManagerRaftPDTest.benchmarkScanBatch:604 » Runtime org.apache.hugegra...

[7682](https://github.com/msgui/incubator-hugegraph/actions/runs/6064456827/job/16452926898?pr=13#step:10:7683)Error:    HgSessionManagerRaftPDTest.benchmarkScanBatch2:621 » HgStoreClient org.apache....

[7683](https://github.com/msgui/incubator-hugegraph/actions/runs/6064456827/job/16452926898?pr=13#step:10:7684)Error:    HgSessionManagerRaftPDTest.benchmarkScanBatchSkipDegree:653 » HgStoreClient or...

[7684](https://github.com/msgui/incubator-hugegraph/actions/runs/6064456827/job/16452926898?pr=13#step:10:7685)Error:    HgSessionManagerRaftPDTest.check:138 » Runtime org.apache.hugegraph.pd.common....

[7685](https://github.com/msgui/incubator-hugegraph/actions/runs/6064456827/job/16452926898?pr=13#step:10:7686)Error:    HgSessionManagerRaftPDTest.delete:298 » HgStoreClient org.apache.hugegraph.pd....

[7686](https://github.com/msgui/incubator-hugegraph/actions/runs/6064456827/job/16452926898?pr=13#step:10:7687)Error:    HgSessionManagerRaftPDTest.deletePrefix:375 » HgStoreClient org.apache.hugegra...

[7687](https://github.com/msgui/incubator-hugegraph/actions/runs/6064456827/job/16452926898?pr=13#step:10:7688)Error:    HgSessionManagerRaftPDTest.deleteRange:335 » HgStoreClient org.apache.hugegrap...

[7688](https://github.com/msgui/incubator-hugegraph/actions/runs/6064456827/job/16452926898?pr=13#step:10:7689)Error:    HgSessionManagerRaftPDTest.deleteSingle:316 » HgStoreClient org.apache.hugegra...

[7689](https://github.com/msgui/incubator-hugegraph/actions/runs/6064456827/job/16452926898?pr=13#step:10:7690)Error:    HgSessionManagerRaftPDTest.paging:504 » HgStoreClient org.apache.hugegraph.pd....

[7690](https://github.com/msgui/incubator-hugegraph/actions/runs/6064456827/job/16452926898?pr=13#step:10:7691)Error:    HgSessionManagerRaftPDTest.putGet:107 » HgStoreClient org.apache.hugegraph.pd....

[7691](https://github.com/msgui/incubator-hugegraph/actions/runs/6064456827/job/16452926898?pr=13#step:10:7692)Error:    HgSessionManagerRaftPDTest.putGetUnique:161 » HgStoreClient org.apache.hugegra...

[7692](https://github.com/msgui/incubator-hugegraph/actions/runs/6064456827/job/16452926898?pr=13#step:10:7693)Error:    HgSessionManagerRaftPDTest.scanIterator:407 » HgStoreClient org.apache.hugegra...

[7693](https://github.com/msgui/incubator-hugegraph/actions/runs/6064456827/job/16452926898?pr=13#step:10:7694)Error:    HgSessionManagerRaftPDTest.scanPartition:129 » Runtime org.apache.hugegraph.pd...

[7694](https://github.com/msgui/incubator-hugegraph/actions/runs/6064456827/job/16452926898?pr=13#step:10:7695)Error:    HgSessionManagerRaftPDTest.scanTable:586 » Runtime org.apache.hugegraph.pd.com...

[7695](https://github.com/msgui/incubator-hugegraph/actions/runs/6064456827/job/16452926898?pr=13#step:10:7696)Error:    HgSessionManagerRaftPDTest.testBatchPutExt:170 » HgStoreClient org.apache.huge...

[7696](https://github.com/msgui/incubator-hugegraph/actions/runs/6064456827/job/16452926898?pr=13#step:10:7697)Error:    HgSessionManagerRaftPDTest.testBatchPutMultiGraph:252 » HgStoreClient org.apac...

[7697](https://github.com/msgui/incubator-hugegraph/actions/runs/6064456827/job/16452926898?pr=13#step:10:7698)Error:    HgSessionManagerRaftPDTest.testBatchPutUniqueExt:226 » HgStoreClient org.apach...

[7698](https://github.com/msgui/incubator-hugegraph/actions/runs/6064456827/job/16452926898?pr=13#step:10:7699)Error:    HgSessionManagerRaftPDTest.testDelGraph:592 » HgStoreClient org.apache.hugegra...

[7699](https://github.com/msgui/incubator-hugegraph/actions/runs/6064456827/job/16452926898?pr=13#step:10:7700)Error:    HgSessionManagerRaftPDTest.truncate:547 » HgStoreClient org.apache.hugegraph.p...

[7700](https://github.com/msgui/incubator-hugegraph/actions/runs/6064456827/job/16452926898?pr=13#step:10:7701)Error:    HgStoreClientTest.testDeleteData:136 » HgStoreClient org.apache.hugegraph.pd.c...

[7701](https://github.com/msgui/incubator-hugegraph/actions/runs/6064456827/job/16452926898?pr=13#step:10:7702)Error:    HgStoreClientTest.testDropTable:164 » HgStoreClient org.apache.hugegraph.pd.co...

[7702](https://github.com/msgui/incubator-hugegraph/actions/runs/6064456827/job/16452926898?pr=13#step:10:7703)Error:    HgStoreClientTest.testPutData:46 » HgStoreClient org.apache.hugegraph.pd.commo...

[7703](https://github.com/msgui/incubator-hugegraph/actions/runs/6064456827/job/16452926898?pr=13#step:10:7704)Error:    HgStoreClientTest.testPutData2:61 » HgStoreClient org.apache.hugegraph.pd.comm...

[7704](https://github.com/msgui/incubator-hugegraph/actions/runs/6064456827/job/16452926898?pr=13#step:10:7705)Error:    HgStoreClientTest.testScan:74 » HgStoreClient org.apache.hugegraph.pd.common.P...

[7705](https://github.com/msgui/incubator-hugegraph/actions/runs/6064456827/job/16452926898?pr=13#step:10:7706)Error:    HgStoreClientTest.testScanPartition:197 » PD PD unreachable, pd.peers=127.0.0....


module:PD

Run unit test

backed:(memory 11,Cassandra 11,scylladb 11,hbase 11,rocksdb 11,mysql 11,postgresql11)

Error:  Errors: 
Error:    PDClientTest.testGetActiveStores:97 » Runtime org.apache.hugegraph.pd.common.P...
Error:    PDClientTest.testGetPartition:261 » Runtime org.apache.hugegraph.pd.common.PDE...
Error:    PDClientTest.testScanPartitions:130 » Runtime org.apache.hugegraph.pd.common.P...
Error:    PDClientTest.testUpdatePartitionLeader:168 » Runtime org.apache.hugegraph.pd.c...
Error:    MainTest.getConfig:53 » PD PD unreachable, pd.peers=127.0.0.1:8686
Error:    MainTest.getConfig2:68 » PD PD unreachable, pd.peers=127.0.0.1:8686

module:server

Run api test

backed:(postgresql11)

Error:  Errors: 
Error:    ResourceAllocationAPITest.prepareSchema:36->BaseApiTest.initPropertyKey:198->BaseApiTest.createAndAssert:437->BaseApiTest.assertResponseStatus:612 » Processing

module:PD

Run core test

backed:(postgresql11)

Error:  Errors: 
Error:    RestApiTest.testQueryClusterInfo:39 » Connect Connection refused
Error:    RestApiTest.testQueryClusterMembers:52 » Connect Connection refused
Error:    RestApiTest.testQueryDebugPartitionsInfo:104 » Connect Connection refused
Error:    RestApiTest.testQueryGraphsInfo:78 » Connect Connection refused
Error:    RestApiTest.testQueryPartitionsInfo:91 » Connect Connection refused
Error:    RestApiTest.testQueryShards:116 » Connect Connection refused
Error:    RestApiTest.testQueryStoresInfo:65 » Connect Connection refused
Error:    StoreServiceTest.testGetTombStores:521 » IndexOutOfBounds Index 0 out of bound...

module:PD

Run api test

backed:(memory 11,Cassandra 11,scylladb 11,hbase 11,rocksdb 11,mysql 11)

Error:  Errors: 
Error:    RestApiTest.testQueryClusterInfo:39 » Connect Connection refused
Error:    RestApiTest.testQueryClusterMembers:52 » Connect Connection refused
Error:    RestApiTest.testQueryDebugPartitionsInfo:104 » Connect Connection refused
Error:    RestApiTest.testQueryGraphsInfo:78 » Connect Connection refused
Error:    RestApiTest.testQueryPartitionsInfo:91 » Connect Connection refused
Error:    RestApiTest.testQueryShards:116 » Connect Connection refused
Error:    RestApiTest.testQueryStoresInfo:65 » Connect Connection refused
Error:    StoreServiceTest.testGetTombStores:521 » IndexOutOfBounds Index 0 out of bound...

Run raft test

backed:(rocksdb 8)

time out: 5h 51m 24s

module:server

Run api test

backed:(mysql 8)

TaskApiTest>BaseApiTest.init:80->BaseApiTest.clearData:597->BaseApiTest.clearGraph:509->BaseApiTest.lambda$clearGraph$2:499->BaseApiTest.assertResponseStatus:612 » Processing

module:server

Run core test

backed:(postgresql 8,postgresql 11)

Error:  Failures: 
Error:    TaskCoreTest.testGremlinJobAndCancel:555 expected:<CANCELLING> but was:<RUNNING>
Error:  Errors: 
Error:    TaskCoreTest.setup:59 » IllegalArgument Can't delete incomplete task '1' in st...
Error:    TaskCoreTest.setup:59 » IllegalArgument Can't delete incomplete task '1' in st...
Error:    TaskCoreTest.setup:59 » IllegalArgument Can't delete incomplete task '1' in st...
Error:    TaskCoreTest.setup:59 » IllegalArgument Can't delete incomplete task '1' in st...
Error:    TaskCoreTest.setup:59 » IllegalArgument Can't delete incomplete task '1' in st...
Error:    TaskCoreTest.setup:59 » IllegalArgument Can't delete incomplete task '1' in st...
Error:    TaskCoreTest.setup:59 » IllegalArgument Can't delete incomplete task '1' in st...
Error:    TaskCoreTest.setup:59 » IllegalArgument Can't delete incomplete task '1' in st...
Error:    TaskCoreTest.setup:59 » IllegalArgument Can't delete incomplete task '1' in st...

.github/configs/settings.xml Outdated Show resolved Hide resolved
.github/configs/settings.xml Outdated Show resolved Hide resolved
Comment on lines +30 to +35
<pluginRepositories>
<pluginRepository>
<id>staged-releases</id>
<url>https://repository.apache.org/content/groups/staging/</url>
</pluginRepository>
</pluginRepositories>
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe we don't need it, although we could keep it now

.github/workflows/check-dependencies.yml Outdated Show resolved Hide resolved
.github/workflows/check-dependencies.yml Outdated Show resolved Hide resolved
.github/workflows/ci.yml Outdated Show resolved Hide resolved
.github/workflows/ci.yml Outdated Show resolved Hide resolved
.github/workflows/codeql-analysis.yml Outdated Show resolved Hide resolved
.github/workflows/codeql-analysis.yml Outdated Show resolved Hide resolved
@imbajin imbajin requested a review from z7658329 September 5, 2023 07:06
msgui and others added 3 commits September 5, 2023 21:39
@imbajin imbajin merged commit 0903e90 into apache:pd-store Sep 6, 2023
11 of 21 checks passed
@msgui msgui deleted the sup-stage branch September 9, 2023 12:43
VGalaxies added a commit to VGalaxies/incubator-hugegraph-doc that referenced this pull request Dec 17, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

2 participants