Skip to content

Commit

Permalink
add repartitionWithNebula for Exchange (#1054)
Browse files Browse the repository at this point in the history
  • Loading branch information
randomJoe211 authored Jan 19, 2022
1 parent 3923723 commit fbdf601
Show file tree
Hide file tree
Showing 2 changed files with 20 additions and 0 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -182,6 +182,7 @@ For different data sources, the vertex configurations are different. There are m
|Parameter|Type|Default value|Required|Description|
|:---|:---|:---|:---|:---|
|`tags.path`|string|-|Yes|The path of the source file specified to generate SST files.|
|`tags.repartitionWithNebula`|bool|`false`|No|Whether to repartition data based on the number of partitions of graph spaces in Nebula Graph when generating the SST file. Enabling this function can reduce the time required to DOWNLOAD and INGEST SST files.|

### Specific parameters of Nebula Graph

Expand Down Expand Up @@ -216,6 +217,13 @@ For the specific parameters of different data sources for edge configurations, p
|`edges.batch`|int|`256`|Yes|The maximum number of edges written into Nebula Graph in a single batch.|
|`edges.partition`|int|`32`|Yes|The number of Spark partitions.|

### Specific parameters for generating SST files

|Parameter|Type|Default value|Required|Description|
|:---|:---|:---|:---|:---|
|`edges.path`|string|-|Yes|The path of the source file specified to generate SST files.|
|`edges.repartitionWithNebula`|bool|`false`|No|Whether to repartition data based on the number of partitions of graph spaces in Nebula Graph when generating the SST file. Enabling this function can reduce the time required to DOWNLOAD and INGEST SST files.|

### Specific parameters of Nebula Graph

|Parameter|Type|Default value|Required|Description|
Expand Down
12 changes: 12 additions & 0 deletions docs-2.0/nebula-exchange/use-exchange/ex-ug-import-from-sst.md
Original file line number Diff line number Diff line change
Expand Up @@ -278,6 +278,9 @@ After Exchange is compiled, copy the conf file `target/classes/application.conf`
# The number of Spark partitions.
partition: 32
# Whether to repartition data based on the number of partitions of graph spaces in Nebula Graph when generating the SST file.
repartitionWithNebula: false
}
# Set the information about the Tag Team.
Expand Down Expand Up @@ -323,6 +326,9 @@ After Exchange is compiled, copy the conf file `target/classes/application.conf`
# The number of Spark partitions.
partition: 32
# Whether to repartition data based on the number of partitions of graph spaces in Nebula Graph when generating the SST file.
repartitionWithNebula: false
}
Expand Down Expand Up @@ -381,6 +387,9 @@ After Exchange is compiled, copy the conf file `target/classes/application.conf`
# The number of Spark partitions.
partition: 32
# Whether to repartition data based on the number of partitions of graph spaces in Nebula Graph when generating the SST file.
repartitionWithNebula: false
}
# Set the information about the Edge Type serve.
Expand Down Expand Up @@ -432,6 +441,9 @@ After Exchange is compiled, copy the conf file `target/classes/application.conf`
# The number of Spark partitions.
partition: 32
# Whether to repartition data based on the number of partitions of graph spaces in Nebula Graph when generating the SST file.
repartitionWithNebula: false
}
]
Expand Down

0 comments on commit fbdf601

Please sign in to comment.