From e3e2515a82a8f64c69c49ddda3bfa0ff03d333cc Mon Sep 17 00:00:00 2001 From: Junfan Zhang Date: Sat, 9 Jul 2022 15:47:36 +0800 Subject: [PATCH] Supplement doc about assignment tags --- README.md | 2 +- docs/client_guide.md | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index 2e2fc44bae..cd40df5c4d 100644 --- a/README.md +++ b/README.md @@ -251,7 +251,7 @@ The important configuration is listed as following. |rss.server.commit.timeout|600000|Timeout when commit shuffle data (ms)| |rss.storage.type|-|Supports MEMORY_LOCALFILE, MEMORY_HDFS, MEMORY_LOCALFILE_HDFS| |rss.server.flush.cold.storage.threshold.size|64M| The threshold of data size for LOACALFILE and HDFS if MEMORY_LOCALFILE_HDFS is used| - +|rss.server.tags|-|The comma-separated list of tags to indicate the shuffle server's attributes. It will be used as the assignment basis for the coordinator| ### Shuffle Client diff --git a/docs/client_guide.md b/docs/client_guide.md index ac0ec1012e..ba26f3c571 100644 --- a/docs/client_guide.md +++ b/docs/client_guide.md @@ -86,7 +86,7 @@ These configurations are shared by all types of clients. |.rss.storage.type|-|Supports MEMORY_LOCALFILE, MEMORY_HDFS, MEMORY_LOCALFILE_HDFS| |.rss.client.read.buffer.size|14m|The max data size read from storage| |.rss.client.send.threadPool.size|5|The thread size for send shuffle data to shuffle server| - +|.rss.client.assignment.tags|-|The comma-separated list of tags for deciding assignment shuffle servers. Notice that the SHUFFLE_SERVER_VERSION will always as the assignment tag whether this conf is set or not| Notice: 1. `` should be `spark` or `mapreduce`