Skip to content

Commit a95a4a4

Browse files
committed
Reflect review comments
1 parent 803663f commit a95a4a4

File tree

1 file changed

+4
-5
lines changed

1 file changed

+4
-5
lines changed

docs/monitoring.md

Lines changed: 4 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -104,12 +104,12 @@ Enabling <code>spark.eventLog.rolling.enabled</code> and <code>spark.eventLog.ro
104104
let you have rolling event log files instead of single huge event log file which may help some scenarios on its own,
105105
but it still doesn't help you reducing the overall size of logs.
106106

107-
Spark History Server can apply 'compaction' on the rolling event log files to reduce the overall size of
107+
Spark History Server can apply compaction on the rolling event log files to reduce the overall size of
108108
logs, via setting the configuration <code>spark.history.fs.eventLog.rolling.maxFilesToRetain</code> on the
109109
Spark History Server.
110110

111-
Details will be described below, but please note in prior that 'compaction' is LOSSY operation.
112-
'Compaction' will discard some events which will be no longer seen on UI - you may want to check which events will be discarded
111+
Details will be described below, but please note in prior that compaction is LOSSY operation.
112+
Compaction will discard some events which will be no longer seen on UI - you may want to check which events will be discarded
113113
before enabling the option.
114114

115115
When the compaction happens, the History Server lists all the available event log files for the application, and considers
@@ -119,8 +119,7 @@ For example, if the application A has 5 event log files and <code>spark.history.
119119
Once it selects the target, it analyzes them to figure out which events can be excluded, and rewrites them
120120
into one compact file with discarding events which are decided to exclude.
121121

122-
The compaction tries to exclude the events which point to the outdated things like jobs, and so on. As of now, below describes
123-
the candidates of events to be excluded:
122+
The compaction tries to exclude the events which point to the outdated data. As of now, below describes the candidates of events to be excluded:
124123

125124
* Events for the job which is finished, and related stage/tasks events
126125
* Events for the executor which is terminated

0 commit comments

Comments
 (0)