diff --git a/docs/configuration.md b/docs/configuration.md index c276e8e90dec..d961f43acf4a 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -305,7 +305,7 @@ Apart from these, the following properties are also available, and may be useful
daily, hourly, minutely or
+ Rolling is disabled by default. Valid values are daily, hourly, minutely or
any interval in seconds. See spark.executor.logs.rolling.maxRetainedFiles
for automatic cleaning of old logs.
spark.python.profilesc.show_profiles(),
+ Enable profiling in Python worker, the profile result will show up by sc.show_profiles(),
or it will be displayed before the driver exiting. It also can be dumped into disk by
- sc.dump_profiles(path). If some of the profile results had been displayed manually,
+ sc.dump_profiles(path). If some of the profile results had been displayed manually,
they will not be displayed automatically before driver exiting.
- By default the pyspark.profiler.BasicProfiler will be used, but this can be overridden by
- passing a profiler class in as a parameter to the SparkContext constructor.
+ By default the pyspark.profiler.BasicProfiler will be used, but this can be overridden by
+ passing a profiler class in as a parameter to the SparkContext constructor.