forked from docs/doc-exports
Reviewed-by: Kacur, Michal <michal.kacur@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
3.3 KiB
3.3 KiB
Enabling an Executor to Execute Custom Code When Exiting
Scenario
You can configure the following parameters to execute custom code when Executor exits.
Configuration Parameters
Configure the following parameters in the spark-defaults.conf file of the Spark client.
Parameter |
Description |
Default Value |
---|---|---|
spark.executor.execute.shutdown.cleaner |
If this parameter is set to true, an executor can execute custom code when the executor exits. |
false |
spark.executor.execute.shutdown.cleaner.max.timeout |
Timeout interval for an executor to execute custom code. |
240s |
Parent topic: Scenario-Specific Configuration