Spark3 service management via ADCM

Konstantin Alpashkin

The ADCM UI provides actions to manage the Spark3 service and its components. For information on how to run service actions, refer to ADH service actions.

The actions available for the Spark3 service are listed in the table below.

Action Description

Check

Runs service-specific tests to check the health of the service and its components

Start

Starts the service. When you run this action, the option Apply configs from ADCM is available. If it is set to true, all service configurations defined in ADCM settings will be applied on the service startup. Otherwise, the service starts without applying configurations from ADCM

Stop

Stops the service

Restart

Restarts the service. When you run this action, the option Apply configs from ADCM is available. If it is set to true, all service configurations defined in ADCM settings will be applied during the service restart. Otherwise, the service restarts without applying configurations from ADCM

Remove

Removes the service from the cluster. This action should be used to remove already installed services. Whereas the delete control can be used to remove a non-mapped service (a service which components have not been distributed among cluster hosts)

Add Client(s)

Adds Spark3 client(s) to the cluster. Running this action opens the component-host mapping interface where you can add new Spark3 clients

Remove Client(s)

Removes Spark3 client(s) from cluster hosts. Running this action opens the component-host mapping interface where you can remove Spark3 clients from specific hosts

Add Spark3 Connect

Adds the Spark3 Connect component. Running this action opens the component-host mapping interface where you can add new Spark3 Connect components

Remove Spark3 Connect

Removes the Spark3 Connect component. Running this action opens the component-host mapping interface where you can remove Spark3 Connect components

Add Spark3 History Server

Adds the Spark3 History Server component. Running this action opens the component-host mapping interface where you can add new History Server components

Move Spark3 History Server

Moves the Spark3 History Server component to a different host. Use the force option if the source host (where the component is currently installed) is offline

Remove Spark3 History Server

Removes the Spark3 History Server component. Running this action opens the component-host mapping interface where you can remove History Server components

Add Spark3 Livy

Adds the Spark3 Livy Server component. Running this action opens the component-host mapping interface where you can add new Livy Server components

Move Spark3 Livy

Moves the Spark3 Livy Server component to a different host. Use the force option if the source host (where the service is currently installed) is offline

Remove Spark3 Livy

Removes the Spark3 Livy Server component. Running this action opens the component-host mapping interface where you can remove Livy Server components

Switch dynamic allocation

Enables/disables dynamic resource allocation for Spark3

Add Spark3 ThriftServer

Adds the Spark3 ThriftServer component. Running this action opens the component-host mapping interface where you can add new ThriftServer components

Remove Spark3 ThriftServer

Removes the Spark3 ThriftServer component. Running this action opens the component-host mapping interface where you can remove ThriftServer components
Found a mistake? Seleсt text and press Ctrl+Enter to report it