Skip to content

hopsworks.execution #

[source] Execution #

For backwards compatibility hopsworks.execution.Execution is still available as hsfs.core.execution.Execution. The use of this alias is discouraged as it is to be deprecated.

Returned by

[source] id property #

Id of the execution.

[source] job_name property #

Name of the job the execution belongs to.

[source] job_type property #

Type of the job the execution belongs to.

[source] state property #

Current state of the execution.

Can be: INITIALIZING, INITIALIZATION_FAILED, FINISHED, RUNNING, ACCEPTED, FAILED, KILLED, NEW, NEW_SAVING, SUBMITTED, AGGREGATING_LOGS, FRAMEWORK_FAILURE, STARTING_APP_MASTER, APP_MASTER_START_FAILED, GENERATING_SECURITY_MATERIAL, or CONVERTING_NOTEBOOK.

[source] final_status property #

Final status of the execution. Can be UNDEFINED, SUCCEEDED, FAILED or KILLED.

[source] submission_time property #

Timestamp when the execution was submitted.

[source] stdout_path property #

Path in Hopsworks Filesystem to stdout log file.

[source] stderr_path property #

Path in Hopsworks Filesystem to stderr log file.

[source] app_id property #

Application id for the execution.

[source] hdfs_user property #

Filesystem user for the execution.

[source] args property #

Arguments set for the execution.

[source] progress property #

Progress of the execution.

[source] user property #

User that submitted the execution.

[source] duration property #

Duration in milliseconds the execution ran.

[source] success property #

Boolean to indicate if execution ran successfully or failed.

RETURNS DESCRIPTION

bool. True if execution ran successfully. False if execution failed or was killed.

[source] download_logs #

download_logs(
    path: str | None = None,
) -> tuple[str | None, str | None]

Download stdout and stderr logs for the execution.

Downloading and printing the logs 
# Download logs
out_log_path, err_log_path = execution.download_logs()

out_fd = open(out_log_path, "r")
print(out_fd.read())

err_fd = open(err_log_path, "r")
print(err_fd.read())
PARAMETER DESCRIPTION
path

path to download the logs.

TYPE: str | None DEFAULT: None

RETURNS DESCRIPTION
stdout

Path to downloaded log for stdout.

TYPE: str | None

stderr

Path to downloaded log for stderr.

TYPE: str | None

[source] delete #

delete()

Delete the execution.

Potentially dangerous operation

This operation deletes the execution.

RAISES DESCRIPTION
hopsworks.client.exceptions.RestAPIError

If the backend encounters an error when handling the request.

[source] stop #

stop()

Stop the execution.

Potentially dangerous operation

This operation stops the execution.

RAISES DESCRIPTION
hopsworks.client.exceptions.RestAPIError

If the backend encounters an error when handling the request.

[source] await_termination #

await_termination(timeout: float | None = None)

Wait until execution terminates.

PARAMETER DESCRIPTION
timeout

The maximum waiting time in seconds. If None the waiting time is unbounded. Note: the actual waiting time may be bigger by approximately 3 seconds.

TYPE: float | None DEFAULT: None

RAISES DESCRIPTION
hopsworks.client.exceptions.RestAPIError

If the backend encounters an error when handling the request.

[source] get_url #

get_url()

Get url to view execution details in Hopsworks UI.