Configuration of a Hopsworks job.
Each job has a config attribute, which can be used in combination with job.save() to update the job's configuration.
Memory sizes are in MB. The two memory overhead factors are the fractions of the driver and executor memory that Spark adds to each pod as non-heap headroom. Leave them unset to keep Spark's defaults of 0.10 for Spark jobs and 0.40 for PySpark jobs. Raise the executor factor when executors are OOMKilled.
For backwards compatibility hopsworks.core.job_configuration.JobConfiguration is still available as hsfs.core.job_configuration.JobConfiguration. The use of this alias is discouraged as it is to be deprecated.