Hopsworks.ai is our managed platform for running Hopsworks and the Feature Store in the cloud. It integrates seamlessly with third-party platforms such as Databricks, SageMaker, and KubeFlow.
Hopsworks.ai requires a set of permissions to be able to manage resources in the user’s cloud account. By default, these permissions are set to easily allow a wide range of different configurations and allow us to automate as many steps as possible. While we ensure to never access resources we shouldn’t, we do understand that this might not be enough for your organization or security policy. The following guides explain how you can reduce the permissions you give to hopsworks.ai by doing some of the cluster creation steps manually: Azure, AWS.
Integration with managed Kubernetes#
When deploying a cluster you can set it up to use managed Kubernetes to run python jobs, Jupyter servers, and ML model serving in a scalable way. This guide provides step-by-step instructions on how to set up Kubernetes and start a cluster using it: AWS.
Integration with third-party platforms#
Once you have deployed a cluster with hopsworks.ai you can connect to it from third-party platforms such as Databricks, AWS Sagemaker, Azure HDInsight, etc. Go to integrations for more third-party platforms and details.
You can find more information on the following topics by clicking on the links: