How To Clone a Git Repository#
Repositories are cloned and managed within the scope of a project. The content of the repository will reside on the Hopsworks File System. The content of the repository can be edited from Jupyter notebooks and can for example be used to configure Jobs. Repositories can be managed from the Git section in the project settings. The Git overview in the project settings provides a list of repositories currently cloned within the project, the location of their content as well which branch and commit their HEAD is currently at.
The feature is currently in Beta and will be improved in the upcoming releases.
This guide requires that you have previously configured a Git Provider with your git credentials.
Step 1: Navigate to repositories#
Project settings page you can find the
This page lists all the cloned git repositories under
Repositories, while operations performed on those repositories, e.g
commit are listed under
Step 2: Clone a repository#
To clone a new repository, click on the
Clone repository button on the Git overview page.
The clone dialog asks you to specify the URL of the repository to clone. The supported protocol is HTTPS. As an example, if the repository is hosted on GitHub, the URL should look like:
Then specify which branch you want to clone. By default the
main branch will be used, however a different branch or commit can be specified by selecting
Clone from a specific branch.
You can select the folder, within your project, in which the repository should be cloned. By default, the repository is going to be cloned within the
Resources dataset. However, by clicking on the location button, a different location can be selected.
Finally, click on the
Clone repository button to trigger the cloning of the repository.
Step 3: Track progress of the clone#
The progress of the git clone can be tracked under
Step 4: Browse repository files#
File browser page you can now browse the files of the cloned repository, found on the path in
Step 5: Repository actions#
The operation to perform on the cloned repository can be found in the dropdown as shown below.
Step 1: Get the git API#
This snippet assumes the python script is in the current working directory and named
script.py. It will upload the python script to run to the
import hopsworks connection = hopsworks.connection() project = connection.get_project() git_api = project.get_git_api()
Step 2: Clone the repository#
REPO_URL="https://github.com/logicalclocks/hops-examples.git" # git repository HOPSWORKS_FOLDER="Resources" # path in hopsworks filesystem to clone to PROVIDER="GitHub" BRANCH="master" # optional branch to clone examples_repo = git_api.clone(REPO_URL, HOPSWORKS_FOLDER, PROVIDER, branch=BRANCH)
A notebook for managing git can be found here.
In this guide you learned how to clone a Git repository. You can now start Jupyter from the cloned git repository path to work with the files.