Domino supports adding Git repositories to projects. Repositories that have been added to a project are available to Runs started in that project, allowing you to access the contents of those repositories just as you would your Domino files. This article explains how you can add a Git repository to a project, access the added repository from within a Workspace, and commit any changes back to the repository.
Domino supports connecting to Git servers via HTTPS and SSH, and both public and private repositories.
If you are adding a private repository, want to write commits to remote, or are using SSH, you will need to add Git credentials to your Domino account. Domino will use these credentials to authenticate with the service hosting your repository when you start a Run.
Domino supports storing two types of credentials:
-
Personal Access Tokens
-
SSH private keys
Option 1: SSH key creation
To connect with SSH, you’ll need a private SSH key that corresponds to a public key that you’ve added to your Git service. Check out the `GitHub documentation Connect to Github with SSH for thorough instructions on creating and adding keys.
Option 2: Personal Access Token creation
You will need a Personal Access Token to access a private repository via HTTPS. You will need a Personal Access Token if the URI you want to use to interact with a repository is formatted as:
Personal Access Tokens are supported by the following Git services:
To connect to Bitbucket repositories via HTTPS from Domino, you must add a Bitbucket App Password credential to your Domino account.
If your GitHub organization requires SSO then you will need to authorize the PAT or SSH key in order to access private repos via Domino.
Read the GitHub documentation for instructions about authorizing keys for SSO on Github.
Option 1: SSH private key
You will need an SSH Private Key to access a repository via SSH. You will need an SSH private key if the URI you want to use to interact with a repository is formatted as:
<user>@<domain>:<username>/<repository>.git
SSH access is supported by the following Git services.
After setting up SSH access with your Git service, you have both a public key that you provided to the Git service, and a private key. Use these steps to add the private key to Domino:
-
In Domino, click your username, then click Account Settings.
-
Go to Git Credentials and click Add a New Credential.
-
For Domain, enter the exact domain of the service hosting your repository, such as
github.com,bitbucket.com, oryour-internal-gitlab-url.com. -
For Authentication Credential Type, select Private SSH Key.
-
Paste in your private key. This will be the contents of the private key file that matches the public key you provided to your Git service.
-
If you set up your SSH keys to require a passphrase when used, enter it in the Passphrase field, then click Add Credential.
-
You should now see your credential listed in the Git Credentials panel. You can also delete it from this panel if desired.
Option 2: Personal Access Token
The Personal Access Token you generate needs to have read and write access to your private repositories. After generating a Personal Access Token in your Git service, use these steps to add it to Domino:
-
In Domino, click your username in the upper right, then click Account Settings.
-
Scroll down to the panel labeled Git Credentials, then click Add a New Credential.
-
In the Domain field, enter the exact domain of the service hosting your repository, such as github.com, bitbucket.com, or your-internal-gitlab-url.com.
-
For Authentication Credential Type, click to select Personal Access Token.
-
Enter your Personal Access Token, then click Add Credential.
-
You should now see your credential listed in the Git Credentials panel. You can also delete it from this panel if desired.
-
Open the project you want to add a repository to, then click Files from the left navigation bar.
-
Click to open the Git Repositories tab, then click Add a New Repository.
-
Enter an optional directory name and the HTTPS or SSH URI of the repository you want to add. The directory name will be the directory in
/reposthat this repository clones into. It defaults to the name of the repository. -
Use the dropdown menu to choose which branch of the repository you want Domino to check out when it clones this repository into a run or workspace. If you leave this setting at Use default branch, Domino will check out the branch specified as default by your Git service, typically
master. You can also specify a different branch name, tag name, commit ID, or supply a custom Git ref.
-
Click Add Repository.
When you start a run or workspace in a project, any repositories added to the project are cloned into /repos and will have the branch or commit you specified checked out.
Remember that your Domino working directory
is in /mnt, which is a sibling of /repos.
Both directories are in the filesystem root (/).
Scripts you have added as Domino files can interact with the contents of these repositories by specifying an absolute path to
/repos/<repo-name>/<file>.
When you start a Workspace session in a project that has added Git repositories, you will see those repositories listed in the Session Overview under Git repos. If you make changes to the contents of those repositories while running the workspace, those changes will be itemized file-by-file under each repository.
If you want to commit those changes back to the repository, click the checkbox next to the repository name and then click Full Sync.
You will be prompted to supply a commit message. This commit message will be attached to commits to the selected Git repositories, and to a new revision of the Domino project if there are changes to Domino files. Git commits will be pushed to the default branch you specified when adding the repository.
If you attempt to stop your workspace while there are uncommitted changes to your Git repositories, you will be prompted to commit those changes. This works the same as the Session Overview interface. Click the checkbox next to the repositories you want to commit to, supply a commit message, and click Stop and Commit.
If you try to commit when there are conflicts between your local changes and the state of the default branch in remote, Domino will create a new branch from its local state. Domino will then push that new branch to remote.
After this happens, you will need to resolve those conflicts outside of Domino, or use the command line in your Workspace session to resolve them. The next time you launch a Workspace session, Domino will check out the default branch from remote, not the new branch it pushed.
Both Jupyter and RStudio workspaces have command line tools.
You can use these to interact with your repositories with conventional Git commands.
Navigate to /repos in your command line to find your project’s repositories.
See the official Git documentation to learn more about using Git on the command line.
To open the RStudio command line, click Tools > Shell…
To open the Jupyter command line, from the Files tab click New > Terminal.
When viewing the Details tab of a Domino Run, at the bottom you will find a Repositories panel. You can expand this panel to see details of how the repository changed during the Run. Domino records the checked out commit at the start of the Run and the end of the Run.
Errors occurred while processing dependencies. Contact support@dominodatalab.com:
Credentials are required for your repository: project-name (ssh://git@github.com/your-org/projectname.git)Your Git Credential added to Domino may have the incorrect Domain. Double-check the domain field in your Git credential to ensure it matches your exact Git repository URL, like:
-
github.com
-
bitbucket.com
-
your-internal-gitlab-url.com
Errors occurred while processing dependencies. Contact support@dominodatalab.com:
Authentication is required for your repository:
The repository provided requires credentials but none were found.
Please add SSH or PAT authentication to your Domino account.If you encounter this error, check the following: Confirm that your private SSH key or PAT has been added to the Git Credentials section of your Domino Account Settings page. If your organization’s Git repository requires SSO access, you might have to authorize the key you have added. See the following instructions on authorizing keys for SSO on Github.
Errors occurred while processing dependencies. Contact support@dominodatalab.com:
remote: Invalid username or password.
fatal: Authentication failed for 'https://github.com/<your account>/<your repo>/'If your organization’s Git repo requires SSO access, you might have to authorize the key you added. See authorizing keys for SSO on Github.