domino logo
Latest (5.5)
  • Tech Ecosystem
  • Get Started
  • Domino Cloud
  • Collaborate
  • Projects
  • Work with Data
  • Workspaces
  • Environments
  • Executions
  • Deploy Models and Apps
  • Model Monitoring
  • Organizations
  • Security and Credentials
  • Notifications
  • Download the Audit Log
  • Data Planes
  • Search
  • Domino CLI
  • Troubleshooting
  • Get Help
domino logo
About Domino
Domino Data LabKnowledge BaseData Science BlogTraining
User Guide
>
Work with Data
>
Datasets
>
File Location of Datasets in Projects

File Location of Datasets in Projects

Domino executions (Workspaces, Jobs, Apps, and Launchers) automatically make datasets and their associated snapshots from a project available in a predefined path that follows the conventions described in this topic.

You do not have to use a domino.yaml configuration file to control mounting behavior, as in previous Domino releases.

The following configuration demonstrates how it translates into paths that will be available in executions.

  • Dataset called clapton (local to the project)

    • Snapshot 1 (tagged with tag1)

    • Snapshot 2 (not tagged)

  • Dataset called mingus (local to project)

    • Snapshot 1 (tagged with tag2)

    • Snapshot 2 (not tagged)

  • Dataset called ella (shared from another project)

    • Snapshot 1 (tagged with tag3)

    • Snapshot 2 (not tagged)

  • Dataset called davis (shared from another project)

    • Snapshot 1 (tagged with tag4)

    • Snapshot 2 (not tagged)

Domino Projects

For a Domino Project, the previous Datasets and Snapshots are available in the following hierarchy:

/domino
   |--/datasets
      |--/local               <== Local datasets and snapshots
         |--/clapton          <== Read-write dataset for owner and editor, read-only for reader
         |--/mingus           <== Read-write dataset for owner and editor, read-only for reader
         |--/snapshots        <== Snapshot folder organized by dataset
            |--/clapton       <== Read-write for owner and editor, read-only for reader
            |--/tag1          <== Mounted under latest tag
            |--/1             <== Always mounted under the snapshot number
            |--/2
         |--/mingus
            |--/tag2
            |--/1
            |--/2
      |--/ella                <== Read-write shared dataset for owner and editor, Read-only for reader
      |--/davis               <== Read-write shared dataset for owner and editor, Read-only for reader
      |--/snapshots           <== Shared datasets snapshots organized by dataset
         |--/ella             <== Read-write for owner and editor, read-only for reader
            |--/tag3          <== Mounted under latest tag
            |--/1             <== Always mounted under the snapshot number
            |--/2
         |--/davis
            |--/tag4
            |--/1
            |--/2

In a Workspace or when launching an execution, go to Settings to find the paths for all mounted datasets and the root for any associated snapshots.

Datasets Mounting Workspace DFS Project

Git-based Projects

For a Git-based Projects, the datasets and snapshots are available in the following hierarchy:

/mnt
   |--/data                  <== Local datasets and snapshots
     |--/clapton             <== Read-write dataset for owner and editor, read-only for reader
     |--/mingus              <== Read-write dataset for owner and editor, read-only for reader
     |--/snapshots           <== Snapshot folder organized by dataset
        |--/clapton          <== Read-write for owner and editor, read-only for reader
           |--/tag1          <== Mounted under latest tag
           |--/1             <== Always mounted under the snapshot number
           |--/2
        |--/mingus
           |--/tag2
           |--/1
           |--/2
   |--/imported
     |--/data
        |--/ella             <== Read-write shared dataset for owner and editor, read-only for reader
        |--/davis            <== Read-write shared dataset for owner and editor, read-only for reader
        |--/snapshots        <== Shared dataset snapshots organized by dataset
           |--/ella          <== Read-write for owner and editor, read-only for reader
              |--/tag3       <== Mounted under latest tag
              |--/1          <== Always mounted under the snapshot number
              |--/2
           |--/davis
              |--/tag4
              |--/1
              |--/2

In a Workspace or when launching an execution, go to Settings to find the paths for all mounted datasets and the root for any associated snapshots.

Datasets Mounting Launch Git Project

Domino Data LabKnowledge BaseData Science BlogTraining
Copyright © 2022 Domino Data Lab. All rights reserved.