- In a DFS-based (Domino File System) project, artifacts are stored alongside the rest of your project files. You can save them just as you would any other files in your project.
- In a Git-based project, artifacts are stored in a special Artifacts folder in the DFS. See the instructions below for saving artifacts in a Git-based project.
Save outputs
Use Project Artifacts and TrainingSets to store the output of your data analysis jobs or training runs. Project artifactsAn artifact is a file whose purpose is not source code or a data set. Artifacts usually contain the output from your data analysis jobs, such as plots, charts, serialized models, and so on. Your workspaces, jobs, and other executables can access data in your project artifacts just as they would any other source of data. TrainingSets
A TrainingSet is a versioned set of data, column information, and other metadata. Use TrainingSets to persist dataframes for model training and other analysis. You can store and load multiple versions of a given dataframe from a training set so you can connect a model to the specific version of a dataframe that was used to train it.
Save artifacts and push changes
- In the navigation pane of your workspace, click File Changes.
- Under Artifacts, expand File Changes.
- Enter a commit message.
- Click Sync to Domino. Domino saves your artifacts to the Domino File System (DFS).
Get the path to a Project artifact
-
Your Code files are accessible at the path
/mnt/code. For example, if you have a file under Code in your project atreference-project-ner/dataset/ner_dataset.csv, you can refer to it in your code as/mnt/code/reference-project-ner/dataset/ner_dataset.csv. -
Your Artifacts are accessible at the path
/mnt/artifacts. For example, if you have a file under Artifacts in your project calledjob_output.json, you can refer to it in your code as/mnt/artifacts/job_output.json.
When to use Datasets instead of Project files
When you start a run or launch a workspace, Domino copies your project files to a Domino execution. When working with large volumes of data, this presents the following potential issues:- By default, you can store 10,000 files in a Domino project and you might exceed the limit.
- By default, you can only transfer individual files that are 8 GB to and from your Domino project files, and you might exceed the limit.
- The time required to transfer data to and from the Domino executions is proportional to the size of the data. It can take a long time if the size of the data is large, which can lead to long startup and shutdown times for workspaces, jobs, apps, and launchers.
- Domino datasets do not have a limit on the number of files that can be stored.
- Domino datasets do not have a limit on the size of any individual file.
- Domino datasets are directly attached to executions as networked file systems, so you do not have to transfer their contents when executions start or complete.
Limitations in an on-demand compute cluster
Project files are not accessible when you are using an on-demand compute cluster. To work around this limitation, you can copy the files you need into the project’s default dataset, then see the instructions for accessing datasets in your cluster:Next steps
- Learn about project file security and sharing.
- Learn about special files in projects.
- Learn about code, data, and artifacts in Git-based projects.
- Learn about data and code in DFS-based projects.