Domino on-demand Dask functionality is available starting with Domino 4.6.
Create a base Dask cluster environment
When using on-demand Dask in Domino you have two separate environments: one for the Dask cluster (base or worker environment) and one for the workspace/job execution (compute environment). You can get the latest released Dask images from compute Environment catalog. To create a new base Dask cluster environment, follow the general Environment management instructions with the followingenvironment_attributes:
- Base Image Select Custom Image and enter an image URI that points to a deployable Dask image. From the options published at compute Environment catalog, select the Dask cluster image available in the cluster-environment-images repository. Domino’s repository contains the latest Dask images curated for Domino. The available images include the full set of Dask components and common dependencies like Pandas and NumPy.
- Supported Clusters Select the Domino managed Dask option (required). This ensures that the environment is available for use when creating Dask clusters from workspaces and jobs.
- Visibility Set this attribute the same way you would for any other compute environment.
- Dockerfile Instructions Leave blank to use the base image provided by the Dask community. You can modify this section to include additional packages that might be necessary for your workloads and must be available on the Dask cluster nodes. See Manage dependencies to learn more.
- Pluggable Notebooks / Workspace Sessions Leave this section blank as the Dask base environments are not intended to include notebook configuration.