Requirements for Domino installation
Namespaces
You don’t have to configure namespaces prior to install. Domino creates three namespaces in the cluster during installation, according to the following specifications:Node pools
The OpenShift cluster must have worker nodes with the following specifications and distinct node labels. It includes optional pools:- OpenShift Container Storage (OCS). This pool runs the storage nodes as part of the OCS Operator which is part of the OpenShift Data Foundation (ODF) Operator.
- GPU. Nodes in this pool contain Nvidia GPUs.
Generally, the
platform worker nodes need an aggregate minimum of 24 CPUs and 96G of memory. Domino recommends that you spread the resources across multiple nodes with proper failure isolation (for example, availability zones).
We recommend deploying to at least three availability zones (AZs) for high availability and tolerance. You must create a machineset per AZ per node pool, as shown in this AWS MachineSet Example.
Node autoscaling
For clusters on top of an elastic cloud provider like AWS, you must create ClusterAutoscaler, MachineAutoscaler and MachineHealthCheck resources to achieve node autoscaling.GPU support
To run GPU workloads in OpenShift, the following must be installed:- Node Feature Discovery (NFD) Operator
- NFD Instance
- Nvidia GPU Operator
- ClusterPolicy
- GPU Enabled MachineSet
Storage
See the storage requirements for your infrastructure. We recommend using the Openshift Data Foundation (ODF) Operator to handle the storage. To create a storage cluster for ODF, the following must be installed:- OCS Dedicated MachineSet (optional but recommended)
- ODF Operator
- StorageSystem
- StorageCluster
storageclasses are created:
-
ocs-storagecluster-ceph-rbd -
ocs-storagecluster-cephfs
Networking
Domain
Domino must be configured to serve from a specific FQDN. To serve Domino securely over HTTPS, you also need an SSL certificate that covers the chosen name.Network plugin
Domino relies on Kubernetes network policies to manage secure communication between pods in the cluster. By default, OpenShift uses the Cluster Network Operator to deploy the OpenShift SDN default CNI network provider plugin, which supports network policies and hence should just work.Ingress
Domino uses the NGNIX ingress controller maintained by the Kubernetes project instead of (but does not replace) the OpenShift implemented HAProxy-based ingress controller and deploys the ingress controller as a node port service. By default, the ingress listens on node ports443 (HTTPS) and 80 (HTTP).
Load balancer
A load balancer must be set up to use your DNS name. For example, in AWS, you must set up the DNS so it points a CNAME at an Elastic Load Balancer. After you complete the installation process, you must configure the load balancer to balance across the platform nodes at the ports specified by your ingress.External resources
If you plan to connect your cluster to other resources like data sources or authentication services, pods running on the cluster must have network connectivity to those resources.Container registry
Domino deploys its own container image registry instead of using the OpenShift built in container image registry. During installation, the OpenShift cluster image configuration is modified to trust the Domino certificate authority (CA). This is done to ensure that OpenShift can run pods using Domino’s custom built images. In theimages.config.openshift.io/cluster resource, you can find a reference to a ConfigMap that contains the Domino CA.
Bootstrapping
If you opt to use theddlctl bootstrap subcommand to install the platform operator and Domino, make sure to pass the --openshift flag.
For more information on bootstrapping, see Bootstrap a Domino Cluster.
Create a configuration file
-
Get the
$FLEETCOMMAND_AGENT_TAGfor your target release from the releases page. -
Use environment variables to set some values used by the
ddlctlCLI. This simplifies the commands you’ll run while installing Domino components: -
Generate an OpenShift configuration file: