Before you can start using on-demand Spark clusters on Domino you must enable and configure the functionality on your deployment.
Your Domino administrator must do the following:
ShortLived.SparkClustersEnabledfeature flag to
trueto enable on-demand Spark functionality.
ShortLived.UseNewWorkspaceChrometo true. This enables the new Domino workspace experience which allows for easy access to the Spark Web application.
By default, Domino does not come with a Spark compatible compute environment that can be used for the components of the cluster. Without at least one such environment available, you cannot create a cluster.
When using on-demand Spark in Domino you will one environment for the Spark cluster (base or worker environment) and one environment for the workspace/job execution (compute environment).
Follow the instructions to create an environment
In the Base image section, select Custom Image and specify an image URI that points to a deployable Spark image.