domino logo
5.2
  • Tech Ecosystem
  • Get Started
  • Domino Cloud
  • Collaborate
  • Projects
  • Work with Data
  • Workspaces
  • Environments
  • Executions
  • Deploy Models and Apps
  • Model Monitoring
  • Organizations
  • Security and Credentials
  • Notifications
  • Search
  • Domino CLI
  • Troubleshooting
  • Get Help
domino logo
About Domino
Domino Data LabKnowledge BaseData Science BlogTraining
User Guide
>
Executions
>
Jobs
>
Scheduled Jobs

Scheduled Jobs

You can schedule Jobs in advance and set them to execute on a regular cadence. These can be useful when you have a data source that is updated regularly.

To schedule a Job:
  1. Go to a project.

  2. From the navigation pane, click Scheduled Jobs.

  3. Click New Scheduled Job.

  4. In the Create a Scheduled Job page, define the job:

    scheduled job er 1

    Scheduled Job Name

    Enter the name of the job. The Jobs Dashboard lists each job by this name.

    File Name

    Enter the name of the file to execute. Include any optional arguments to pass to the file.

    Hardware tier

    Select the hardware tier used by the Job.

    Environment

    Select the compute environment used by the Job.

    Optional: By default, the latest revision of your environment is used when your environment starts. To use another revision of the environment:

    1. In the Environments section, click Change.

      scheduled job er 1

      A list of revisions for this environment opens.

    2. Click the revision number of the environment you want for your job. The revisions you selected displays in the Revision section.

      Note
      Domino recommends using the revision set as the active one by the project owner. If you select a different revision, the Not Recommended warning is shown.
    Data

    Click to expand the section to see the Datasets configuration used by the Job.

  5. Click Next. Then, define the Compute Cluster:

    scheduled_job_2.png

    Attach Compute Cluster

    Use this option to provision and attach a compute cluster to the Job. The remainder of the configurations are explained in:

    • Spark Cluster Settings

    • Ray Cluster Settings

    • Dask Cluster Settings

  6. Click Next. Set up the Schedule:

    scheduled_job_3.png

    Use custom expression

    Enter a custom Quartz CronTrigger expression. For example, if you want to run the job on the 5th minute of every day, enter the following:

    0 5 * ? * *

    Note
    To learn more about these expressions, see CronTrigger expressions.
    Repeat every

    Set the frequency at which you want the Job to repeat.

    Run sequentially

    Setting a Job to Run sequentially will cause the scheduler to always wait for the last Job it started to complete before starting the next one. For example, if you set up a scheduled Job to run once per hour, and one of the Jobs launched by the scheduler takes 90 minutes to complete, the next hourly Job will not start until the previous one has finished. Otherwise, multiple Jobs from this scheduler will be allowed to run simultaneously. The scheduler will not wait for the previous Job to finish if it’s still running. This mode should be used when your Job doesn’t depend on output from the previous Job.

  7. Click Next. Set up Actions:

    scheduled_job_4.png

    Notify Emails

    Enter a list of email addresses to notify when the Job completes.

    Update Model API

    If a Model API has been publishing from the Project, the selected Model API will be republished after the Job has completed. Use this for retraining and updating a Model API regularly.

Domino Data LabKnowledge BaseData Science BlogTraining
Copyright © 2022 Domino Data Lab. All rights reserved.