domino logo
5.2
  • Tech Ecosystem
  • Get Started
  • Domino Cloud
  • Collaborate
  • Projects
  • Work with Data
  • Workspaces
  • Environments
  • Executions
  • Deploy Models and Apps
  • Model Monitoring
  • Organizations
  • Security and Credentials
  • Notifications
  • Search
  • Domino CLI
  • Troubleshooting
  • Get Help
domino logo
About Domino
Domino Data LabKnowledge BaseData Science BlogTraining
User Guide
>
Executions
>
Jobs

Jobs

Jobs are a type of execution where an executor machine is assigned to execute a specified command in its OS shell. You can use Jobs to run Python, R, or Bash scripts from your project.

Each Job keeps a snapshot of all your files, including any results the code creates or modifies. This includes charts, tables, data files, and serialized model data. All assets are versioned and can be compared across different Jobs. See Domino File System to learn more about the file system environment your Jobs will run in.

When you start a Job, Domino launches a new environment for your code on the target executor. You can start multiple concurrent Jobs. Each gets its own container environment, so you can try multiple parameters and techniques in parallel. You can schedule recurring jobs and set up notifications, including customized reports.

Supported file types

The following lists the supported file types and the commands that Domino executes when it runs the file type:

LanguageFiletype/KeywordInvocation

Python

py

python -u

R

r

R --no-save --no-environ --no-site-file --no-restore --max-ppsize=100000

Spark

--spark

python /spark-submit-wrapper.py

Markdown

rmd/rhtml

R -e require('knitr'); knit('file_name')

Bash

sh

bash file_name

Matlab

m

matlab_executable_name

Perl

pl

perl file_name

Julia

jl

julia file_name

Python notebook

ipynb

ipython nbconvert -to notebook --execute file_name --output file_name

Fsharp

fsx

fsharpi file_name

Sas

sas/wp

run_sas.sh file_name

Project files page

You can start a Job directly from the project Files page.

  1. Go the file you want to run and click the gear icon at the end of the row in the files list, then click Run.

  2. Use the window to configure the Run. This window has additional options to set up recurring scheduled Jobs and select different hardware tiers.

    Title

    In this field, enter a name for the Job. This name will be the label for the Job in the Jobs dashboard.

    Parameters

    If there are any arguments or parameters you’d like to pass to your script, enter them here.

    Hardware tier

    This dropdown list lets you set the hardware tier used by the Job.

    Schedule to repeat

    In this section, specify if you want the run to execute only once, or to repeat on a schedule.

    Publish after complete

    Check this if you want Domino to republish a Model API once the Job completes successfully.

Domino CLI

From your workstation, you can start Jobs through the Domino CLI . Follow these instructions to install the CLI on your system.

After you have logged in and opened a project, you can start Jobs with:

domino run <filename>

Examples domino run calculateStats.r domino run runModel.m model1 .05 domino run --wait runModel.m model1 .05 domino run --direct "pip freeze | grep pandas"

Scheduled job

Use Domino to schedule Jobs in advance, and set them to execute on a regular schedule. These can be useful when you have a data source that is updated regularly.

Launchers

A Launcher is a web form that rests on top of a script that Domino can execute in a Job. You can use a Launcher to pass arguments to your script from UI fields in a customized web form.

API

You can use the Domino API to start a Job with a POST request to:

https://<domino-url>/v1/projects/<username>/<project-name>/runs

For more information about how to send valid configuration data, see the API docs.

Manage jobs with the Jobs dashboard

Click Jobs from the Project menu to open the Jobs dashboard. A table lists all Jobs from the history of this Project, sorted into tabs by queued, running, completed, and archived state. You can use the Jobs dashboard to find, manage, and view results from your Jobs in the following ways:

Archive jobs

You can archive Jobs by checking them in the table and clicking Bulk Archive.

Screen Shot 2019 02 14 at 1.15.29 PM

Compare jobs

To create a Jobs comparison report, select two Jobs in the table, then click Compare.

Screen Shot 2019 02 14 at 1.24.11 PM

Customize your Jobs dashboard columns

Click the funnel icon above the table of Jobs to customize which columns are shown in the Jobs dashboard. If any Jobs in your project have produced diagnostic statistics, the keys from dominostats.json will become available as columns, allowing you to quickly compare these outputs.

Screen Shot 2019 02 14 at 1.31.02 PM

Domino Data LabKnowledge BaseData Science BlogTraining
Copyright © 2022 Domino Data Lab. All rights reserved.