Jobs and Scheduling
A job is a runnable Fusion object that performs a specific activity. Datasource jobs, Spark jobs, and tasks are all types of jobs. Examples of the activities include:
-
Aggregating signal data
-
Training a shallow neural model and projecting each document onto the resulting vector embedding space
-
Loading data into a data source
Job types
Each job type is a type of Fusion object that you can run or schedule to be run.
|
A job to ingest data according to the specified datasource configuration, such as See Datasource Jobs. |
|
A Spark job to process data, such as See Spark Jobs. |
|
A job to perform an HTTP call or log cleanup, such as See Tasks. |
The Jobs manager
The Jobs manager, available in the Fusion workspace at Collections > Jobs, provides a simple interface for viewing and scheduling jobs. You can also create tasks and Spark jobs here.
| You cannot create, run, or schedule datasource jobs in the Jobs manager. You must create them on the Datasources page, in the Index Workbench, or in the Quickstart. To run a datasource job, use the scheduler. |
Additional resources
|
Lucidworks offers free training to help you get started. The Quick Learning for Managing and Scheduling Jobs focuses on how to create, configure, and schedule jobs using the Fusion UI:
Visit the LucidAcademy to see the full training catalog. |
|
Lucidworks offers free training to help you get started. The Course for Jobs and Scheduling focuses on some of the most common jobs in Fusion:
Visit the LucidAcademy to see the full training catalog. |
