As part of the improvements for job queueing, filtering and general performance, Candlepin is moving away from a pure Quartz solution for job execution and is, instead, using a solution involving the Artemis messaging system.

Migration

Migrating from a Candlepin version using the “old” Quartz-based jobs to the new job system is no different than a typical upgrade, however there are a few caveats of which the maintainers should be aware:

  1. The Candlepin migration/upgrade makes no attempt to preserve existing jobs that were running or in the queue when the upgrade process begins, and any existing job entries within Quartz may be removed as part of the upgrade.
  2. Some APIs and output has changed slightly with the new system. Specifically, some job details are slightly different when fetching the status of a job, and there are additional states a job may be in.
  3. Some configuration options have changed to be more clear and standardized with the other job configurations

This leaves the responsibility of timing, conversion and compatibility to Satellite’s upgrade process or the manual upgrade process followed for non-standard deployments (i.e. hosted). However, this sounds worse than it acutally is: At the time of writing, both Satellite and hosted currently wait for manually executed jobs to complete before performing an upgrade, most job configurations have only changed location, not value, and the API changes have been minimized or duplicated to avoid compatibility issues where possible.

API Changes

While many APIs will remain indistinguishable in the new job system, some queries and features may not be possible or are achieved through different means. Below is a list of known and expected changes, along with the workaround if necessary.

  • Several new job states have been added. The states which correspond to equivalent states in the old job system have retained the previous names.
  • It is no longer necessary to provide the result_data query parameter to include the result when fetching job status

TODO: add more changes as necessary

Configuration changes

In the Artemis-based job system, all job configuration has been standardized such that all job configuration falls under the candlepin.async. path, with native job-specific config all falling under the candlepin.async.job.{job_key}. path. Note that non-native jobs may deviate from this schema.

Additionally, there are new configurations available for controlling whether jobs may or may not run on a given node.

New Global Configurations

  • candlepin.async.threads
    Controls the number of threads that will be created to process jobs. Must be a positive integer. Defaults to 10.
  • candlepin.async.jobs.{job_key}.schedule
    Sets a schedule to automatically execute the job defined by {job_key}, using a cron-like syntax. The job will be executed with zero parameters and without any validation. Care should be used when setting job schedules. Only one schedule may be defined for a job on a given node. Default value varies per native-job, defaults to empty for non-native jobs.

Converted and Dropped Job Configuration

  • pinsetter.tasks
    Removed
  • pinsetter.default_tasks
    Removed; redundant
  • candlepin.pinsetter.enable
    Removed
  • pinsetter.waiting.timeout.seconds
    Removed; currently unsupported.
  • pinsetter.retries.max
    Removed; currently unsupported globally, can be set per-job in code
  • pinsetter.org.candlepin.pinsetter.tasks.ManifestCleanerJob.max_age_in_minutes
    Moved to candlepin.async.jobs.ManifestCleanerJob.max_age_in_minutes
  • pinsetter.org.candlepin.pinsetter.tasks.EntitlerJob.throttle
    Moved to candlepin.async.jobs.EntitlerJob.throttle; currently unsupported
Last modified on 6 December 2023