Skip to content

Kueue Scheduler ​

Kueue Scheduler manages the scheduling policies that assign workloads to queues and allocate cluster resources according to priority.

Scheduling Policy Overview ​

The Kueue scheduler processes Workloads in the following order:

  1. Quota check: Verify the Workload can run within the Cluster Queue's nominalQuota
  2. Cohort Borrowing: Re-check feasibility by borrowing unused quota from other Cluster Queues in the same Cohort
  3. Preemption: Preempt lower-priority Workloads to admit higher-priority ones

Priority Configuration ​

SettingDescription
WorkloadPriorityClassAssign a priority class directly to a Workload
PriorityClass (k8s)Reference a Kubernetes PriorityClass

Cohort Configuration ​

A Cohort is a group of Cluster Queues that share quota:

  • nominalQuota: Baseline guaranteed resource amount
  • borrowingLimit: Maximum resources that can be borrowed from other Queues
  • lendingLimit: Maximum resources that can be lent to other Queues

Preemption Policies ​

PolicyDescription
NeverPreemption disabled
LowerPriorityPreempt only lower-priority Workloads
LowerOrNewerEqualPriorityPreempt lower or equally-prioritized newer Workloads

WARNING

Changing preemption policies can affect running Workloads. Coordinate with your team before making changes.

The New Standard for AI Infrastructure