Skip to main content

Edge Cluster Upgrade Behavior

When you update an active Edge cluster's profile, Palette will upgrade the active cluster to the latest version of the profile. Depending on the nature of the change, implementing an upgrade might involve repaving a cluster, rebooting a cluster, restarting services, or doing nothing. For more information about cluster repaves, refer to Repave Behavior and Configurations. For more information about how to update a cluster profile, refer to Update a Cluster.

warning
  • If a cluster's Kubernetes service is down, updates to the cluster's profile will not get applied to the cluster. You must fix the issue impacting the Kubernetes service first. Once the Kubernetes service is back to being operational, the Palette agent will apply the updates from the cluster profile to the cluster.

Known Issues

  • For RKE2 clusters, updates to the stages.* section in the Operating System (OS) and the Kubernetes pack of the cluster profile will trigger a repave instead of a reboot. The only exception is changes to the stages.reconcile.* section, which will behave as expected and trigger a configuration reload.

Upgrade Behaviors

A cluster could respond to an upgrade in several ways. The table below lists the potential upgrade behaviors you could encounter.

Upgrade BehaviorDescription
RepaveRepaves all nodes in the cluster, starting with the control plane.
RebootReboots all nodes in the cluster, starting with the control plane.
Service restartRestarts specific services in all nodes in the cluster, starting with the control plane.
Configuration reloadUpdates the configurations without needing to restart services or the node. This is only triggered when you update stage.reconcile.* in the Operating System (OS) layer.
No operations (No-op)Acknowledges the update request but does nothing.

Upgrade Behavior by Change Location

Updates in the OS or Kubernetes layers can trigger different upgrade behaviors depending on the exact values changed.

OS Layer

RepaveRebootService RestartNo-op
- options.system.uri- stages.rootfs.*
- stages.initramfs.*
- stages.boot.*
- stages.fs.*
- stages.network.*
- stages.after-install.*
- stages.after-install-chroot.*
- stages.after-upgrade.*
- stages.after-upgrade-chroot.*
- stages.after-reset.*
- stages.after-reset-chroot.*
- stages.before-install.*
- stages.before-upgrade.*
- stages.before-reset.*
None.- pack.*
- providerCredentials.*
- options.system.registry
- options.system.repo
- options.system.k8sDistribution
- options.system.osName
- options.system.peVersion
- options.system.customTag
- options.system.osVersion
warning

Changes to any other parameters that are used by the options.system.uri parameter will also trigger a cluster repave. For example, if your options.system.uri parameter is {{ .spectro.pack.edge-native-byoi.options.system.registry }}/{{ .spectro.pack.edge-native-byoi.options.system.repo }}:{{ .spectro.pack.edge-native-byoi.options.system.k8sDistribution }}, changes to .spectro.pack.edge-native-byoi.options.system.registry will trigger a cluster repave because it changes the options.system.uri parameter.

Kubernetes Layer

RepaveRebootService RestartNo-op
None.- stages.rootfs.*
- stages.initramfs.*
- stages.boot.*
- stages.fs.*
- stages.network.*
- stages.after-install.*
- stages.after-install-chroot.*
- stages.after-upgrade.*
- stages.after-upgrade-chroot.*
- stages.after-reset.*
- stages.after-reset-chroot.*
- stages.before-install.*
- stages.before-upgrade.*
- stages.before-reset.*
- cluster.*
- clientConfig.*
- pack.*

Network Layer

Changes made to the Container Network Interface (CNI) pack typically do not result in cluster repave or reboot, and can be applied by restarting the related networking services.

warning

Do not change to a different CNI pack after provisioning a cluster. You can make changes to the existing CNI pack, but if you want to use a different CNI pack altogether, we recommend you create another cluster.

Storage Layer

Changes made to the storage layer typically do not result in cluster repave or reboot and can be applied by restarting the related storage services.