Kubecost v2 Install/Upgrade
Kubecost v2 introduced massive functionality changes including changes to the backend architecture. This may require additional changes be made to your environment before upgrading from an older version of Kubecost to 2.0+. This article reviews several different common configurations and explains any necessary steps to take.
After upgrading to v2, it's possible saved reports may not properly display in the Kubecost UI. Follow this solution if you experience this problem.
Single cluster users
If you have a single cluster installation of Kubecost (i.e. one primary Kubecost instance on each cluster), then you can follow the standard upgrade process for Kubecost 2.0+.
If you are using Helm, it may look something like this:
Upon upgrading, you should see the following pods running:
Enterprise federated ETL users
As a federated ETL user, there should be minimal changes. Be aware that Kubecost 2.0+ removes the Federator and instead introduces the Aggregator. When upgrading to Kubecost 2.0+, the federator pod will not be deployed. No action is required.
Ensure you have set the Helm flag .Values.federatedETL.federatedCluster=true in all your deployments. Each cluster is still responsible for building & pushing ETL files to the object store.
When upgrading to Kubecost v2, the Aggregator should be automatically deployed. It is recommended to upgrade your primary cluster first, then secondary clusters. This is documented in our Federated ETL migration guide when upgrading.
Enterprise Thanos users
This section applies to all users who use a multi-cluster Prometheus deployment. This includes architectures such as Thanos, Amazon Managed Prometheus, and Google Managed Prometheus.
As of Kubecost v2, Kubecost requires a central object store which all Kubecost instances can write to.
A future release will add support for multi-cluster Prometheus without requiring external object-storage.
Importantly, Kubecost 2.0+ removes support for Thanos via its Helm chart. For details on how to migrate to Kubecost 2.0+, please refer to the Thanos migration guide and talk to your Kubecost representative.
Enterprise SSO/RBAC users
Kubecost 2.0+ has significant architectural changes that may impact RBAC. This should be tested before giving end-users access to the UI. Kubecost has tested various configurations and believe that 2.0+ will be 100% compatible with existing configurations.
To upgrade to Kubecost 2.0+, please add the following helm value to your existing configuration:
Troubleshooting
If you encounter any issues during the upgrade process, please refer to the section below, our Aggregator troubleshooting guide, our general troubleshooting guide, or reach out to support@kubecost.com.
Running Aggregator in v1.107 or v1.108
If you were running the Aggregator in v1.107 or v1.108, you will need to manually run kubectl delete sts/kubecost-aggregator before upgrading to v2. This is due to a breaking change in the StatefulSet template, specifically a removal of one of the Aggregator's PVs, which Helm does not allow an upgrade.
Cloud integration working in v1, but not in v2
First, ensure you have upgraded Kubecost to the latest version of v2. Patches have been released to fix miscellaneous cloud integration issues. You can learn more about what's been fixed in our release notes.
Next, ensure that you are configuring the cloud integration via the cloud-integration secret and .Values.kubecostProductConfigs.cloudIntegrationSecret Helm value. This is now the only supported way of configuring your cloud integration
Last updated