Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] KB 1.0 crash install with KB 0.9.3 #9034

Open
JashBook opened this issue Mar 11, 2025 · 0 comments
Open

[BUG] KB 1.0 crash install with KB 0.9.3 #9034

JashBook opened this issue Mar 11, 2025 · 0 comments
Assignees
Labels
kind/bug Something isn't working
Milestone

Comments

@JashBook
Copy link
Collaborator

JashBook commented Mar 11, 2025

Describe the bug

kbcli version
Kubernetes: v1.28.15-vke.18
KubeBlocks: 1.0.0-beta.32,0.9.3
kbcli: 1.0.0-beta.15

To Reproduce
Steps to reproduce the behavior:

  1. download kbcli
curl -fsSL https://kubeblocks.io/installer/install_cli.sh | bash -s v1.0.0-beta.15
  1. insatll KB 0.9.3
kbcli kubeblocks install --create-namespace --version v0.9.3 --namespace kb-system
  1. insatll KB 1.0
kbcli kubeblocks install --create-namespace --set webhooks.conversionEnabled=true --version 1.0.0-beta.32 --namespace kb-system-new 
kubectl get pod -n kb-system
NAME                                            READY   STATUS    RESTARTS   AGE
kb-addon-apecloud-otel-collector-hm5cg          1/1     Running   0          108m
kb-addon-apecloud-otel-collector-pzb49          1/1     Running   0          12m
kb-addon-apecloud-otel-collector-v8jdz          1/1     Running   0          108m
kb-addon-apecloud-otel-collector-zd6fb          1/1     Running   0          108m
kb-addon-grafana-69ffcb4854-5wsjk               3/3     Running   0          109m
kb-addon-prometheus-server-0                    2/2     Running   0          110m
kb-addon-snapshot-controller-7df64b4d5b-jpbch   1/1     Running   0          3h4m
kubeblocks-7689f6b444-gzcjs                     1/1     Running   0          6m26s
kubeblocks-dataprotection-7475d568d6-6dl5c      1/1     Running   0          6m26s

kubectl get pod -n kb-system-new 
NAME                                         READY   STATUS    RESTARTS        AGE
kubeblocks-584cbdc6c5-h9qtb                  1/1     Running   2 (2m15s ago)   6m41s
kubeblocks-dataprotection-794c84586f-m7flw   1/1     Running   0               6m41s

  1. See error
E0311 05:49:39.540188       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1alpha1.ParametersDefinition: failed to list *v1alpha1.ParametersDefinition: parametersdefinitions.parameters.kubeblocks.io is forbidden: User "system:serviceaccount:kb-system-new:kubeblocks" cannot list resource "parametersdefinitions" in API group "parameters.kubeblocks.io" at the cluster scope
W0311 05:49:43.189013       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1alpha1.ParamConfigRenderer: paramconfigrenderers.parameters.kubeblocks.io is forbidden: User "system:serviceaccount:kb-system-new:kubeblocks" cannot list resource "paramconfigrenderers" in API group "parameters.kubeblocks.io" at the cluster scope
E0311 05:49:43.189046       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1alpha1.ParamConfigRenderer: failed to list *v1alpha1.ParamConfigRenderer: paramconfigrenderers.parameters.kubeblocks.io is forbidden: User "system:serviceaccount:kb-system-new:kubeblocks" cannot list resource "paramconfigrenderers" in API group "parameters.kubeblocks.io" at the cluster scope
W0311 05:49:47.610336       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1alpha1.ComponentParameter: componentparameters.parameters.kubeblocks.io is forbidden: User "system:serviceaccount:kb-system-new:kubeblocks" cannot list resource "componentparameters" in API group "parameters.kubeblocks.io" at the cluster scope
E0311 05:49:47.610359       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1alpha1.ComponentParameter: failed to list *v1alpha1.ComponentParameter: componentparameters.parameters.kubeblocks.io is forbidden: User "system:serviceaccount:kb-system-new:kubeblocks" cannot list resource "componentparameters" in API group "parameters.kubeblocks.io" at the cluster scope
W0311 05:49:53.551850       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1alpha1.Parameter: parameters.parameters.kubeblocks.io is forbidden: User "system:serviceaccount:kb-system-new:kubeblocks" cannot list resource "parameters" in API group "parameters.kubeblocks.io" at the cluster scope
E0311 05:49:53.551872       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1alpha1.Parameter: failed to list *v1alpha1.Parameter: parameters.parameters.kubeblocks.io is forbidden: User "system:serviceaccount:kb-system-new:kubeblocks" cannot list resource "parameters" in API group "parameters.kubeblocks.io" at the cluster scope
W0311 05:49:55.850669       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.Role: roles.rbac.authorization.k8s.io is forbidden: User "system:serviceaccount:kb-system-new:kubeblocks" cannot list resource "roles" in API group "rbac.authorization.k8s.io" at the cluster scope
E0311 05:49:55.850693       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.Role: failed to list *v1.Role: roles.rbac.authorization.k8s.io is forbidden: User "system:serviceaccount:kb-system-new:kubeblocks" cannot list resource "roles" in API group "rbac.authorization.k8s.io" at the cluster scope
W0311 05:50:19.392445       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1alpha1.ParametersDefinition: parametersdefinitions.parameters.kubeblocks.io is forbidden: User "system:serviceaccount:kb-system-new:kubeblocks" cannot list resource "parametersdefinitions" in API group "parameters.kubeblocks.io" at the cluster scope
E0311 05:50:19.392464       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1alpha1.ParametersDefinition: failed to list *v1alpha1.ParametersDefinition: parametersdefinitions.parameters.kubeblocks.io is forbidden: User "system:serviceaccount:kb-system-new:kubeblocks" cannot list resource "parametersdefinitions" in API group "parameters.kubeblocks.io" at the cluster scope
W0311 05:50:23.005668       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1alpha1.ComponentParameter: componentparameters.parameters.kubeblocks.io is forbidden: User "system:serviceaccount:kb-system-new:kubeblocks" cannot list resource "componentparameters" in API group "parameters.kubeblocks.io" at the cluster scope
E0311 05:50:23.005688       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1alpha1.ComponentParameter: failed to list *v1alpha1.ComponentParameter: componentparameters.parameters.kubeblocks.io is forbidden: User "system:serviceaccount:kb-system-new:kubeblocks" cannot list resource "componentparameters" in API group "parameters.kubeblocks.io" at the cluster scope
2025-03-11T05:50:30.223Z	ERROR	Could not wait for Cache to sync	{"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "error": "failed to wait for cluster caches to sync: timed out waiting for cache to be synced for Kind *v1.Cluster"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:203
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:208
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:234
sigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/runnable_group.go:223
2025-03-11T05:50:30.223Z	ERROR	Could not wait for Cache to sync	{"controller": "servicedescriptor", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ServiceDescriptor", "error": "failed to wait for servicedescriptor caches to sync: timed out waiting for cache to be synced for Kind *v1.ServiceDescriptor"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:203
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:208
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:234
sigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/runnable_group.go:223
...
2025-03-11T05:50:30.265Z	INFO	eventHandledError	{"controller": "event", "controllerGroup": "", "controllerKind": "Event", "Event": {"name":"zkeeper-upkb910-zookeeper-0.182ba892a46e120e","namespace":"default"}, "namespace": "default", "name": "zkeeper-upkb910-zookeeper-0.182ba892a46e120e", "reconcileID": "6834b242-2cae-430c-b3fe-0ce051018b13", "event": {"name":"zkeeper-upkb910-zookeeper-0.182ba892a46e120e","namespace":"default"}}
2025-03-11T05:50:30.270Z	ERROR	Reconciler error	{"controller": "event", "controllerGroup": "", "controllerKind": "Event", "Event": {"name":"mysql-upkb910-mysql-scaling-0-data.182ba8e46a029af3","namespace":"default"}, "namespace": "default", "name": "mysql-upkb910-mysql-scaling-0-data.182ba8e46a029af3", "reconcileID": "4124fe90-f404-445f-a037-27516d666925", "error": "client rate limiter Wait returned an error: context canceled"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:266
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:227
2025-03-11T05:50:30.271Z	INFO	eventHandledError	{"controller": "event", "controllerGroup": "", "controllerKind": "Event", "Event": {"name":"mysql-upkb910-mysql-83c70b8e-preparedata-2.182ba9010eecde07","namespace":"default"}, "namespace": "default", "name": "mysql-upkb910-mysql-83c70b8e-preparedata-2.182ba9010eecde07", "reconcileID": "2e75ffc3-8c41-4189-b4f8-91576924661d", "event": {"name":"mysql-upkb910-mysql-83c70b8e-preparedata-2.182ba9010eecde07","namespace":"default"}}
2025-03-11T05:50:30.275Z	INFO	probe event failed	{"controller": "event", "controllerGroup": "", "controllerKind": "Event", "Event": {"name":"redis-upkb910-redis-1.gjmpgv675wjwtm4q","namespace":"default"}, "namespace": "default", "name": "redis-upkb910-redis-1.gjmpgv675wjwtm4q", "reconcileID": "2ff7eeec-27f2-47c0-8ca2-2585d5a17e7c", "event": {"name":"redis-upkb910-redis-1.gjmpgv675wjwtm4q","namespace":"default"}, "message": ""}
2025-03-11T05:50:30.275Z	INFO	handleEventError	{"controller": "event", "controllerGroup": "", "controllerKind": "Event", "Event": {"name":"redis-upkb910-redis-1.gjmpgv675wjwtm4q","namespace":"default"}, "namespace": "default", "name": "redis-upkb910-redis-1.gjmpgv675wjwtm4q", "reconcileID": "2ff7eeec-27f2-47c0-8ca2-2585d5a17e7c", "event": {"name":"redis-upkb910-redis-1.gjmpgv675wjwtm4q","namespace":"default"}}
2025-03-11T05:50:30.275Z	INFO	probe event failed	{"controller": "event", "controllerGroup": "", "controllerKind": "Event", "Event": {"name":"redis-upkb910-redis-1.5c7kznp2k2qwg92b","namespace":"default"}, "namespace": "default", "name": "redis-upkb910-redis-1.5c7kznp2k2qwg92b", "reconcileID": "fa3977a9-3284-4506-98f6-ed147adbe3ca", "event": {"name":"redis-upkb910-redis-1.5c7kznp2k2qwg92b","namespace":"default"}, "message": ""}
2025-03-11T05:50:30.275Z	INFO	handleEventError	{"controller": "event", "controllerGroup": "", "controllerKind": "Event", "Event": {"name":"redis-upkb910-redis-1.5c7kznp2k2qwg92b","namespace":"default"}, "namespace": "default", "name": "redis-upkb910-redis-1.5c7kznp2k2qwg92b", "reconcileID": "fa3977a9-3284-4506-98f6-ed147adbe3ca", "event": {"name":"redis-upkb910-redis-1.5c7kznp2k2qwg92b","namespace":"default"}}
2025-03-11T05:50:30.275Z	INFO	All workers finished	{"controller": "event", "controllerGroup": "", "controllerKind": "Event"}
2025-03-11T05:50:30.275Z	INFO	Stopping and waiting for caches
W0311 05:50:30.275340       1 reflector.go:462] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: watch of *v1.ServiceAccount ended with: an error on the server ("unable to decode an event from the watch stream: context canceled") has prevented the request from succeeding
W0311 05:50:30.275384       1 reflector.go:462] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: watch of *v1.ClusterDefinition ended with: an error on the server ("unable to decode an event from the watch stream: context canceled") has prevented the request from succeeding
W0311 05:50:30.275388       1 reflector.go:462] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: watch of *v1.PersistentVolumeClaim ended with: an error on the server ("unable to decode an event from the watch stream: context canceled") has prevented the request from succeeding
W0311 05:50:30.275413       1 reflector.go:462] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: watch of *v1.ShardingDefinition ended with: an error on the server ("unable to decode an event from the watch stream: context canceled") has prevented the request from succeeding
W0311 05:50:30.275444       1 reflector.go:462] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: watch of *v1alpha1.Restore ended with: an error on the server ("unable to decode an event from the watch stream: context canceled") has prevented the request from succeeding
2025-03-11T05:50:30.275Z	INFO	Stopping and waiting for webhooks
2025-03-11T05:50:30.275Z	INFO	controller-runtime.webhook	Shutting down webhook server with timeout of 1 minute
2025-03-11T05:50:30.275Z	INFO	Stopping and waiting for HTTP servers
2025-03-11T05:50:30.275Z	INFO	shutting down server	{"kind": "health probe", "addr": "[::]:8081"}
2025-03-11T05:50:30.275Z	INFO	controller-runtime.metrics	Shutting down metrics server with timeout of 1 minute
2025-03-11T05:50:30.275Z	INFO	Wait completed, proceeding to shutdown the manager
2025-03-11T05:50:30.280Z	ERROR	error received after stop sequence was engaged	{"error": "leader election lost"}
sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).engageStopProcedure.func1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/internal.go:490
2025-03-11T05:50:30.280Z	ERROR	setup	problem running manager	{"error": "failed to wait for cluster caches to sync: timed out waiting for cache to be synced for Kind *v1.Cluster"}
main.main
	/src/cmd/manager/main.go:678
runtime.main
	/usr/local/go/src/runtime/proc.go:267

KubeBlocks_1.0_crash.logs.txt

Expected behavior
insatll KB 1.0 with KB 0.9.3 ok

Screenshots
If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

  • OS: [e.g. iOS]
  • Browser [e.g. chrome, safari]
  • Version [e.g. 22]

Additional context
Add any other context about the problem here.

@JashBook JashBook added the kind/bug Something isn't working label Mar 11, 2025
@JashBook JashBook added this to the Release 1.0.0 milestone Mar 11, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants