Kubernetes刪除資源后持續terminating狀態

Error from server (Forbidden): error when creating "/root/istio.yaml": configmaps "istio-galley-configuration" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": configmaps "prometheus" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": configmaps "istio-security-custom-resources" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": configmaps "istio" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": configmaps "istio-sidecar-injector" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": serviceaccounts "istio-galley-service-account" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": serviceaccounts "istio-egressgateway-service-account" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": serviceaccounts "istio-ingressgateway-service-account" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": serviceaccounts "istio-mixer-service-account" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": serviceaccounts "istio-pilot-service-account" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": serviceaccounts "prometheus" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": serviceaccounts "istio-cleanup-secrets-service-account" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": jobs.batch "istio-cleanup-secrets-master-latest-daily" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": serviceaccounts "istio-security-post-install-account" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": jobs.batch "istio-security-post-install-master-latest-daily" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": serviceaccounts "istio-citadel-service-account" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": serviceaccounts "istio-sidecar-injector-service-account" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": services "istio-galley" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": services "istio-egressgateway" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": services "istio-ingressgateway" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": services "istio-policy" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": services "istio-telemetry" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": services "istio-pilot" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": services "prometheus" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": services "istio-citadel" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": services "istio-sidecar-injector" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": deployments.extensions "istio-galley" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": deployments.extensions "istio-egressgateway" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": deployments.extensions "istio-ingressgateway" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": deployments.extensions "istio-policy" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": deployments.extensions "istio-telemetry" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": deployments.extensions "istio-pilot" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": deployments.extensions "prometheus" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": deployments.extensions "istio-citadel" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": deployments.extensions "istio-sidecar-injector" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": horizontalpodautoscalers.autoscaling "istio-egressgateway" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": horizontalpodautoscalers.autoscaling "istio-ingressgateway" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": horizontalpodautoscalers.autoscaling "istio-policy" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": horizontalpodautoscalers.autoscaling "istio-telemetry" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": horizontalpodautoscalers.autoscaling "istio-pilot" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": attributemanifests.config.istio.io "istioproxy" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": attributemanifests.config.istio.io "kubernetes" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": handlers.config.istio.io "stdio" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": logentries.config.istio.io "accesslog" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": logentries.config.istio.io "tcpaccesslog" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": rules.config.istio.io "stdio" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": rules.config.istio.io "stdiotcp" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": metrics.config.istio.io "requestcount" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": metrics.config.istio.io "requestduration" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": metrics.config.istio.io "requestsize" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": metrics.config.istio.io "responsesize" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": metrics.config.istio.io "tcpbytesent" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": metrics.config.istio.io "tcpbytereceived" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": metrics.config.istio.io "tcpconnectionsopened" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": metrics.config.istio.io "tcpconnectionsclosed" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": handlers.config.istio.io "prometheus" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": rules.config.istio.io "promhttp" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": rules.config.istio.io "promtcp" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": rules.config.istio.io "promtcpconnectionopen" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": rules.config.istio.io "promtcpconnectionclosed" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": handlers.config.istio.io "kubernetesenv" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": rules.config.istio.io "kubeattrgenrulerule" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": rules.config.istio.io "tcpkubeattrgenrulerule" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": kuberneteses.config.istio.io "attributes" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": destinationrules.networking.istio.io "istio-policy" is forbidden: unable to create new content in namespace istio-system because it is being terminated
Error from server (Forbidden): error when creating "/root/istio.yaml": destinationrules.networking.istio.io "istio-telemetry" is forbidden: unable to create new content in namespace istio-system because it is being terminated
[root@master1 ~]# kubectl get po -n istio-system
NAME READY STATUS RESTARTS AGE
istio-policy-6ccddfd88c-b9jrm 1/2 Terminating 9 4h57m
istio-policy-6ccddfd88c-njnq5 1/2 Terminating 9 4h57m
istio-policy-6ccddfd88c-pwr97 2/2 Terminating 20 5h28m
istio-telemetry-8bf65698d-cstxv 1/2 Terminating 15 5h4m
istio-telemetry-8bf65698d-d5v6n 1/2 Terminating 7 4h54m
istio-telemetry-8bf65698d-nj474 1/2 Terminating 17 5h22m
[root@master1 ~]# kubectl delete po -n istio-system istio-policy-6ccddfd88c-b9jrm --grace-period= 0 --force
warning: Immediate deletion does not wait for confirmation that the running resource has been ter minated. The resource may continue to run on the cluster indefinitely.
pod "istio-policy-6ccddfd88c-b9jrm" force deleted
[root@master1 ~]# kubectl delete po -n istio-system istio-policy-6ccddfd88c-njnq5 --grace-period= 0 --force
warning: Immediate deletion does not wait for confirmation that the running resource has been ter minated. The resource may continue to run on the cluster indefinitely.
pod "istio-policy-6ccddfd88c-njnq5" force deleted
[root@master1 ~]# kubectl delete po -n istio-system istio-policy-6ccddfd88c-pwr97 --grace-period= 0 --force
warning: Immediate deletion does not wait for confirmation that the running resource has been ter minated. The resource may continue to run on the cluster indefinitely.
pod "istio-policy-6ccddfd88c-pwr97" force deleted
[root@master1 ~]# kubectl delete po -n istio-system istio-telemetry-8bf65698d-cstxv --grace-perio d=0 --force
warning: Immediate deletion does not wait for confirmation that the running resource has been ter minated. The resource may continue to run on the cluster indefinitely.
pod "istio-telemetry-8bf65698d-cstxv" force deleted
[root@master1 ~]# kubectl delete po -n istio-system istio-telemetry-8bf65698d-d5v6n --grace-perio d=0 --force
warning: Immediate deletion does not wait for confirmation that the running resource has been ter minated. The resource may continue to run on the cluster indefinitely.
pod "istio-telemetry-8bf65698d-d5v6n" force deleted
[root@master1 ~]# kubectl delete po -n istio-system istio-telemetry-8bf65698d-nj474 --grace-perio d=0 --force
warning: Immediate deletion does not wait for confirmation that the running resource has been ter minated. The resource may continue to run on the cluster indefinitely.
pod "istio-telemetry-8bf65698d-nj474" force deleted