kubernetes仪表板无法到达节点，GUI中断

分类：编程问答

如何解决kubernetes仪表板无法到达节点，GUI中断

我正在尝试设置Web仪表板。安装似乎有效：

kubectl apply -f https://raw.githubusercontent.com/kubernetes/dashboard/v2.0.0/aio/deploy/recommended.yaml
kubectl proxy --address='172.29.248.55' --disable-filter=true -v=5

但该应用由于无法到达一个节点而拒绝启动：

{
  "kind": "Status","apiVersion": "v1","metadata": {
  },"status": "Failure","message": "error trying to reach service: dial tcp 172.16.69.193:8443: i/o timeout","code": 500
}

使用journaclctl检查kubelet，向我显示了这一点：

"myserver.mydomain.com","type":"ipipTunnelAddress"}},v3.AllocationAttribute{AttrPrimary:(*string)(0xc000222be0),AttrSecondary:map[string]string{"namespace":"kubernetes-dashboard","node":"myserver.mydomain.com","pod":"dashboard-metrics-scraper-7b59f7d4df-rfrzq"}}},Deleted:false}} error=Operation cannot be fulfilled on ipamblocks.crd.projectcalico.org "172-16-69-192-26": the object has been modified; please apply your changes to the latest version and try again
Oct 05 09:25:38 myserver.mydomain.com kubelet[58981]: 2020-10-05 09:25:38.610 [INFO][50949] ipam.go 963: Failed to update block block=172.16.69.192/26 error=update conflict: IPAMBlock(172-16-69-192-26) handle="k8s-pod-network.131460cb8642e07ad2f15f475723906b65419624b4aec390ac2ded92286f68e7" host="myserver.mydomain.com"
Oct 05 09:25:38 myserver.mydomain.com kubelet[58981]: 2020-10-05 09:25:38.639 [INFO][50949] ipam.go 936: Attempting to assign 1 addresses from block block=172.16.69.192/26 handle="k8s-pod-network.131460cb8642e07ad2f15f475723906b65419624b4aec390ac2ded92286f68e7" host="myserver.mydomain.com"
Oct 05 09:25:38 myserver.mydomain.com kubelet[58981]: 2020-10-05 09:25:38.642 [INFO][50949] ipam.go 1397: Creating new handle: k8s-pod-network.131460cb8642e07ad2f15f475723906b65419624b4aec390ac2ded92286f68e7
Oct 05 09:25:38 myserver.mydomain.com kubelet[58981]: 2020-10-05 09:25:38.649 [INFO][50949] ipam.go 959: Writing block in order to claim IPs block=172.16.69.192/26 handle="k8s-pod-network.131460cb8642e07ad2f15f475723906b65419624b4aec390ac2ded92286f68e7" host="myserver.mydomain.com"
Oct 05 09:25:38 myserver.mydomain.com kubelet[58981]: 2020-10-05 09:25:38.658 [INFO][50949] ipam.go 972: Successfully claimed IPs: [172.16.69.194/26] block=172.16.69.192/26 handle="k8s-pod-network.131460cb8642e07ad2f15f475723906b65419624b4aec390ac2ded92286f68e7" host="myserver.mydomain.com"
Oct 05 09:25:38 myserver.mydomain.com kubelet[58981]: 2020-10-05 09:25:38.658 [INFO][50949] ipam.go 695: Auto-assigned 1 out of 1 IPv4s: [172.16.69.194/26] handle="k8s-pod-network.131460cb8642e07ad2f15f475723906b65419624b4aec390ac2ded92286f68e7" host="myserver.mydomain.com"
Oct 05 09:25:38 myserver.mydomain.com kubelet[58981]: 2020-10-05 09:25:38.658 [INFO][50949] ipam_plugin.go 255: Calico CNI IPAM assigned addresses IPv4=[172.16.69.194/26] IPv6=[] ContainerID="131460cb8642e07ad2f15f475723906b65419624b4aec390ac2ded92286f68e7" HandleID="k8s-pod-network.131460cb8642e07ad2f15f475723906b65419624b4aec390ac2ded92286f68e7" Workload="myserver.mydomain.com-k8s-dashboard--metrics--scraper--7b59f7d4df--rfrzq-eth0"
Oct 05 09:25:38 myserver.mydomain.com kubelet[58981]: 2020-10-05 09:25:38.661 [INFO][50905] k8s.go 372: Populated endpoint ContainerID="131460cb8642e07ad2f15f475723906b65419624b4aec390ac2ded92286f68e7" Namespace="kubernetes-dashboard" Pod="dashboard-metrics-scraper-7b59f7d4df-rfrzq" WorkloadEndpoint="myserver.mydomain.com-k8s-dashboard--metrics--scraper--7b59f7d4df--rfrzq-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint",APIVersion:"projectcalico.org/v3"},ObjectMeta:v1.ObjectMeta{Name:"myserver.mydomain.com-k8s-dashboard--metrics--scraper--7b59f7d4df--rfrzq-eth0",GenerateName:"dashboard-metrics-scraper-7b59f7d4df-",Namespace:"kubernetes-dashboard",SelfLink:"",UID:"5c257fd8-ad0e-4d60-885a-c2ff673a7b96",ResourceVersion:"126017",Generation:0,CreationTimestamp:v1.Time{Time:time.Time{wall:0x0,ext:63737501137,loc:(*time.Location)(0x27947e0)}},DeletionTimestamp:(*v1.Time)(nil),DeletionGracePeriodSeconds:(*int64)(nil),Labels:map[string]string{"k8s-app":"dashboard-metrics-scraper","pod-template-hash":"7b59f7d4df","projectcalico.org/namespace":"kubernetes-dashboard","projectcalico.org/orchestrator":"k8s","projectcalico.org/serviceaccount":"kubernetes-dashboard"},Annotations:map[string]string(nil),OwnerReferences:[]v1.OwnerReference(nil),Finalizers:[]string(nil),ClusterName:"",ManagedFields:[]v1.ManagedFieldsEntry(nil)},Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s",Workload:"",Node:"myserver.mydomain.com",ContainerID:"",Pod:"dashboard-metrics-scraper-7b59f7d4df-rfrzq",Endpoint:"eth0",IPNetworks:[]string{"172.16.69.194/32"},IPNATs:[]v3.IPNAT(nil),IPv4Gateway:"",IPv6Gateway:"",Profiles:[]string{"kns.kubernetes-dashboard","ksa.kubernetes-dashboard.kubernetes-dashboard"},InterfaceName:"cali5d0b61a63e5",MAC:"",Ports:[]v3.EndpointPort(nil)}}
Oct 05 09:25:38 myserver.mydomain.com kubelet[58981]: 2020-10-05 09:25:38.661 [INFO][50905] k8s.go 373: Calico CNI using IPs: [172.16.69.194/32] ContainerID="131460cb8642e07ad2f15f475723906b65419624b4aec390ac2ded92286f68e7" Namespace="kubernetes-dashboard" Pod="dashboard-metrics-scraper-7b59f7d4df-rfrzq" WorkloadEndpoint="myserver.mydomain.com-k8s-dashboard--metrics--scraper--7b59f7d4df--rfrzq-eth0"
Oct 05 09:25:38 myserver.mydomain.com kubelet[58981]: 2020-10-05 09:25:38.661 [INFO][50905] dataplane_linux.go 66: Setting the host side veth name to cali5d0b61a63e5 ContainerID="131460cb8642e07ad2f15f475723906b65419624b4aec390ac2ded92286f68e7" Namespace="kubernetes-dashboard" Pod="dashboard-metrics-scraper-7b59f7d4df-rfrzq" WorkloadEndpoint="myserver.mydomain.com-k8s-dashboard--metrics--scraper--7b59f7d4df--rfrzq-eth0"
Oct 05 09:25:38 myserver.mydomain.com kubelet[58981]: 2020-10-05 09:25:38.663 [INFO][50905] dataplane_linux.go 420: Disabling IPv4 forwarding ContainerID="131460cb8642e07ad2f15f475723906b65419624b4aec390ac2ded92286f68e7" Namespace="kubernetes-dashboard" Pod="dashboard-metrics-scraper-7b59f7d4df-rfrzq" WorkloadEndpoint="myserver.mydomain.com-k8s-dashboard--metrics--scraper--7b59f7d4df--rfrzq-eth0"
Oct 05 09:25:38 myserver.mydomain.com kubelet[58981]: 2020-10-05 09:25:38.671 [WARNING][50905] dataplane_linux.go 404: failed to set net.ipv6.conf.cali5d0b61a63e5.accept_ra=0: open /proc/sys/net/ipv6/conf/cali5d0b61a63e5/accept_ra: no such file or directory ContainerID="131460cb8642e07ad2f15f475723906b65419624b4aec390ac2ded92286f68e7" Namespace="kubernetes-dashboard" Pod="dashboard-metrics-scraper-7b59f7d4df-rfrzq" WorkloadEndpoint="myserver.mydomain.com-k8s-dashboard--metrics--scraper--7b59f7d4df--rfrzq-eth0"

我检查了仪表板的错误日志，并反复显示以下内容

kubectl logs kubernetes-dashboard-74d688b6bc-btrp6 --namespace=kubernetes-dashboard
2020/10/05 18:07:42 Metric client health check failed: an error on the server ("unknown") has prevented the request from succeeding (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2020/10/05 18:08:42 Metric client health check failed: an error on the server ("unknown") has prevented the request from succeeding (get services dashboard-metrics-scraper). Retrying in 30 seconds.

和

kubectl logs dashboard-metrics-scraper-7b59f7d4df-rfrzq --namespace=kubernetes-dashboard
{"level":"error","msg":"Error scraping node metrics: the server could not find the requested resource (get nodes.metrics.k8s.io)","time":"2020-10-05T18:20:39Z"}
172.29.192.115 - - [05/Oct/2020:18:20:43 +0000] "GET / HTTP/1.1" 200 6 "" "kube-probe/1.19"
172.29.192.115 - - [05/Oct/2020:18:20:53 +0000] "GET / HTTP/1.1" 200 6 "" "kube-probe/1.19"
172.29.192.115 - - [05/Oct/2020:18:21:03 +0000] "GET / HTTP/1.1" 200 6 "" "kube-probe/1.19"
172.29.192.115 - - [05/Oct/2020:18:21:13 +0000] "GET / HTTP/1.1" 200 6 "" "kube-probe/1.19"
172.29.192.115 - - [05/Oct/2020:18:21:23 +0000] "GET / HTTP/1.1" 200 6 "" "kube-probe/1.19"

所以我有2个问题：

  1. 有一种方法可以忽略发生故障的主机，以便GUI可以呈现其他所有内容
  2. 知道这个错误是什么意思吗？我正在使用Calico作为CNI。

谢谢！

-Jose

解决方法

事实证明是导致此节点的IP地址错误（多宿主）的原因。发布正确的IP地址（kubelet --node-ip xx.xx.xx.xx）并重新加入后，仪表板恢复。

版权声明：本文内容由互联网用户自发贡献，该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务，不拥有所有权，不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容， 请发送邮件至 dio@foxmail.com 举报，一经查实，本站将立刻删除。

相关推荐

导入项目后报错问题
依赖报错 idea导入项目后依赖报错，解决方案：https://blog.csdn.net/weixin_42420249/article/details/81191861 依赖版本报错：更换其他版本 无法下载依赖可参考：https://blog.csdn.net/weixin_42628809/a
idea不能识别yaml文件
使用mybatis plus常见错误
错误1：代码生成器依赖和mybatis依赖冲突 启动项目时报错如下 2021-12-03 13:33:33.927 ERROR 7228 [ main] o.s.b.d.LoggingFailureAnalysisReporter : *************************** APPL
gradle常见问题与错误
错误1：gradle项目控制台输出为乱码 # 解决方案：https://blog.csdn.net/weixin_43501566/article/details/112482302 # 在gradle-wrapper.properties 添加以下内容 org.gradle.jvmargs=-Df
Mybatis Plus传入参数0不起作用
错误还原：在查询的过程中，传入的workType为0时，该条件不起作用 <select id="xxx"> SELECT di.id, di.name, di.work_type, di.updated... <where> <if test=&qu
linux中make编译源码包失败
报错如下，gcc版本太低 ^ server.c:5346:31: 错误：‘struct redisServer’没有名为‘server_cpulist’的成员 redisSetCpuAffinity(server.server_cpulist); ^ server.c: 在函数‘hasActiveC
微服务启动错误：Command line is too long. Shorten command line for
解决方案1 1、改项目中.idea/workspace.xml配置文件，增加dynamic.classpath参数 2、搜索PropertiesComponent，添加如下 <property name="dynamic.classpath" value="tru
vue常见错误
删除根组件app.vue中的默认代码后报错：Module Error (from ./node_modules/eslint-loader/index.js): 解决方案：关闭ESlint代码检测，在项目根目录创建vue.config.js，在文件中添加 module.exports = { lin
spark常见错误
查看spark默认的python版本 [root@master day27]# pyspark /home/software/spark-2.3.4-bin-hadoop2.7/conf/spark-env.sh: line 2: /usr/local/hadoop/bin/hadoop: No s
matplotlib报错：AttributeError: module 'backend_interagg' has no attribute 'FigureCanvas'. Did you mean: 'FigureCanvasAgg'?
使用本地python环境可以成功执行 import pandas as pd import matplotlib.pyplot as plt # 设置字体 plt.rcParams['font.sans-serif'] = ['SimHei'] # 能正确显示负号 p
gitlab登录失败，报错：This challenge page was accidentally cached by an intermediary and is no longer available.
设置时间 控制面板
后端开发常见错误
错误1：Request method ‘DELETE‘ not supported 错误还原：controller层有一个接口，访问该接口时报错：Request method ‘DELETE‘ not supported 错误原因：没有接收到前端传入的参数，修改为如下 参考 错误2：cannot r
docker常见错误
错误1：启动docker镜像时报错：Error response from daemon: driver failed programming external connectivity on endpoint quirky_allen 解决方法：重启docker -> systemctl r
idea常见错误
错误1：private field ‘xxx‘ is never assigned 按Altʾnter快捷键，选择第2项 参考：https://blog.csdn.net/shi_hong_fei_hei/article/details/88814070 错误2：启动时报错，不能找到主启动类 #
pip安装依赖失败
报错如下，通过源不能下载，最后警告pip需升级版本 Requirement already satisfied: pip in c:\users\ychen\appdata\local\programs\python\python310\lib\site-packages (22.0.4) Coll
maven常见错误
错误1：maven打包报错 错误还原：使用maven打包项目时报错如下 [ERROR] Failed to execute goal org.apache.maven.plugins:maven-resources-plugin:3.2.0:resources (default-resources)
cloud项目中常见错误
错误1：服务调用时报错 服务消费者模块assess通过openFeign调用服务提供者模块hires 如下为服务提供者模块hires的控制层接口 @RestController @RequestMapping("/hires") public class FeignControl
springboot常见错误
错误1：运行项目后报如下错误 解决方案 报错2：Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.8.1:compile (default-compile) on project sb 解决方案：在pom.
springmvc拦截器中使用redisTemplate报空指针异常
参考 错误原因 过滤器或拦截器在生效时，redisTemplate还没有注入 解决方案：在注入容器时就生效 @Component //项目运行时就注入Spring容器 public class RedisBean { @Resource private RedisTemplate<String
vite报错：npm ERR! command C:WINDOWSsystem32cmd.exe /d /s /c C:UsersychenAppDataLocalTempnpx-dde1c848.cmd
使用vite构建项目报错 C:\Users\ychen\work>npm init @vitejs/app @vitejs/create-app is deprecated, use npm init vite instead C:\Users\ychen\AppData\Local\npm-
pythonJavaScriptjavaHTMLPHPreactjsC#AndroidCSSNode.jssqlrpython-3.xMysqLjQueryc++pandasFlutterangularIOSdjangolinuxswifttypescript路由器JSON路由器设置无线路由器h3c华三华三路由器设置华三路由器电脑软件教程arraysdocker软件图文教程Cvue.jslaravelspring-boot