kubernetes笔记-亲和性调度

以DaemonSet为例，目前有三种方法来指定想要调度的Node：

nodeSelector：只调度到匹配指定label的Node上
nodeAffinity：功能更丰富的Node选择器，支持集合操作和多个选择器
podAffinity：调度到满足条件的Pod所在的Node上

1、为Node添加label workload=true
#  kubectl label node   kube-node2  workload=true
#  kubectl label node   kube-node3  workload=true
#  kubectl get node --show-labels              
NAME         STATUS   ROLES   AGE   VERSION   LABELS
kube-node1   Ready   master   9d    v1.14.1  beta.kubernetes.io/arch=amd64,beta.kubernetes.io/os=linux,kubernetes.io/arch=amd64,kubernetes.io/hostname=kube-node1,kubernetes.io/os=linux,node-role.kubernetes.io/master=
kube-node2   Ready      9d    v1.14.1  beta.kubernetes.io/arch=amd64,beta.kubernetes.io/os=linux,kubernetes.io/arch=amd64,kubernetes.io/hostname=kube-node2,kubernetes.io/os=linux,workload=true
kube-node3   Ready      8d    v1.14.1  beta.kubernetes.io/arch=amd64,beta.kubernetes.io/os=linux,kubernetes.io/arch=amd64,kubernetes.io/hostname=kube-node3,kubernetes.io/os=linux,workload=true
2、使用nodeSelector调度到包含标签workload='true'的Node上

注意true要加上引号

apiVersion:extensions/v1beta1
kind: DaemonSet
metadata:
  name: testpod
spec:
  template:
    metadata:
      labels:
         app: fortest
    spec:
      nodeSelector:
        workload: 'true'
      containers:
      - name: busybox-1
        image: busybox:v1
        command:
        - /bin/sh
        - -c
        - 'sleep 365d'
        imagePullPolicy: IfNotPresent

查看Daemonset的调度情况

# kubectl getpods -o wide -l app=fortest
NAME            READY   STATUS   RESTARTS   AGE   IP               NODE         NOMINATED NODE   READINESS GATES
testpod-dmknb   1/1    Running   0          49s  10.244.119.173   kube-node3             
testpod-sjhl6   1/1    Running   0          49s  10.244.1.39      kube-node2
3、使用 nodeAffinity调度到包含标签workload:'true'的Node上

编写YAML文件：

apiVersion:extensions/v1beta1
kind: DaemonSet
metadata:
  name: testpod
spec:
  template:
    metadata:
      labels:
         app: fortest
    spec:
      affinity:
        nodeAffinity:
         requiredDuringSchedulingIgnoredDuringExecution:
            nodeSelectorTerms:
              - matchExpressions:
                - key: workload
                  operator: In
                  values:
                  - 'true'
      containers:
      - name: busybox-1
        image: busybox:v1
        command:
        - /bin/sh
        - -c
        - 'sleep 365d'
       imagePullPolicy: IfNotPresent

查看Daemonset的调度情况

# kubectl getpods -o wide -l app=fortest        
NAME            READY   STATUS   RESTARTS   AGE   IP               NODE         NOMINATED NODE   READINESS GATES
testpod-22mdb   1/1    Running   0          5s   10.244.119.174   kube-node3             
testpod-v9xzn   1/1    Running   0          5s   10.244.1.40      kube-node2

修改DaemonSet，增加匹配条件kubernetes.io/os=linux

apiVersion:extensions/v1beta1
kind: DaemonSet
metadata:
  name: testpod
spec:
  template:
    metadata:
      labels:
         app: fortest
    spec:
      affinity:
        nodeAffinity:
         requiredDuringSchedulingIgnoredDuringExecution:
            nodeSelectorTerms:
              - matchExpressions:
                - key: workload
                  operator: In
                  values:
                  - 'true'
                - key: kubernetes.io/os
                  operator: In
                  values:
                  - linux
      containers:
      - name: busybox-1
        image: busybox:v1
        command:
        - /bin/sh
        - -c
        - 'sleep 365d'
        imagePullPolicy: IfNotPresent

查看Daemonset的调度情况
可以看到还是调度到kube-node3和kube-node2，说明两个匹配条件为AND关系

# kubectl get pods  -o wide -l app=fortest
NAME                            READY   STATUS    RESTARTS  AGE   IP               NODE         NOMINATED NODE   READINESS GATES
testpod-7cd6m                   1/1     Running   0         11s   10.244.1.45      kube-node2             
testpod-swpn8                   1/1     Running   0         11s   10.244.119.180   kube-node3

修改yaml文件，增加matchFields匹配条件metadata.name=kube-node1

apiVersion: extensions/v1beta1
kind: DaemonSet
metadata:
  name: testpod
spec:
  template:
    metadata:
      labels:
         app: fortest
    spec:
      affinity:
        nodeAffinity:
         requiredDuringSchedulingIgnoredDuringExecution:
           nodeSelectorTerms:
              - matchExpressions:
               - key: workload
                 operator: In
                 values:
                 - 'true'
               - key: kubernetes.io/os
                 operator: In
                 values:
                 - linux
              -matchFields:
               - key: metadata.name
                 operator: In
                 values:
                 - kube-node1
      containers:
      - name: busybox-1
        image: busybox:v1
        command:
        - /bin/sh
        - -c
        - 'sleep 365d'
        imagePullPolicy:IfNotPresent

查看Daemonset的调度情况
可以看到DaemonSet调度到了3个Node上，说明matchExpressions和matchFields之间是或的关系

# kubectl get pods  -o wide -l app=fortest
NAME                            READY   STATUS    RESTARTS  AGE   IP               NODE         NOMINATED NODE   READINESS GATES
testpod-42crx                   1/1    Running   0         8s    10.244.0.12      kube-node1             
testpod-6bqhp                   1/1     Running   0         8s    10.244.119.181   kube-node3            
testpod-h7296                   1/1     Running  0         8s    10.244.1.46      kube-node2

同时指定了nodeSelector和nodeAffinity

apiVersion: extensions/v1beta1
kind: DaemonSet
metadata:
  name: testpod
spec:
  template:
    metadata:
      labels:
         app: fortest
    spec:
     nodeSelector:
       workload: 'true'
      affinity:
       nodeAffinity:
         requiredDuringSchedulingIgnoredDuringExecution:
           nodeSelectorTerms:
              - matchExpressions:
               - key: workload
                 operator: In
                 values:
                 - 'true'
               - key: kubernetes.io/os
                 operator: In
                 values:
                 - linux
              -matchFields:
               - key: metadata.name
                 operator: In
                 values:
                 - kube-node1
      containers:
      - name: busybox-1
        image: busybox:v1
        command:
        - /bin/sh
        - -c
        - 'sleep 365d'
        imagePullPolicy:IfNotPresent

查看Daemonset的调度情况

# kubectl get pods -o wide -l app=fortest
NAME           READY   STATUS    RESTARTS  AGE    IP               NODE         NOMINATED NODE   READINESS GATES
testpod-bmxjt   1/1     Running  0          6m8s   10.244.119.182   kube-node3            
testpod-cltnt   1/1     Running  0          6m8s   10.244.1.47      kube-node2
image.png
4、podAffinity调度

将Pod调度到拥有指定标签的Pod所在的Node及与该Node具有相同topologyKey标签value的Node上.查看当前pod的标签

# kubectl getpod --show-labels
NAME                             READY   STATUS   RESTARTS   AGE    LABELS
busybox-httpd-7cf56cb476-dxnmj   1/1    Running   1          21h   pod-template-hash=7cf56cb476,run=busybox-httpd
busybox-httpd-7cf56cb476-ghgjr   1/1    Running   1         21h   pod-template-hash=7cf56cb476,run=busybox-httpd

查看当前Pod所在Node

# kubectl getpod -o wide
NAME                             READY   STATUS   RESTARTS   AGE     IP               NODE         NOMINATED NODE   READINESS GATES
busybox-httpd-7cf56cb476-dxnmj   1/1    Running   1          21h     10.244.1.25      kube-node2             
busybox-httpd-7cf56cb476-ghgjr   1/1    Running   1          21h     10.244.119.161   kube-node3

编写YAML文件，通过podAffinity调度到kube-node2和kube-node3上。

apiVersion:extensions/v1beta1
kind: DaemonSet
metadata:
  name: testpod
spec:
  template:
    metadata:
      labels:
         app: fortest
    spec:
      affinity:
        podAffinity:
          requiredDuringSchedulingIgnoredDuringExecution:
          - labelSelector:
              matchExpressions:
              - key: run
                operator: In
                values:
                  - busybox-httpd
            topologyKey: kubernetes.io/hostname
      containers:
      - name: busybox-1
        image: busybox:v1
        command:
        - /bin/sh
        - -c
        - 'sleep 365d'
        imagePullPolicy: IfNotPresent

查看Daemonset的调度情况

# kubectl get pods -o wide -l app=fortest
NAME            READY  STATUS    RESTARTS   AGE    IP               NODE         NOMINATED NODE   READINESS GATES
testpod-2zrxj   1/1     Running  0          4m47s   10.244.119.175   kube-node3            
testpod-8fzkc   0/1     Pending  0          4m47s   <none>           <none>       <none>           <none>                          
testpod-gwdsk   1/1     Running  0          4m47s   10.244.1.41      kube-node2
image.png

扩容deployment busybox-httpd，使得3个node都有busybox-httpd的pod，可以看到DasmonSet的3个Pod均变为running状态

# kubectl get pods -o wide
NAME                            READY   STATUS    RESTARTS  AGE    IP               NODE         NOMINATED NODE   READINESS GATES
busybox-httpd-7cf56cb476-bzlcf  1/1     Running   0         14s    10.244.0.10      kube-node1             
busybox-httpd-7cf56cb476-dxnmj  1/1     Running   1         22h    10.244.1.25      kube-node2             
busybox-httpd-7cf56cb476-ghgjr  1/1     Running   1         22h    10.244.119.161   kube-node3            
testpod-2zrxj                   1/1     Running   0         7m7s   10.244.119.175   kube-node3            
testpod-8fzkc                   1/1     Running   0         7m7s   10.244.0.9       kube-node1             
testpod-gwdsk                   1/1     Running   0         7m7s   10.244.1.41      kube-node2
image.png

修改topologyKey为failure-domain.beta.kubernetes.io/zone，由于3个Node都没有这个标签，所以DaemonSet中没有Pod处于running状态

# kubectl get pods -l app=fortest
NAME           READY   STATUS    RESTARTS  AGE
testpod-7czf5   0/1     Pending  0          28m
testpod-hp6vc   0/1     Pending  0          28m
testpod-tqkrc   0/1     Pending  0          28m
image.png

逐步添加failure-domain.beta.kubernetes.io/zone到各个Node上，最终3个Pod都会进入Running状态


image.png
# kubectl label  nodeskube-node3 failure-domain.beta.kubernetes.io/zone=qy
# kubectl get pods -l app=fortest                                         
NAME           READY   STATUS    RESTARTS  AGE
testpod-7czf5   0/1     Pending  0          29m
testpod-hp6vc   1/1     Running  0          29m
testpod-tqkrc   0/1     Pending  0          29m
# kubectl label  nodeskube-node2 failure-domain.beta.kubernetes.io/zone=qy
# kubectl get pods -l app=fortest                                          
NAME           READY   STATUS    RESTARTS  AGE
testpod-7czf5   1/1     Running  0          29m
testpod-hp6vc   1/1     Running  0          29m
testpod-tqkrc   0/1     Pending  0          29m
# kubectl label  nodes kube-node1failure-domain.beta.kubernetes.io/zone=xy
# kubectl get pods -l app=fortest                                         
NAME           READY   STATUS    RESTARTS  AGE
testpod-7czf5   1/1     Running  0          29m
testpod-hp6vc  1/1     Running  0          29m
testpod-tqkrc   1/1     Running  0          29m
# kubectl get pods -l app=fortest -o wide
NAME           READY   STATUS    RESTARTS  AGE   IP               NODE         NOMINATED NODE   READINESS GATES
testpod-7czf5   1/1     Running  0          29m   10.244.1.42      kube-node2             
testpod-hp6vc   1/1     Running  0          29m   10.244.119.177   kube-node3            
testpod-tqkrc   1/1     Running  0          29m   10.244.0.11      kube-node1

对deployment busybox-httpd进行缩容，使得只有kube-node2上有相关pod，可以看到kube-node2和kube-node3上都有DaemonSet调度的pod处于Running状态


image.png
# kubectl get pods -l run=busybox-httpd -o wide
NAME                             READY   STATUS   RESTARTS   AGE   IP           NODE         NOMINATED NODE   READINESS GATES
busybox-httpd-7cf56cb476-dxnmj  1/1     Running   1         23h   10.244.1.25   kube-node2            
#kubectl get pods -o wide
NAME                            READY   STATUS    RESTARTS  AGE    IP               NODE         NOMINATED NODE   READINESS GATES
busybox-httpd-7cf56cb476-dxnmj  1/1     Running   1         23h    10.244.1.25      kube-node2             
busybox-httpd-7cf56cb476-vq2c2  1/1     Running   1         23h    10.244.1.24      kube-node2             
testpod-4tlp5                   1/1     Running   0         9m1s   10.244.1.44      kube-node2             
testpod-dlskr                   1/1     Running   0         9m1s   10.244.119.179   kube-node3            
testpod-mmxk7                   0/1     Pending   0         9m1s    <none>           <none>       <none>           <none>
最后编辑于 ：
©著作权归作者所有,转载或内容合作请联系作者
  • 人面猴
    序言：七十年代末，一起剥皮案震惊了整个滨河市，随后出现的几起案子，更是在滨河造成了极大的恐慌，老刑警刘岩，带你破解...
    沈念sama阅读 213,752评论 6赞 493
  • 死咒
    序言：滨河连续发生了三起死亡事件，死亡现场离奇诡异，居然都是意外死亡，警方通过查阅死者的电脑和手机，发现死者居然都...
    沈念sama阅读 91,100评论 3赞 387
  • 救了他两次的神仙让他今天三更去死
    文/潘晓璐 我一进店门，熙熙楼的掌柜王于贵愁眉苦脸地迎上来，“玉大人，你说我怎么就摊上这事。” “怎么了？”我有些...
    开封第一讲书人阅读 159,244评论 0赞 349
  • 道士缉凶录：失踪的卖姜人
    文/不坏的土叔 我叫张陵，是天一观的道长。 经常有香客问我，道长，这世上最难降的妖魔是什么？ 我笑而不...
    开封第一讲书人阅读 57,099评论 1赞 286
  • 港岛之恋（遗憾婚礼）
    正文 为了忘掉前任，我火速办了婚礼，结果婚礼上，老公的妹妹穿的比我还像新娘。我一直安慰自己，他们只是感情好，可当我...
    茶点故事阅读 66,210评论 6赞 385
  • 恶毒庶女顶嫁案：这布局不是一般人想出来的
    文/花漫 我一把揭开白布。 她就那样静静地躺着，像睡着了一般。 火红的嫁衣衬着肌肤如雪。 梳的纹丝不乱的头发上，一...
    开封第一讲书人阅读 50,307评论 1赞 292
  • 城市分裂传说
    那天，我揣着相机与录音，去河边找鬼。 笑死，一个胖子当着我的面吹牛，可吹牛的内容都是我干的。 我是一名探鬼主播，决...
    沈念sama阅读 39,346评论 3赞 412
  • 双鸳鸯连环套：你想象不到人心有多黑
    文/苍兰香墨 我猛地睁开眼，长吁一口气：“原来是场噩梦啊……” “哼！你这毒妇竟也来了？” 一声冷哼从身侧响起，我...
    开封第一讲书人阅读 38,133评论 0赞 269
  • 万荣杀人案实录
    序言：老挝万荣一对情侣失踪，失踪者是张志新（化名）和其女友刘颖，没想到半个月后，有当地人在树林里发现了一具尸体，经...
    沈念sama阅读 44,546评论 1赞 306
  • 护林员之死
    正文 独居荒郊野岭守林人离奇死亡，尸身上长有42处带血的脓包…… 初始之章·张勋 以下内容为张勋视角 年9月15日...
    茶点故事阅读 36,849评论 2赞 328
  • 白月光启示录
    正文 我和宋清朗相恋三年，在试婚纱的时候发现自己被绿了。 大学时的朋友给我发了我未婚夫和他白月光在一起吃饭的照片。...
    茶点故事阅读 39,019评论 1赞 341
  • 活死人
    序言：一个原本活蹦乱跳的男人离奇死亡，死状恐怖，灵堂内的尸体忽然破棺而出，到底是诈尸还是另有隐情，我是刑警宁泽，带...
    沈念sama阅读 34,702评论 4赞 337
  • 日本核电站爆炸内幕
    正文 年R本政府宣布，位于F岛的核电站，受9级特大地震影响，放射性物质发生泄漏。R本人自食恶果不足惜，却给世界环境...
    茶点故事阅读 40,331评论 3赞 319
  • 男人毒药：我在死后第九天来索命
    文/蒙蒙 一、第九天 我趴在偏房一处隐蔽的房顶上张望。 院中可真热闹，春花似锦、人声如沸。这庄子的主人今日做“春日...
    开封第一讲书人阅读 31,030评论 0赞 21
  • 一桩弑父案，背后竟有这般阴谋
    文/苍兰香墨 我抬头看了看天上的太阳。三九已至，却和暖如春，着一层夹袄步出监牢的瞬间，已是汗流浃背。 一阵脚步声响...
    开封第一讲书人阅读 32,260评论 1赞 267
  • 情欲美人皮
    我被黑心中介骗来泰国打工， 没想到刚下飞机就差点儿被人妖公主榨干…… 1. 我叫王不留，地道东北人。 一个月前我还...
    沈念sama阅读 46,871评论 2赞 365
  • 代替公主和亲
    正文 我出身青楼，却偏偏与公主长得像，于是被迫代替她去往敌国和亲。 传闻我的和亲对象是个残疾皇子，可洞房花烛夜当晚...
    茶点故事阅读 43,898评论 2赞 351