1. 概述

該教程沃暗，是基于 k8s 集群的部署旺入，事先準(zhǔn)備好 k8s 集群饱苟，此處k8s集群部署略過

2. 部署

官網(wǎng)教程

2.1 安裝基礎(chǔ)組件

yum install iscsi-initiator-utils

2.2 下載 部署文件 yml

wget https://raw.githubusercontent.com/longhorn/longhorn/v1.3.2/deploy/longhorn.yaml

2.3 修改 yml 文件

2.3.1 修改pv為保留策略瓦呼，否則刪除pvc的時候pv就會被刪除

data:
  storageclass.yaml: |
    kind: StorageClass
    apiVersion: storage.k8s.io/v1
    metadata:
      name: longhorn
      annotations:
        storageclass.kubernetes.io/is-default-class: "true"
    provisioner: driver.longhorn.io
    allowVolumeExpansion: true
    # 找到文件中的StorageClass.data.reclaimPolicy字段,修改為Retain
    reclaimPolicy: "Retain"
    volumeBindingMode: Immediate

2.3.2 修改longhorn-frontend 服務(wù)的svc資源類型和端口涨共，便于web界面查看

kind: Service
apiVersion: v1
metadata:
  labels:
    app.kubernetes.io/name: longhorn
    app.kubernetes.io/instance: longhorn
    app.kubernetes.io/version: v1.3.2
    app: longhorn-ui
  name: longhorn-frontend
  namespace: longhorn-system
spec:
  # 修改為 NodePort价卤，默認為ClusterIP
  #type: ClusterIP
  type: NodePort
  selector:
    app: longhorn-ui
  ports:
  - name: http
    port: 80
    targetPort: http
    # 修改端口號劝萤，默認為 null
    #nodePort: null
    nodePort: 30080

2.3.3 修改存儲路徑

默認存儲路徑為：/var/lib/longhorn，可修改為自己想要路徑

找到DaemonSet資源下的spec.template.containers.volumeMounts字段

apiVersion: apps/v1
kind: DaemonSet
metadata:
  labels:
    app.kubernetes.io/name: longhorn
    app.kubernetes.io/instance: longhorn
    app.kubernetes.io/version: v1.3.2
    app: longhorn-manager
  name: longhorn-manager
  namespace: longhorn-system
spec:
  selector:
    matchLabels:
      app: longhorn-manager
  template:
    metadata:
      labels:
        app.kubernetes.io/name: longhorn
        app.kubernetes.io/instance: longhorn
        app.kubernetes.io/version: v1.3.2
        app: longhorn-manager
    spec:
      initContainers:
      - name: wait-longhorn-admission-webhook
        image: longhornio/longhorn-manager:v1.3.2
        command: ['sh', '-c', 'while [ $(curl -m 1 -s -o /dev/null -w "%{http_code}" -k https://longhorn-admission-webhook:9443/v1/healthz) != "200" ]; do echo waiting; sleep 2; done']
      containers:
      - name: longhorn-manager
        image: longhornio/longhorn-manager:v1.3.2
        imagePullPolicy: IfNotPresent
        securityContext:
          privileged: true
        command:
        - longhorn-manager
        - -d
        - daemon
        - --engine-image
        - "longhornio/longhorn-engine:v1.3.2"
        - --instance-manager-image
        - "longhornio/longhorn-instance-manager:v1_20221003"
        - --share-manager-image
        - "longhornio/longhorn-share-manager:v1_20221003"
        - --backing-image-manager-image
        - "longhornio/backing-image-manager:v3_20221003"
        - --manager-image
        - "longhornio/longhorn-manager:v1.3.2"
        - --service-account
        - longhorn-service-account
        ports:
        - containerPort: 9500
          name: manager
        readinessProbe:
          tcpSocket:
            port: 9500
        volumeMounts:
        - name: dev
          mountPath: /host/dev/
        - name: proc
          mountPath: /host/proc/
        - name: longhorn
          # 修改為自己的路徑
          #mountPath: /var/lib/longhorn/
          mountPath: /data/longhorn/
          mountPropagation: Bidirectional
        - name: longhorn-grpc-tls
          mountPath: /tls-files/
        env:
        - name: POD_NAMESPACE
          valueFrom:
            fieldRef:
              fieldPath: metadata.namespace
        - name: POD_IP
          valueFrom:
            fieldRef:
              fieldPath: status.podIP
        - name: NODE_NAME
          valueFrom:
            fieldRef:
              fieldPath: spec.nodeName
      volumes:
      - name: dev
        hostPath:
          path: /dev/
      - name: proc
        hostPath:
          path: /proc/
      - name: longhorn
        hostPath:
          # 修改為自己的路徑
          #path: /var/lib/longhorn/
          path: /data/longhorn/
      - name: longhorn-grpc-tls
        secret:
          secretName: longhorn-grpc-tls
          optional: true
      serviceAccountName: longhorn-service-account
  updateStrategy:
    rollingUpdate:
      maxUnavailable: "100%"

2.4 部署

kubectl apply -f longhorn.yml

2.5 檢查

web界面管理

image-20221122144530823.png

查看所有 pod 運行狀態(tài)

image-20221122144603579.png

查看 sc 資源

image-20221122144720913.png

3. 使用 longhorn 存儲

3.1 創(chuàng)建一個pvc

kind: PersistentVolumeClaim
apiVersion: v1
metadata:
  name: test-pvc
  namespace: longhorn-system
  annotations:
    volume.beta.kubernetes.io/storage-class: "longhorn"
spec:
  accessModes:
  - ReadWriteMany
  resources:
    requests:
      storage: 5Gi

3.2 創(chuàng)建一個 pod慎璧，驗證 pvc 使用情況

kind: Pod
apiVersion: v1
metadata:
  name: mysql-pod
  namespace: longhorn-system
  labels:
    app: mysql-server
spec:
  containers:
  - name: mysql-server
    imagePullPolicy: Never
    image: mysql:5.7
    volumeMounts:
    - name: data
      mountPath: "/var/lib/mysql"
    ports:
    - containerPort: 3306
    env:
    - name: MYSQL_ROOT_PASSWORD
      value: '123456'
    args: 
    - "--ignore-db-dir=lost+found"
    
  restartPolicy: "Always"
  volumes:
  - name: data
    persistentVolumeClaim:
      claimName: test-pvc
  
---
kind: Service
apiVersion: v1
metadata:
  name: mysql-server
  namespace: longhorn-system
spec:
  selector:
    app: mysql-server
  type: NodePort
  ports:
  - port: 3306
    targetPort: 3306
    nodePort: 30060

image-20221122144910946.png

image-20221122144927101.png

image-20221122144940066.png

image-20221122145043339.png