无法使用 StorageClass“慢”配置卷：无法获取 GCE GCECloudProvider 并出现错误 <nil>

Question

我正在尝试从 GKE 中安装 Redis 集群 (StatefulSet)，当我得到 pvc 时，我得到了

Events:
  Type       Reason              Age   From                         Message
  ----       ------              ----  ----                         -------
  Warning    ProvisioningFailed  10s   persistentvolume-controller  Failed to provision volume with StorageClass "slow": Failed to get GCE GCECloudProvider with error <nil>

已经在文件 /etc/kubernetes/manifests/kube-controller-manager.yaml 和 sudo vi /etc/kubernetes/manifests/kube-apiserver.yaml 上添加了“--cloud-provider=gce”。重新启动但还是一样。 任何人都可以帮助我吗？让 k8s 在 GCP 上运行的诀窍是什么？

我的清单来自here：

---
apiVersion: v1
kind: ConfigMap
metadata:
  name: redis-cluster
  labels:
    app: redis-cluster
data:
  fix-ip.sh: |
    #!/bin/sh
    CLUSTER_CONFIG="/data/nodes.conf"
    if [ -f ${CLUSTER_CONFIG} ]; then
      if [ -z "${POD_IP}" ]; then 
        echo "Unable to determine Pod IP address!"
        exit 1
      fi
      echo "Updating my IP to ${POD_IP} in ${CLUSTER_CONFIG}"
      sed -i.bak -e "/myself/ s/[0-9]\{1,3\}\.[0-9]\{1,3\}\.[0-9]\{1,3\}\.[0-9]\{1,3\}/${POD_IP}/" ${CLUSTER_CONFIG}
    fi
    exec "$@"
  redis.conf: |+
    cluster-enabled yes
    cluster-require-full-coverage no
    cluster-node-timeout 15000
    cluster-config-file /data/nodes.conf
    cluster-migration-barrier 1
    appendonly yes
    protected-mode no
---
kind: StorageClass
apiVersion: storage.k8s.io/v1
metadata:
  name: slow
provisioner: kubernetes.io/gce-pd
parameters:
  type: pd-standard
  replication-type: none
  zone: "us-west2-a"
  reclaimPolicy: Retain
---
apiVersion: v1
kind: Service
metadata:
  name: redis-cluster
  labels:
    app: redis-cluster
spec:
  ports:
  - port: 6379
    targetPort: 6379
    name: client
  - port: 16379
    targetPort: 16379
    name: gossip
  clusterIP: None
  selector:
    app: redis-cluster
---
apiVersion: apps/v1
kind: StatefulSet
metadata:
  name: redis-cluster
  labels:
    app: redis-cluster
spec:
  serviceName: redis-cluster
  replicas: 5
  selector:
    matchLabels:
      app: redis-cluster
  template:
    metadata:
      labels:
        app: redis-cluster
    spec:
      containers:
      - name: redis
        image: redis:5.0-rc
        ports:
        - containerPort: 6379
          name: client
        - containerPort: 16379
          name: gossip
        command: ["/conf/fix-ip.sh", "redis-server", "/conf/redis.conf"]
        args:
        - --cluster-announce-ip
        - "$(POD_IP)"
        readinessProbe:
          exec:
            command:
            - sh
            - -c
            - "redis-cli -h $(hostname) ping"
          initialDelaySeconds: 15
          timeoutSeconds: 5
        livenessProbe:
          exec:
            command:
            - sh
            - -c
            - "redis-cli -h $(hostname) ping"
          initialDelaySeconds: 20
          periodSeconds: 3
        env:
        - name: POD_IP
          valueFrom:
            fieldRef:
              fieldPath: status.podIP
        volumeMounts:
        - name: conf
          mountPath: /conf
          readOnly: false
        - name: data
          mountPath: /data
          readOnly: false
      volumes:
      - name: conf
        configMap:
          name: redis-cluster
          defaultMode: 0755
  volumeClaimTemplates:
  - metadata:
      name: data
      labels:
        name: redis-cluster
    spec:
      accessModes: [ "ReadWriteOnce" ]
      storageClassName: slow 
      resources:
        requests:
          storage: 5Gi

Answer 1

请验证您的“StorageClass:slow”，似乎有缩进问题（以reclaimPolicy开头）

kind: StorageClass
apiVersion: storage.k8s.io/v1
metadata:
  name: slow
provisioner: kubernetes.io/gce-pd
parameters:
  type: pd-standard
  replication-type: none
  zone: "us-west2-a"
reclaimPolicy: Retain

# 更新：

1. 请将--cloud-provider=gce 添加到：kube-apiserver.yaml, kube-controller-manager.yaml, KUBELET_KUBECONFIG_ARGS。您还可以启用 enable-admission-plugins=DefaultStorageClass

2. 在“云 API 访问范围”权限中验证您的 “VM 实例详细信息” 权限。

3. 验证您的存储类 pv 和 pvc 是否正常工作。

---

  kind: StorageClass
    apiVersion: storage.k8s.io/v1beta1
    metadata:
      name: slow
      annotations:
        storageclass.beta.kubernetes.io/is-default-class: "true" 
    provisioner: kubernetes.io/gce-pd
    parameters:
      type: pd-standard      

  apiVersion: v1
    kind: PersistentVolumeClaim
    metadata:
     name: pvc-test
    spec:
     accessModes:
      - ReadOnlyMany
     storageClassName: slow
     resources:
       requests:
         storage: 1Gi

Answer 2

Google 提供两种主要类型的永久性磁盘，它们在 kubernetes 上自动配置：

Standard storage (labeled pd-standard)
SSD storage (labeled pd-ssd)

默认情况下，GKE 将配置标准存储永久性磁盘。事实上，这是唯一可用的存储类。

apiVersion: storage.k8s.io/v1
kind: StorageClass
metadata:
  name: test-storageclass
provisioner: kubernetes.io/gce-pd
parameters:
  type: pd-ssd

您可以通过以下键/值对告诉持久卷使用新的 ssd 存储类：storageClassName: ssd.

kind: PersistentVolumeClaim
apiVersion: v1
metadata:
  name: ssd-storageclass
spec:
  accessModes:
    - ReadWriteOnce
  storageClassName: ssd
  resources:
    requests:
      storage: 1Gi