kubernetes - 在 Kubernetes 上部署 IPFS-Cluster 我得到了错误

Question

当我在 Kubernetes 上部署 IPFS-Cluster 时，出现以下错误(这些是 ipfs-cluster 日志):

 error applying environment variables to configuration: error loading cluster secret from config: encoding/hex: invalid byte: U+00EF 'ï'
 2022-01-04T10:23:08.103Z   INFO    service ipfs-cluster-service/daemon.go:47   Initializing. For verbose output run with "-l debug". Please wait...
 2022-01-04T10:23:08.103Z   ERROR   config  config/config.go:352    error reading the configuration file: open /data/ipfs-cluster/service.json: no such file or directory
 error loading configurations: open /data/ipfs-cluster/service.json: no such file or directory

这些是 initContainer 日志:

 + user=ipfs
 + mkdir -p /data/ipfs
 + chown -R ipfs /data/ipfs
 + '[' -f /data/ipfs/config ]
 + ipfs init '--profile=badgerds,server'
 initializing IPFS node at /data/ipfs
 generating 2048-bit RSA keypair...done
 peer identity: QmUHmdhauhk7zdj5XT1zAa6BQfrJDukysb2PXsCQ62rBdS
 to get started, enter:

    ipfs cat /ipfs/QmS4ustL54uo8FzR9455qaxZwuMiUhyvMcX9Ba8nUH4uVv/readme

 + ipfs config Addresses.API /ip4/0.0.0.0/tcp/5001
 + ipfs config Addresses.Gateway /ip4/0.0.0.0/tcp/8080
 + ipfs config --json Swarm.ConnMgr.HighWater 2000
 + ipfs config --json Datastore.BloomFilterSize 1048576
 + ipfs config Datastore.StorageMax 100GB

这些是 ipfs 容器日志:

 Changing user to ipfs
 ipfs version 0.4.18
 Found IPFS fs-repo at /data/ipfs
 Initializing daemon...
 go-ipfs version: 0.4.18-aefc746
 Repo version: 7
 System version: amd64/linux
 Golang version: go1.11.1
 Error: open /data/ipfs/config: permission denied
 Received interrupt signal, shutting down...
 (Hit ctrl-c again to force-shutdown the daemon.)

以下是我的kubernetes yaml文件:

apiVersion: apps/v1
kind: StatefulSet
metadata:
  name: ipfs-cluster
spec:
  serviceName: ipfs-cluster
  replicas: 3
  selector:
    matchLabels:
      app: ipfs-cluster
  template:
    metadata:
      labels:
        app: ipfs-cluster
    spec:
      initContainers:
        - name: configure-ipfs
          image: "ipfs/go-ipfs:v0.4.18"
          command: ["sh", "/custom/configure-ipfs.sh"]
          volumeMounts:
            - name: ipfs-storage
              mountPath: /data/ipfs
            - name: configure-script
              mountPath: /custom/entrypoint.sh
              subPath: entrypoint.sh
            - name: configure-script-2
              mountPath: /custom/configure-ipfs.sh
              subPath: configure-ipfs.sh
      containers:
        - name: ipfs
          image: "ipfs/go-ipfs:v0.4.18"
          imagePullPolicy: IfNotPresent
          env:
            - name: IPFS_FD_MAX
              value: "4096"
          ports:
            - name: swarm
              protocol: TCP
              containerPort: 4001
            - name: swarm-udp
              protocol: UDP
              containerPort: 4002
            - name: api
              protocol: TCP
              containerPort: 5001
            - name: ws
              protocol: TCP
              containerPort: 8081
            - name: http
              protocol: TCP
              containerPort: 8080
          livenessProbe:
            tcpSocket:
              port: swarm
            initialDelaySeconds: 30
            timeoutSeconds: 5
            periodSeconds: 15
          volumeMounts:
            - name: ipfs-storage
              mountPath: /data/ipfs
            - name: configure-script
              mountPath: /custom
          resources:
            {}
        - name: ipfs-cluster
          image: "ipfs/ipfs-cluster:latest"
          imagePullPolicy: IfNotPresent
          command: ["sh", "/custom/entrypoint.sh"]
          envFrom:
            - configMapRef:
                name: env-config
          env:
            - name: BOOTSTRAP_PEER_ID
              valueFrom:
                configMapRef:
                  name: env-config
                  key: bootstrap-peer-id
            - name: BOOTSTRAP_PEER_PRIV_KEY
              valueFrom:
                secretKeyRef:
                  name: secret-config
                  key: bootstrap-peer-priv-key
            - name: CLUSTER_SECRET
              valueFrom:
                secretKeyRef:
                  name: secret-config
                  key: cluster-secret
            - name: CLUSTER_MONITOR_PING_INTERVAL
              value: "3m"
            - name: SVC_NAME
              value: $(CLUSTER_SVC_NAME)
          ports:
            - name: api-http
              containerPort: 9094
              protocol: TCP
            - name: proxy-http
              containerPort: 9095
              protocol: TCP
            - name: cluster-swarm
              containerPort: 9096
              protocol: TCP
          livenessProbe:
            tcpSocket:
              port: cluster-swarm
            initialDelaySeconds: 5
            timeoutSeconds: 5
            periodSeconds: 10
          volumeMounts:
            - name: cluster-storage
              mountPath: /data/ipfs-cluster
            - name: configure-script
              mountPath: /custom/entrypoint.sh
              subPath: entrypoint.sh
          resources:
            {}
      volumes:
      - name: configure-script
        configMap:
          name: ipfs-cluster-set-bootstrap-conf
      - name: configure-script-2
        configMap:
          name: configura-ipfs
  volumeClaimTemplates:
    - metadata:
        name: cluster-storage
      spec:
        storageClassName: gp2
        accessModes: ["ReadWriteOnce"]
        persistentVolumeReclaimPolicy: Retain
        resources:
          requests:
            storage: 5Gi
    - metadata:
        name: ipfs-storage
      spec:
        storageClassName: gp2
        accessModes: ["ReadWriteOnce"]
        persistentVolumeReclaimPolicy: Retain
        resources:
          requests:
            storage: 200Gi

---

kind: Secret
apiVersion: v1
metadata:
  name: secret-config
  namespace: weex-ipfs
  annotations:
    kubesphere.io/creator: tom
data:
  bootstrap-peer-priv-key: >-
    UTBGQlUzQjNhM2RuWjFOcVFXZEZRVUZ2U1VKQlVVTjBWbVpUTTFwck9ETkxVWEZNYzJFemFGWlZaV2xKU0doUFZGRTBhRmhrZVhCeFJGVmxVbmR6Vmt4Nk9IWndZ...
  cluster-secret: 7d4c019035beb7da7275ea88315c39b1dd9fdfaef017596550ffc1ad3fdb556f
type: Opaque

---

kind: ConfigMap
apiVersion: v1
metadata:
  name: env-config
  namespace: weex-ipfs
  annotations:
    kubesphere.io/creator: tom
data:
  bootstrap-peer-id: QmWgEHZEmJhuoDgFmBKZL8VtpMEqRArqahuaX66cbvyutP

---

kind: ConfigMap
apiVersion: v1
metadata:
  name: ipfs-cluster-set-bootstrap-conf
  namespace: weex-ipfs
  annotations:
    kubesphere.io/creator: tom
data:
  entrypoint.sh: |2
        #!/bin/sh
        user=ipfs

        # This is a custom entrypoint for k8s designed to connect to the bootstrap
        # node running in the cluster. It has been set up using a configmap to
        # allow changes on the fly.


        if [ ! -f /data/ipfs-cluster/service.json ]; then
          ipfs-cluster-service init
        fi

        PEER_HOSTNAME=`cat /proc/sys/kernel/hostname`

        grep -q ".*ipfs-cluster-0.*" /proc/sys/kernel/hostname
        if [ $? -eq 0 ]; then
          CLUSTER_ID=${BOOTSTRAP_PEER_ID} \
          CLUSTER_PRIVATEKEY=${BOOTSTRAP_PEER_PRIV_KEY} \
          exec ipfs-cluster-service daemon --upgrade
        else
          BOOTSTRAP_ADDR=/dns4/${SVC_NAME}-0/tcp/9096/ipfs/${BOOTSTRAP_PEER_ID}

          if [ -z $BOOTSTRAP_ADDR ]; then
            exit 1
          fi
          # Only ipfs user can get here
          exec ipfs-cluster-service daemon --upgrade --bootstrap $BOOTSTRAP_ADDR --leave
        fi

---

kind: ConfigMap
apiVersion: v1
metadata:
  name: configura-ipfs
  namespace: weex-ipfs
  annotations:
    kubesphere.io/creator: tom
data:
  configure-ipfs.sh: >-
    #!/bin/sh
    set -e
    set -x
    user=ipfs

    # This is a custom entrypoint for k8s designed to run ipfs nodes in an
    appropriate
    # setup for production scenarios.

    mkdir -p /data/ipfs && chown -R ipfs /data/ipfs

    if [ -f /data/ipfs/config ]; then
      if [ -f /data/ipfs/repo.lock ]; then
        rm /data/ipfs/repo.lock
      fi
      exit 0
    fi

    ipfs init --profile=badgerds,server
    ipfs config Addresses.API /ip4/0.0.0.0/tcp/5001
    ipfs config Addresses.Gateway /ip4/0.0.0.0/tcp/8080
    ipfs config --json Swarm.ConnMgr.HighWater 2000
    ipfs config --json Datastore.BloomFilterSize 1048576
    ipfs config Datastore.StorageMax 100GB

我关注official steps build 。

我按照官方的步骤，使用如下命令生成cluster-secret:

$ od  -vN 32 -An -tx1 /dev/urandom | tr -d ' \n' | base64 -w 0 -

但是我得到:

 error applying environment variables to configuration: error loading cluster secret from config: encoding/hex: invalid byte: U+00EF 'ï'

从官方看到了同样的问题github issue .所以，我用openssl rand -hex命令不行。

Answer 1

为了澄清，我正在发布社区 Wiki 答案。

---

解决以下错误:

no such file or directory

您使用了 runAsUser: 0。

---

第二个错误:

error applying environment variables to configuration: error loading cluster secret from config: encoding/hex: invalid byte: U+00EF 'ï'

是由于 CLUSTER_SECRET 的十六进制编码不同造成的。

根据 this page :

The Cluster Secret Key

The secret key of a cluster is a 32-bit hex encoded random string, of which every cluster peer needs in their _service.json_ configuration.

A secret key can be generated and predefined in the CLUSTER_SECRET environment variable, and will subsequently be used upon running ipfs-cluster-service init.

Here是已解决问题的链接。

---

另见:

• Configuration reference
• IPFS Tutorial
• 文档指南 Security and ports