Replicated PV Mayastor Installation on MicroK8s
Prerequisites
Prepare a cluster by following the steps outlined in this guide.
Install Replicated PV Mayastor on MicroK8s
To install Replicated PV Mayastor using Helm on MicroK8s, execute the following command:
Command
helm install openebs openebs/openebs -n openebs --create-namespace \
--set mayastor.csi.node.kubeletDir="/var/snap/microk8s/common/var/lib/kubelet" \
--set lvm-localpv.lvmNode.kubeletDir="/var/snap/microk8s/common/var/lib/kubelet" \
--set zfs-localpv.zfsNode.kubeletDir="/var/snap/microk8s/common/var/lib/kubelet"
Output
NAME: openebs
LAST DEPLOYED: Wed Apr 17 14:35:22 2024
NAMESPACE: openebs
STATUS: deployed
REVISION: 1
NOTES:
Successfully installed OpenEBS.
Check the status by running: kubectl get pods -n openebs
The default values will install both Local PV and Replicated PV. However,
the Replicated PV will require additional configuration to be fuctional.
The Local PV offers non-replicated local storage using 3 different storage
backends i.e HostPath, LVM and ZFS, while the Replicated PV provides one replicated highly-available
storage backend i.e Mayastor.
For more information,
- Connect with an active community on our Kubernetes slack channel.
- Sign up to Kubernetes slack: https://slack.k8s.io
- #openebs channel: https://kubernetes.slack.com/messages/openebs
Resolve Known Issue (Calico Vxlan)
During the installation of Replicated PV Mayastor in MicroK8s, Pods with hostnetwork might encounter a known issue where they get stuck in the init state due to the Calico Vxlan bug.
Expected Error
root@master:~# kubectl logs -f mayastor-agent-ha-node-ljxdt -n mayastor -c agent-cluster-grpc-probe
nc: bad address 'mayastor-agent-core'
Fri Feb 10 08:18:41 UTC 2023
Waiting for agent-cluster-grpc services...
nc: bad address 'mayastor-agent-core'
Fri Feb 10 08:19:02 UTC 2023
Waiting for agent-cluster-grpc services...
nc: bad address 'mayastor-agent-core'
Fri Feb 10 08:19:23 UTC 2023
Waiting for agent-cluster-grpc services...
nc: bad address 'mayastor-agent-core'
Fri Feb 10 08:19:44 UTC 2023
Waiting for agent-cluster-grpc services...
nc: bad address 'mayastor-agent-core'
Fri Feb 10 08:20:05 UTC 2023
Resolution
To resolve this error, execute the following command:
Command
microk8s kubectl patch felixconfigurations default --patch '{"spec":{"featureDetectOverride":"ChecksumOffloadBroken=true"}}' --type=merge
For more details about this issue, refer to the GitHub issue.
info
Refer to the Replicated PV Mayastor Configuration Documentation for further Configuration of Replicated PV Mayastor including storage pools, storage class, persistent volume claims, and application setup.