Any idea if we can use aws farget as existing cluster install?


I was trying to install the kotsadm app on eks with farget but its not getting persistent volume assigned to it.
Is there any restriction of KOTS to have EBS storage only ?

 Warning  FailedScheduling  58m   fargate-scheduler  Pod not supported on Fargate: volumes not supported: kotsadm-minio not supported because: PVC kotsadm-minio-kotsadm-minio-0 not bound

and none of them getting up.

kubectl get all --all-namespaces
NAMESPACE     NAME                           READY   STATUS    RESTARTS   AGE
icedq         pod/kotsadm-minio-0            0/1     Pending   0          121m
icedq         pod/kotsadm-rqlite-0           0/1     Pending   0          121m
kube-system   pod/coredns-54d6f577c6-44jlz   0/1     Pending   0          167m
kube-system   pod/coredns-54d6f577c6-ffg4j   0/1     Pending   0          167m

NAMESPACE     NAME                              TYPE        CLUSTER-IP       EXTERNAL-IP   PORT(S)                  AGE
default       service/kubernetes                ClusterIP       <none>        443/TCP                  169m
icedq         service/kotsadm-minio             ClusterIP    <none>        9000/TCP                 121m
icedq         service/kotsadm-rqlite            ClusterIP   <none>        4001/TCP                 121m
icedq         service/kotsadm-rqlite-headless   ClusterIP   None             <none>        4001/TCP                 121m
kube-system   service/kube-dns                  ClusterIP      <none>        53/UDP,53/TCP,9153/TCP   167m

kube-system   daemonset.apps/aws-node                 0         0         0       0            0           <none>          167m
kube-system   daemonset.apps/eks-pod-identity-agent   0         0         0       0            0           <none>          160m
kube-system   daemonset.apps/kube-proxy               0         0         0       0            0           <none>          167m

NAMESPACE     NAME                      READY   UP-TO-DATE   AVAILABLE   AGE
kube-system   deployment.apps/coredns   0/2     2            0           167m

NAMESPACE     NAME                                 DESIRED   CURRENT   READY   AGE
kube-system   replicaset.apps/coredns-54d6f577c6   2         2         0       167m

NAMESPACE   NAME                              READY   AGE
icedq       statefulset.apps/kotsadm-minio    0/1     121m
icedq       statefulset.apps/kotsadm-rqlite   0/1     121m

I dont see any mentions of farget or ebs in replicated documentation, but i guess kotsadm-minio uses ebs for storage.

Hi @dmuley I’m not sure if kots will work on Fargate. In the past I’ve seen that typically the storage part is a potential problem. More info on how kots uses storage and options how to for example disable minio: About Selecting Storage Add-ons | Replicated Docs

Can you check the creation of the PV’s? I’m assuming that is where we might find the root cause.