Search code examples
nginxkuberneteskubernetes-ingressazure-aksnginx-ingress

cant create a second ingress controller using helm with custom class in Azure k8s cluster


I have created an ingress controller using Helm with default configuration

default        nginx-ingress-controller        LoadBalancer   10.0.182.128   xx.xxx.xx.90     80:32485/TCP,443:31756/TCP   62m
default        nginx-ingress-default-backend   ClusterIP      10.0.12.39     <none>           80/TCP                       62m

using Helm:

helm install nginx-ingress stable/nginx-ingress \         
--set controller.replicaCount=2 \     
--set controller.nodeSelector."beta\.kubernetes\.io/os"=linux \
--set defaultBackend.nodeSelector."beta\.kubernetes\.io/os"=linux \
--set controller.service.loadBalancerIP="Created static IP" \
--set controller.service.annotations."service\.beta\.kubernetes\.io/azure-dns-label-name"="XXX-aks-ingress"

this ingress is running in the default namespace.

Now, I wanted to add a second ingress controller, from the official doc I have specific Ingress class

helm install nginx-ingress stable/nginx-ingress \     
--namespace ingress-nginx-devices \ #I create this namespace first 
--set controller.ingressClass="nginx-devices" \   # custom class to use for different ingress resources  
--set controller.replicaCount=2 \     
--set controller.nodeSelector."beta\.kubernetes\.io/os"=linux \
--set defaultBackend.nodeSelector."beta\.kubernetes\.io/os"=linux \
--set controller.service.loadBalancerIP="A second static Ip address created before" \
--set controller.service.annotations."service\.beta\.kubernetes\.io/azure-dns-label-name"="serviceIot-aks-ingress-iot"

but I keep getting this error:

Error: rendered manifests contain a resource that already exists. Unable to continue with install: ClusterRole "nginx-ingress" in namespace "" exists and cannot be imported into the current release: invalid ownership metadata; annotation validation error: key "meta.helm.sh/release-namespace" must equal "ingress-nginx-devices": current value is "default"

What could be wrong here ? Any help is appreciated :)


Solution

  • Update :

    Controller-value of the controller that is processing this ingressClass

    With recent update you might have to use the controller.ingressClassByName

    Official doc : https://github.com/kubernetes/ingress-nginx/tree/main/charts/ingress-nginx#values

    helm install nginx-ingress-devices stable/nginx-ingress \     
        --namespace ingress-nginx-devices \ #I create this namespace first 
        --set controller.ingressClass="nginx-devices" \   # custom class to use for different ingress resources  
        --set controller.ingressClassResource.name="nginx-devices" \
        --set controller.replicaCount=2 \     
        --set controller.nodeSelector."beta\.kubernetes\.io/os"=linux \
        --set defaultBackend.nodeSelector."beta\.kubernetes\.io/os"=linux \
        --set controller.service.loadBalancerIP="A second static Ip address created before" \
        --set controller.service.annotations."service\.beta\.kubernetes\.io/azure-dns-label-name"="serviceIot-aks-ingress-iot"
    

    Old answer

    you can try, what we are changing is name : nginx-ingress-devices instead of nginx-ingress

    helm install nginx-ingress-devices stable/nginx-ingress \     
    --namespace ingress-nginx-devices \ #I create this namespace first 
    --set controller.ingressClass="nginx-devices" \   # custom class to use for different ingress resources  
    --set controller.replicaCount=2 \     
    --set controller.nodeSelector."beta\.kubernetes\.io/os"=linux \
    --set defaultBackend.nodeSelector."beta\.kubernetes\.io/os"=linux \
    --set controller.service.loadBalancerIP="A second static Ip address created before" \
    --set controller.service.annotations."service\.beta\.kubernetes\.io/azure-dns-label-name"="serviceIot-aks-ingress-iot"
    

    error you are getting is due to already there is cluster role with same name : nginx-ingress due to that you are getting the error.

    ClusterRoleBindings grant a user, group, or service account a ClusterRole’s power across the entire cluster.

    You can get the reference file here : https://github.com/helm/charts/blob/master/stable/nginx-ingress/templates/clusterrole.yaml