Nginx 403 error while using kubernetes volumes

Question

I am trying to use Kubernetes volumes for Nginx, but am facing an issue with it. After volumes are set Nginx is unable to serve the HTML page. Also am tried with PV and PVS this time also got the same error.

nginx.yml

apiVersion: apps/v1
kind: Deployment
metadata:
  name: nginx-deployment
  labels: 
    app: nginx 

spec: 
  replicas: 2
  selector: 
    matchLabels: 
      app: nginx
  template:
    metadata: 
      labels:
        app: nginx
    spec: 
      volumes:
        - name: nginxhtml
          # persistentVolumeClaim: 
          #   claimName: pvc
          hostPath:
            path: /home/amjed/Documents/SPS/k8s/mongo/mnt
      containers:
        - name: nginx
          image: nginx
          volumeMounts:
            - name: nginxhtml 
              mountPath: /usr/share/nginx/html
              
          ports: 
            - containerPort: 80



---
apiVersion: v1
kind: Service
metadata:
  name: nginx-service
spec:
  selector: 
    app: nginx
  type: LoadBalancer
  ports:
    - protocol: TCP
      port: 80
      targetPort: 80

right, see if any of these solutions solves your problem https://stackoverflow.com/questions/45484366/how-to-map-one-single-file-into-kubernetes-pod-using-hostpath -- and the minikube doc about mounting local folders https://minikube.sigs.k8s.io/docs/handbook/mount/ — Juan Fontes, Jan 11 '22 at 07:23
Now am tried in another way. I am logged to minikube using ssh. Then there am created a folder named 'sample-vol'. That folder path was added to hostPath. Still am getting same error. hostPath: /home/docker/sample-vol — Amjed saleel, Jan 11 '22 at 07:53

mdobrucki · Accepted Answer · 2022-01-11T14:03:55.760

First, create folder that you want to mount inside minikube:

dobrucki@minikube:~$ minikube ssh
Last login: Tue Jan 11 13:54:50 2022 from 192.168.49.1
docker@minikube:~$ ls -l 
total 4
drwxr-xr-x 2 docker docker 4096 Jan 11 13:56 nginx-mount

This folder is what is mapped to /usr/share/nginx/html inside Pods, so files you paste here will be displayed when you connect to your service. Make sure that you have some .html file inside that folder, otherwise you will get 403 error. For me, example index.html is this:

<html>
 <head>
 </head>
 <body>
   <h1>Hello World<h1>
 </body>
</html>

You also need to add securityContext fsGroup inside your Deployment manifest, so that /usr/share/nginx/html is owned by nginx user (101 uid).

Then, apply Deployment and LoadBalancer resources using this:

apiVersion: apps/v1
kind: Deployment
metadata:
  name: nginx-deployment
  labels: 
    app: nginx 
spec:
  replicas: 2
  selector: 
    matchLabels: 
      app: nginx
  template:
    metadata: 
      labels:
        app: nginx
    spec:
      securityContext:
        fsGroup: 101
      volumes:
        - name: nginxhtml
          hostPath:
            path: /home/docker/nginx-mount
      containers:
        - name: nginx
          image: nginx
          volumeMounts:
            - name: nginxhtml 
              mountPath: /usr/share/nginx/html       
          ports: 
            - containerPort: 80
---
apiVersion: v1
kind: Service
metadata:
  name: nginx-service
spec:
  selector: 
    app: nginx
  type: LoadBalancer
  ports:
    - protocol: TCP
      port: 80
      targetPort: 80

After that you can check if the content is served correctly

dobrucki@minikube:~$ curl $(minikube service nginx-service --url)
<html>
 <head>
 </head>
 <body>
   <h1>Hello World<h1>
 </body>
</html>

Let me know if you have more questions.

I make those changes. But the HTML content was not added to the hostPath. So still the same error. Is it necessary to add those HTML files to hostPath manually? — Amjed saleel, Jan 11 '22 at 12:55
You must have some content to be served by nginx, if the folder is empty you will get 403 error every time. — mdobrucki, Jan 11 '22 at 13:18
What do you mean by "But the HTML content was not added to the hostPath."? — mdobrucki, Jan 11 '22 at 13:24
Let me know if you need step by step instructions how I got it to work. — mdobrucki, Jan 11 '22 at 13:34
@Amjedsaleel I edited the answer with full manifests and step-by-step — mdobrucki, Jan 11 '22 at 14:04
Now it is working, thanks. I have a dought, is it possible to automatically add mountPath file to our hostPath directory. — Amjed saleel, Jan 11 '22 at 14:23

score 0 · Answer 2 · answered Jan 11 '22 at 09:33

0

reduce the replica count to 1
verify that /home/amjed/Documents/SPS/k8s/mongo/mnt location is valid and is accessible from the pod

answered Jan 11 '22 at 09:33

P Ekambaram

15,499
7
34
59

I make those changes, But still same error – Amjed saleel Jan 11 '22 at 10:00
make the path lowercase /home/amjed/Documents/SPS/k8s/mongo/mnt – P Ekambaram Jan 11 '22 at 11:21

Nginx 403 error while using kubernetes volumes

2 Answers2