K8S ceph csi rbd how to create Persistent Volumes from Existing RBD images

Question

I'm trying to test the recovery of exported rbd-images

1. export image

   rbd export --export-format 2 -p ssd-k8s csi-vol-55355f44-eaee-11eb-9e68-6a05d299e4b1 /tmp/csi-vol-55355f44-eaee-11eb-9e68-6a05d299e4b1
   

2. Active watcher

   rbd status -p ssd-k8s  csi-vol-55355f44-eaee-11eb-9e68-6a05d299e4b1
   

Watchers: watcher=100.64.32.92:0/1180447633 client.829851 cookie=18446462598732840961

3. Add watcher to blacklist

   ceph osd blacklist add 100.64.32.92:0/1180447633 
   

4. remove the image

   rbd remove -p csi-vol-55355f44-eaee-11eb-9e68-6a05d299e4b1
   

5. recovery image

   rbd import --image-format 2 /tmp/csi-vol-55355f44-eaee-11eb-9e68-6a05d299e4b1 --dest-pool ssd-k8s csi-vol-55355f44-eaee-11eb-9e68-6a05d299e4b1
   

6. Removing watcher from blacklist

   ceph osd blacklist clear
   

7. no active watchers

    rbd status -p ssd-k8s  csi-vol-55355f44-eaee-11eb-9e68-6a05d299e4b1
   

   Watchers: none

   • can I restore Watchers with CEPH tools ?

8. Trying to reconnect from K8S

1. Re-creation csi-rbdplugin
2. Re-creation pv (through deletion claimRef).
3. Re-creation PVC. PV and PVC is successfully recreated in the Available status and PVC connects perfectly to PV. But the pod has the same error

"Error: failed to prepare subPath for volumeMount"

9. What else is missing?

Found the following discussions, but there is nothing

1. https://github.com/rook/rook/issues/2427
2. https://github.com/ceph/ceph-csi/issues/407