2

In my python server script which is running on a google cloud VM instance, it tries to save an image(jpeg) in the storage. But it throws following error.

File "/home/thamindudj_16/server/object_detection/object_detector.py", line 109, in detect Hand new_img.save("slicedhand/{}#sliced_image{}.jpeg".format(threadname, i)) File

"/home/thamindudj_16/.local/lib/python3.5/site-packages/PIL/Image.py", line 2004, in save fp = builtins.open(filename, "w+b")

OSError: [Errno 5] Input/output error: 'slicedhand/thread_1#sliced_image0.jpeg'

All the files including python scripts are in a google storage bucket and have mounted to the VM instance using gcsfuse. App tries to save new image in the slicedhand folder.

Python code snippet where image saving happen.

from PIL import Image

...
...

i = 0
new_img = Image.fromarray(bounding_box_img)      ## conversion to an image
new_img.save("slicedhand/{}#sliced_image{}.jpeg".format(threadname, i))

I think may be the problem is with permission access. Doc says to use --key_file. But what is the key file I should use and where I can find that. I'm not clear whether this is the problem or something else.

Any help would be appreciated.

Thamindu DJ
  • 1,679
  • 4
  • 16
  • 29

1 Answers1

2

I understand that you are using gcfuse on your Linux VM Instance to access Google Cloud Storage.

Key file is a Service Account credentials key, that will allow you to initiate Cloud SDK or Client Library as another Service Account. You can download key file from Cloud Console. However, if you are using VM Instance, you are automatically using Compute Engine Default Service Account. You can check it using console command: $ gcloud init.

To configure properly your credentials, please follow the documentation.

Compute Engine Default Service Account, need to have enabled Access Scope Storage > Full. Access Scope is the mechanism that limits access level to Cloud APIs. That can be done during machine creation or when VM Instance is stopped.

Please note that Access Scopes are defined explicitly for the Service Account that you select for VM Instance.

Cloud Storage objects names have requirements. It is strongly recommended avoid using hash symbol "#" in the names of the objects.

Pawel Czuczwara
  • 1,442
  • 9
  • 20
  • Yeah. I figured out that I'm using Default Service Account. Most probably my problem will be with 'gcsfuse by default shows all files as owned by the invoking user. Therefore you should invoke gcsfuse as the user that will be using the file system, not as root'. – Thamindu DJ Apr 24 '19 at 02:24
  • I'm extremely sorry. This is regarding my university project. Since I don't have much time, I did save images to the virtual machine memory instead of bucket. Currently I don't have much time to try. But if I try, I will let you know. Referred document seems to be helpful. Thank you for your time. – Thamindu DJ Apr 24 '19 at 09:19