1

I have multiple computers connected over a VPN, each computer having one or more Nvidia GPUs. All computers run Linux. I'm wondering if it's possible to mount them over network such that they appear to be attached on a single machine.

For example, if I have a machine (say MA) with one GPU and another machine (say MB) with two GPUs. Running nvidia-smi on MA would list the one GPU and running it on MB would list two GPUs.

I want to mount MB's GPUs on MA as virtual GPUs such that running nvidia-smi on MA will now list three GPUs. Is this possible?

I realize this will have high latency. But in my case, that is not a concern.

Susmit Agrawal
  • 113
  • 3
  • As far as I know : The typical approaches and technical jargon to use the resources of multiple systems as if were a single resource may be [single system image](https://en.m.wikipedia.org/wiki/Single_system_image) clusters , or [grid computing](https://en.m.wikipedia.org/wiki/Grid_computing) - none of which are really for the faint of heart. – Bob Oct 07 '20 at 07:29

0 Answers0