This refers to one application's using multiple graphics-processing units, either in traditional (graphical) or general-purpose (GPGPU) applications.
Questions tagged [multi-gpu]
387 questions
0
votes
0 answers
How to force to use another GPU in a cluster?
I am using Caffe which is a framework for convolutional neural networks with GPUs(or CPUs). It uses mainly CUDA 6.0 and I'm training a CNN with a large dataset of images(ImageNet dataset=1.2million of images) and requires a great amount of memory.…

ssierral
- 8,537
- 6
- 26
- 44
0
votes
1 answer
Multi GPU vs GPU cluster
I am using cuda programming for the effective and fast computation. and during the study I found that multi gpu and the gpu cluster are the other means for the much further effective calculation but I am confused between these two terms.
What is the…

Laxmi Kadariya
- 1,103
- 1
- 14
- 34
0
votes
1 answer
Are cudaMemcpy and cublas blocking in peer-to-peer mode?
I would like to copy memory between two CUDA devices (with UVA support) by calling cudaMemcpy. I was wondering if the call is synchronous with respect to the host? I'm aware that cudaMemcpy within the same device is asynchronous, but what about the…

simon
- 1
0
votes
1 answer
Multi-GPU for peer to peer
I have some difficulties setting 2 GPUs for peer to peer communication.
I am using Cuda 4.0 and programming with fortran. PGI compiler
I wrote a program which confirm I have 4 GPUs available on my node.
I decided to use two of them but having the…

Adjeiinfo
- 159
- 1
- 2
- 15
0
votes
2 answers
OpenCL multiple GPU buffer read fails
I am trying to make 2 Nvidia GPUs work side by side to do n-body simulation (source). I do proper detection, and store all of the OpenCL stuff in one struct:
struct ocl_wrap {
cl_event event;
cl_program program;
cl_kernel kernel;
…

Ozbolt
- 133
- 1
- 5
0
votes
1 answer
Storing data on GPU and parallelizing convolution in MATLAB
I have a code which relies heavily on convolution. it is responsible for more than 80% of time running time.
I want to use the gpu to make it much faster, but there are some things I don't completely understand, (I don't have the access to test this…

user1999728
- 913
- 1
- 8
- 25
0
votes
1 answer
Multi-GPU Memory Allocation behaves differently with different order of allocation
I have tested this on GTX 690 GPU with 4 GB RAM on Windows 7 x64, Visual C++ 10:
I want to allocate 1.2 GB RAM on each of the two devices. If I get the ram from the first device and then the second one, it fails and returns Memory Allocation error,…

Ramin Halavati
- 107
- 6
0
votes
1 answer
Multi GPU performance degrade when allocated memory increases
I've tested the following on a GTX 690 GPU with 4GB RAM in Windows 7 x64, Visual C++ 10:
I've written a function that receives 2 vectors and adds into a 3rd vector. The task is broken over 2 GPU devices. I gradually increased the vector size to…

Ramin Halavati
- 107
- 6
0
votes
1 answer
Two GPU Cards, One Endabled Display, One Disabled Display: How to tell which GPU Card is OpenGL running on?
So I have two NVidia GPU Cards
Card A: GeForce GTX 560 Ti - Wired to Monitor A (Dell P2210)
Card B: GeForce 9800 GTX+ - Wired to Monitor B (ViewSonic VP20)
Setup: an Asus Mother Board with Intel Core i7 that supports SLI
In NVidia Control Panel, I…

Stochastika
- 305
- 1
- 2
- 14
0
votes
1 answer
How to use DirectX 9 with multi- GPU on windows7
I‘ve got multiple nVidia GPU Cards (Q2000) on a Windows 7 system,without SLI, only one monitor.
Now what I'm trying to do is make a Direct3D9 device runing on a specific GPU.
I can use the [Adapter] parameter in IDirect3D9::CreateDevice to choose a…

El0sua
- 1
- 1
0
votes
1 answer
how to check if a motherboard support Multiple-GPU?
I'll be working on a research project with the integrated use of multiple GPUs. I'm thinking of setting up a Desktop with multiple GPU first.
I currently have a MSI P55 CD53 motherboard, with Intel I5-570 CPU and Nvidia GTS 250 GPU. I want to buy at…

songyy
- 4,323
- 6
- 41
- 63
0
votes
1 answer
CUDA multi gpu: running same kernel (dual chip device)
I'm writing code that must run same kernel on GTX690 (dual chip) board. Since computation is pretty separable, I don't need data exchange between devices, I just merge the result on the CPU. I understand how to run code on each device, and also, how…

neworld
- 3
- 1
0
votes
0 answers
CUDA simpleP2P failing
I have Tesla M2070 cluster with 24 GPUs. I tried running simpleP2P SDK example but it is showing following error although my device supports UVA. OS; Linux 64bit.
Checking for multiple GPUs...
CUDA-capable device count: 3
GPU0 = " Tesla M2070"…

username_4567
- 4,737
- 12
- 56
- 92
-1
votes
0 answers
How can I utilize dual GPU properly for Deep learning?
I am trying to learn modified UNET model which is a lighter version of image segmentation at my office. I use Keras library and searched some ways to utilize company's 2 GPUs and try to use GPU memory efficiently.
I found 3 ways to do so but I still…

Hyoungrak Oh
- 1
- 2
-1
votes
1 answer
Not able to train the model in server (Graph execution error:)
I am trying to train a V-Net model for CBCT dataset using Keras (tensorflow) library. But my local server is not able to train it. It is showing error. Please, somebody, help me in solving this issue.
Note: I am using 8 number of GPUs for…