I followed the CUDA Introduction here (https://devblogs.nvidia.com/even-easier-introduction-cuda/).
And wrote a same program as the author did. However the result on my server with GTX 1080ti is even slower than the author's GT 750M.
How could it be?
The code:
#include <iostream>
#include <math.h>
// Kernel function to add the elements of two arrays
__global__
void add(int n, float *x, float *y) {
int index = blockIdx.x * blockDim.x + threadIdx.x;
int stride = blockDim.x * gridDim.x;
for (int i = index; i < n; i+=stride)
y[i] = x[i] + y[i];
}
int main(int argc, char *argv[])
{
int N = 1<<20;
float *x, *y;
// Allocate Unified Memory – accessible from CPU or GPU
cudaMallocManaged(&x, N*sizeof(float));
cudaMallocManaged(&y, N*sizeof(float));
// initialize x and y arrays on the host
for (int i = 0; i < N; i++) {
x[i] = 1.0f;
y[i] = 2.0f;
}
int block_size = 256;
int num_blocks = (N + block_size - 1) / block_size;
// Run kernel on 1M elements on the GPU
add<<<num_blocks, block_size>>>(N, x, y);
// Wait for GPU to finish before accessing on host
cudaDeviceSynchronize();
// Check for errors (all values should be 3.0f)
float maxError = 0.0f;
for (int i = 0; i < N; i++)
maxError = fmax(maxError, fabs(y[i]-3.0f));
std::cout << "Max error: " << maxError << std::endl;
// Free memory
cudaFree(x);
cudaFree(y);
return 0;
}
The result on my server is 4.1499ms with 1080ti, while the author gets 0.68ms with 750m.
I measured the time with nvprof
command as same as the author did.
I compiled the program with nvcc
with default settings, as the author did.