Questions tagged [cudnn]

The NVIDIA CUDA Deep Neural Network library (cuDNN) is a GPU-accelerated library of primitives for deep neural networks.

The NVIDIA CUDA Deep Neural Network library (cuDNN) is a GPU-accelerated library of primitives for deep neural networks. cuDNN provides highly tuned GPU implementations of standard routines such as forward and backward convolution, pooling, normalization, and activation layers, exposed by a C++ API.

Please use this tag only if you are writing or building code which uses the cuDNN APIs. If you are having problems with installing or running frameworks or libraries which use cuDNN internally, please tag those questions with the library or framework in question, and refrain from tagging them with this tag.

385 questions
10
votes
3 answers

How to know which cuDNN version one should use?

I plan to use cuDNN on Linux: how to know which cuDNN version I need? Should I always use the most recent one? E.g. choosing the right CUDA version depends on the Nvidia driver version. I wonder if there is similar constrains for choosing the cuDNN…
Franck Dernoncourt
  • 77,520
  • 72
  • 342
  • 501
9
votes
4 answers

Non-OK-status: GpuLaunchKernel(...) status: Internal: no kernel image is available for execution on the device

I run my code on tensorflow 2.1.0 Anaconda with CUDA Toolkit 10.1 CUDNN 7.6.0 (Windows 10) and it returns a issue F .\tensorflow/core/kernels/random_op_gpu.h:232] Non-OK-status: GpuLaunchKernel(FillPhiloxRandomKernelLaunch, num_blocks,…
MichaelJamesL
  • 131
  • 1
  • 6
9
votes
3 answers

Tensorflow 1.11 needs CuDNN 7.2 for CUDA 9.0, but there is no such library

The requirements of the current version of tensorflow 1.11 to run on GPU are CUDA® Toolkit —TensorFlow supports CUDA 9.0. cuDNN SDK (>= 7.2) However the CuDNN downlad page only lists Download cuDNN v7.2.1 (August 7, 2018), for CUDA 9.2 Given…
user209974
  • 1,737
  • 2
  • 15
  • 31
8
votes
2 answers

Using Keras, How can I load weights generated from CuDNNLSTM into LSTM Model?

I've developed a NN Model with Keras, based on the LSTM Layer. In order to increase speed on Paperspace (a GPU Cloud processing infrastructure), I've switched the LSTM Layer with the new CuDNNLSTM Layer. However this is usable only on machines with…
leonardfactory
  • 3,353
  • 1
  • 18
  • 25
8
votes
3 answers

TensorFlow: How to verify that it is running on GPU

I am looking for a simple way of verifying that my TF graphs are actually running on the GPU. PS. It would also be nice to verify that the cuDNN library is used.
Toke Faurby
  • 5,788
  • 9
  • 41
  • 62
7
votes
1 answer

Tensorflow 2.2 GPU - which cuDNN library to install?

I have successfully installed CUDA driver, cuDNN libraries and tensorflow. But when running a test program that simply imports tensorflow, I get an error. The error seems to suggest I have the wrong version of cuDNN libraries installed. I'd…
Ziqi
  • 2,445
  • 5
  • 38
  • 65
7
votes
3 answers

Could not create cudnn handle: CUDNN STATUS INTERNAL ERROR

I'm trying to create machinelearing in python 3. but then i trying to compile my code i got this error in Cuda 10.0/cuDNN 7.5.0, can some one help me with this? RTX 2080 I'm on: Keras (2.2.4) tf-nightly-gpu (1.14.1.dev20190510) Could not create…
007fred
  • 155
  • 2
  • 8
7
votes
3 answers

How to get cmake to enable cuda when compiling yolo (darknet)?

I am currently using the cmake-gui to compile yolo darknet at https://github.com/AlexeyAB/darknet.git. However, it will not enable cuda and I am having a few other odd issues. These include when I run darknet.exe from the Release folder after…
Jacob Bunzel
  • 165
  • 1
  • 4
  • 15
7
votes
1 answer

Pytorch convolutional network memory usage details

I am trying to train a neural network for a very large input (5*100,000,000) and it requires much more memory than expected. Here is some minimal example: import torch import torch.nn as nn import torch.nn.functional as F import torch.optim as…
Olha Romaniuk
  • 71
  • 1
  • 5
7
votes
1 answer

PyTorch: training with GPU gives worse error than training the same thing with CPU

I have a next step prediction model on times series which is simply a GRU with a fully-connected layer on top of it. When I train it using CPU after 50 epochs I get a loss of 0.10 but when I train it with GPU the loss is 0.15 after 50 epochs. Doing…
patapouf_ai
  • 17,605
  • 13
  • 92
  • 132
7
votes
3 answers

tensorflow-gpu is not working with Blas GEMM launch failed

I installed tensorflow-gpu to run my tensorflow code on my GPU. But I can't make it run. It keeps on giving the above mentioned error. Following is my sample code followed by the error stack trace: import tensorflow as tf import numpy as np def…
HIMANSHU RAI
  • 305
  • 1
  • 4
  • 13
7
votes
0 answers

cudnnRNNForwardTraining seqLength / xDesc usage

Let's say I have N sequences x[i], each with length seqLength[i] for 0 <= i < N. As far as I understand from the cuDNN docs, they have to be ordered by sequence length, the longest first, so assume that seqLength[i] >= seqLength[i+1]. Let's say that…
Albert
  • 65,406
  • 61
  • 242
  • 386
7
votes
3 answers

how do I update cuDNN to a newer version?

the cuDNN installation manual says ALL PLATFORMS Extract the cuDNN archive to a directory of your choice, referred to below as . Then follow the platform-specific instructions as follows. LINUX cd export…
dontloo
  • 10,067
  • 4
  • 29
  • 50
6
votes
1 answer

CUDNN_STATUS_NOT_INITIALIZED when trying to run TensorFlow

I have installed TensorFlow 1.7 on an Ubuntu 16.04 with Cuda 9.0 and CuDNN 7.0.5 and vanilla Python 2.7 and although they samples for both CUDA and CuDNN run fine, and TensorFlow sees the GPU (so some TensorFlow examples run), those that use CuDNN…
Mike Wise
  • 22,131
  • 8
  • 81
  • 104
6
votes
2 answers

How can I check if keras/tensorflow is using cuDNN?

I have installed CUDA and cuDNN, but the last was not working, giving a lot of error messages in theano. Now I am training moderate sized deep conv nets in Keras/Tensorflow, without getting any cuDNN error messages. How can I check if cuDNN is now…
hirschme
  • 774
  • 2
  • 11
  • 40
1 2
3
25 26