Questions tagged [cudnn]

The NVIDIA CUDA Deep Neural Network library (cuDNN) is a GPU-accelerated library of primitives for deep neural networks.

The NVIDIA CUDA Deep Neural Network library (cuDNN) is a GPU-accelerated library of primitives for deep neural networks. cuDNN provides highly tuned GPU implementations of standard routines such as forward and backward convolution, pooling, normalization, and activation layers, exposed by a C++ API.

Please use this tag only if you are writing or building code which uses the cuDNN APIs. If you are having problems with installing or running frameworks or libraries which use cuDNN internally, please tag those questions with the library or framework in question, and refrain from tagging them with this tag.

385 questions
6
votes
6 answers

Unpredictable CUDNN_STATUS_NOT_INITIALIZED on Windows

I am running keras neural network training and prediction on GTX 1070 on Windows 10. Most times it is working, but from time to time it complains E…
Dims
  • 47,675
  • 117
  • 331
  • 600
6
votes
1 answer

TensorFlow not detecting GPU

I installed Cuda-8.0 and Tensorflow GPU version on ubuntu 16.04. It was working fine initally and using GPU. But suddenly it has stopped using GPU. I installed tensorflow through pip and correctly the GPU version as it worked and used GPU initially.…
Naman
  • 2,569
  • 4
  • 27
  • 44
6
votes
3 answers

Would cuDNN v6.0 work with TensorFlow currently?

Do we specifically need cuDNN v5.1 (as suggested) for TensorFlow, or would the latest version (v6.0) work as well? Is there backward compatibility in cuDNN versions?
hekimgil
  • 109
  • 1
  • 8
6
votes
2 answers

TensorFlow: How to use CudnnLSTM with variable input length (like dynamic_rnn)?

I would like to speed up my LSTM network, but as I am using it for a OCR (where sequences have variable lenght), I can not use plain LSTM implementation. That is why I use "tf.nn.dynamic_rnn". Based on benchmark of RNN in tensorflow…
melgor89
  • 792
  • 5
  • 15
6
votes
4 answers

cudnn compile configuration in TensorFlow

Ubuntu 14.04, CUDA Version 7.5.18, nightly build of tensorflow While running a tf.nn.max_pool() operation in tensorflow, I got the following error: E tensorflow/stream_executor/cuda/cuda_dnn.cc:286] Loaded cudnn library: 5005 but source was…
Alexander R Johansen
  • 2,737
  • 3
  • 18
  • 23
5
votes
4 answers

cuDNN error: CUDNN_STATUS_BAD_PARAM.Can someone explain why i am getting this error and how can i correct it?

I am trying to implement a Character LSTM using Pytorch.But I am getting cudnn_status_bad_params errors.This is the training loop.I getting error on line output = model(input_seq). for epoch in tqdm(range(epochs)): for i in…
Sarthak Mittal
  • 135
  • 1
  • 2
  • 11
5
votes
0 answers

Is there any way to fuse fully connected layer(gemm) and activation layer(relu/sigmoid) on gpu in dnn?

Usually one layer in dnn consists of MatMul, BiasAdd, Relu, cuBlas provides Gemm for MatMul, and we can do BiasAdd and Relu in another kernel for GPU. They are two GPU lanuch calls, is there any way to fuse them all togather and make them just one?…
Kan Liu
  • 175
  • 1
  • 8
5
votes
1 answer

Can not use cuDNN on context None, fatal error: cudnn.h: No such file or directory

I am trying to configure theano to use gpu on my windows machine. I have set up .theanorc to use device= gpu but when I run some code that should utilize the gpu, I get the following error: Can not use cuDNN on context None: cannot compile with…
A_Matar
  • 2,210
  • 3
  • 31
  • 53
5
votes
2 answers

Installing CUDNN for general usage without root access

I use a server which has CUDA 7.5. But the server does not involve CUDNN. Is it possible to install CUDNN, and set all the linkings with CUDA, without root access, for the usage of all applications on ubuntu 14.04? I have implemented the solution on…
yusuf
  • 3,591
  • 8
  • 45
  • 86
4
votes
1 answer

"ERROR 403: Forbidden" when trying to download CuDNN on virtual machine

I am trying to install CuDNN on virtual machine but when I tried to download it using the following command: wget…
John
  • 131
  • 1
  • 2
  • 10
4
votes
2 answers

What is the correct version of CUDNN for CUDA 11.0

I want to start using tensorflow-gpu, and I looked some stuff up, and found out that I need to ensure that I have both CUDA and CUDNN. So, I opened up the command prompt and ran the command nvidia-smi to check my CUDA version: C:\Program…
smg9450
  • 86
  • 1
  • 1
  • 6
4
votes
2 answers

Keras, Tensorflow, CuDDN fails to initialize

I have a very powerful Windows PC (running Windows 10) which has 112GB memory, 16 cores and 3 X Geforce RTX2070 (Doesn't support SLI etc.). It is running CuDNN 7.5 + Tensorflor 1.13 + Python 3.7 My issue is that I am getting the error below -…
PabloDK
  • 2,181
  • 2
  • 19
  • 42
4
votes
1 answer

Best solution to have multiple CUDA/cuDNN versions installed on Ubuntu

I am using Conda on Ubuntu 16.04. My objective is to associate each Conda environment to a specific version of CUDA / cuDNN. I had a look around and I found this interesting article, which basically suggests to put different CUDA versions into…
Max
  • 41
  • 1
  • 2
4
votes
2 answers

Is there a tensorflow version that is compatible with Cuda 9.0 and cudnn 7.1

I have a machine with cuda 9.0 and cudnn 7.1. I've tried using tensorflow 1.7.0 on this machine but it does not work since this version of tensorflow has been created for cudnn 7.0 I'm getting this error when launching a training on my gpu: Loaded…
vvvvv
  • 25,404
  • 19
  • 49
  • 81
4
votes
0 answers

TensorFlow crashes with error CUDNN_STATUS_BAD_PARAM

I'm running fine tuning on Inception ResNet v2 using Keras 2.1.4 with TensorFlow 1.5 back end. My training crashed before the end of the 2nd epoch with the following error message: Epoch 1/50 8103/8103 [==============================] - 3197s…
traveh
  • 2,700
  • 3
  • 27
  • 44