Questions tagged [tensorflow-metal]

3 questions
0
votes
0 answers

Why does using the Metal plugin on my M2 Max with TensorFlow reduce processing times but lower accuracy, and how can I fix it?

I have an Apple computer with an M2 Max chip. I've downloaded TensorFlow and the Metal plugin to utilize the GPU on Jupyter Notebook. The message 'Plugin optimizer for device_type GPU is enabled' appears. Indeed, the processing times are…
0
votes
0 answers

Tensorflow training changes when installing tensorflow-metal (Mac M2)

I'm testing tensorflow on my new M2 Mac device. For experimentation purposes, I have a very simple script: import tensorflow as tf from tensorflow import keras as k # Print list of devices available print("The following devices are available:…
0
votes
0 answers

M2 Max GPU utilization steadily dropping while running inference with huggingface distilbert-base-cased

I got M2 Max (96gb). I am trying to run inference on a column of text from a pandas data frame. I just run it in a loop without bothering to batch them. The model is a fine tuned huggingface distilbert-base-cased. The GPU utilization is around ~50%…