Stack Overflow
Stack Overflow

Questions tagged [pruning]

Use pruning for questions related to algorithms used on data structures to facilitate generalization and performance optimization.

Pruning is a general technique to guard against the creation of an algorithm too specific to the training data so that it can be applied to other data sets.

References

193 questions
0
votes
0 answers

Inconsistency in partition pruning in BigQuery

What's the problem? I'm trying to select two different date periods at once within a query (to be used in Data Studio), to do some complex period comparison calculations. This has to all happen in the query, because it's getting used in Data Studio…
Dominic Woodman
  • 719
  • 2
  • 8
  • 18
0
votes
0 answers

Pruning in Keras, no significant reduction in neither accuracy nor execution time

I am trying to apply a very aggressive pruning to a Keras model that is used to recognise the GTSRB dataset. I applied the following pruning parameters pruning_params = { 'pruning_schedule':…
Alessandro
  • 1
  • 4
0
votes
0 answers

How to prune a large collection of latitude and longitude values in python

I have a large collection (~160m pairs) of latitude and longitude values relating to e-scooter locations. Each lat/lon is to 6dp or more and as such many points lie very close to one another. I am trying to prune this dataset so that points within a…
AoNova
  • 1
0
votes
0 answers

What's the performance difference between unstructured pruning and structured pruning?

I am new to neural network pruning.I know the unstructured pruning sets the weights to zero while the structured pruning does actually change the network architecture. However, I am curious about the difference between their performance. To be…
Kyle Chen
  • 46
  • 3
0
votes
1 answer

Geth Node Not Syncing To The Blockchain Anymore

I'm running a node of an Ethereum side-chain. I started only getting "peer connected on snap without compatible eth support" error messages in the log a few days ago. It would not download any new blocks. The last block in my local chain was 5 days…
uzumaki
  • 1,743
  • 17
  • 32
0
votes
1 answer

Why this query does not trigger partition pruning in Postgres?

I just noticed Postgres (checked on version 13 and 14) behavior that surprised me. I have a simple table volume with id and unique text column name. Second table dir has 3 columns: id, volume_id and path. This table is partitioned by hash on…
Michał Albrycht
  • 322
  • 3
  • 13
0
votes
1 answer

CNN Pruning Issue : 'weights' has to be pruned before pruning can be removed

I am new with Pruning using Pytorch. I had this error when training my model : ValueError: Parameter 'weight' of module Conv2d(1, 4, kernel_size=(7, 7), stride=(3, 3)) has to be pruned before pruning can be removed Here is my whole ConvClass with…
Hamid Fsian
  • 23
  • 2
0
votes
1 answer

HuggingFace - 'optimum' ModuleNotFoundError

I want to run the 3 code snippets from this webpage. I've made all 3 one post, as I am assuming it all stems from the same problem of optimum not having been imported correctly? Kernel: conda_pytorch_p36 Installations: pip install optimum OR ! pip…
DanielBell99
  • 896
  • 5
  • 25
  • 57
0
votes
1 answer

How to perform pruning on trained object detection model?

Hi I have trained object detection model using tensorflow 1.14 object detection API, my model is performing well. However, I want to reduce/optimize parameters of model to make it lighter. How can I use pruning on trained model?
Sohail
  • 21
  • 3
0
votes
1 answer

How to update a pretrained model after Pruning of filters in its conv layer in PyTorch?

I have a pretrained model LeNet5 defined from scratch. I am performing pruning over filters in the convolution layers present in the model shown below. class LeNet5(nn.Module): def __init__(self, n_classes): super(LeNet5,…
NIKITA RATH
  • 354
  • 1
  • 3
  • 12
0
votes
1 answer

How to use pruned weight or model?

I'd like to use the pruned model and weight but, whenever I load the model or weight, this error messages keep popping up... My weight and model's files: Error messages
Joanne
  • 3
  • 2
0
votes
1 answer

How to perform pruning with a transfer learning model?

Essentially, I want to perform pruning to my transfer learning model. I used efficientnetb0 for classifying microorganisms. import tensorflow_model_optimization as tfmot prune_low_magnitude = tfmot.sparsity.keras.prune_low_magnitude # Compute end…
djbacs
  • 41
  • 5
0
votes
1 answer

How to achieve removing/pruning the near-zero parameters in neural network?

I need to remove the near-zero weights of the Neural network so that the distribution of parameters is far away from the zero point. The distribution of weights after removing nearzero weights and weight-scaling I met the problem from this paper:…
ANewBee666
  • 3
  • 2
0
votes
2 answers

InvalidArgumentError: Conv2DCustomBackpropFilterOp only supports NHWC - pruning neural network

Im having problems when I use the library tensorflow_model_optimization. I am developing a code to prune an already trained neural network. I imported the weights from an h5 file and so I use tensorflor_model_optimization to prune my neural…
Gabriela Montes
  • 31
  • 1
  • 7
0
votes
1 answer

Issue in removing layer from keras surgeon

I am trying to remove a layer using kerassurgeon however I am facing issue to do I tried different ways but none of themworking. # delete layer_1 from a model from kerassurgeon import Surgeon surgeon =…
ash luck
  • 17
  • 5
1 2 3
…
12 13