Questions tagged [pruning]

Use pruning for questions related to algorithms used on data structures to facilitate generalization and performance optimization.

Pruning is a general technique to guard against the creation of an algorithm too specific to the training data so that it can be applied to other data sets.

References

193 questions
3
votes
4 answers

Numerical hash for comparing lexical similarity

Is there some form of hashing algorithm that produces similar numerical values for similar words? I imagine there would be a number of false positives, but it seems like something that could be useful for search pruning. EDIT: Soundex is neat and…
Eric Pruitt
  • 1,825
  • 3
  • 21
  • 34
3
votes
3 answers

Pruning using Pytorch on a complicated model

So I am trying to use torch.nn.utils.prune.global_unstructured. I did it on a simple model and that worked. model.cov2 or other layers and that works. I am trying to do it on a model that's (nested)? I get errors as: AttributeError: 'CNN' object has…
3
votes
0 answers

How does discrete fourier transform pruning work?

I'm looking to utilise pruned DFTs. I can't get my head around FFTW's example - they don't have any DFT pruning utilities in the library, so you have to code your own. In general, how does it work? If I have to code it, I have to understand it in…
Tobi Akinyemi
  • 804
  • 1
  • 8
  • 24
3
votes
5 answers

Are we able to prune a pre-trained model? Example: MobileNetV2

I'm trying to prune a pre-trained model: MobileNetV2 and I got this error. Tried searching online and couldn't understand. I'm running on Google Colab. These are my imports. import tensorflow as tf import tensorflow_model_optimization as…
Calbees
  • 49
  • 7
3
votes
2 answers

Can PostgreSQL 12 do partition pruning at execution time with subquery returning a list?

I'm trying to take advantages of partitioning in one case: I have table "events" which partitioned by list by field "dt_pk" which is foreign key to table "dates". -- Schema drop schema if exists test cascade; create schema test; -- Tables create…
3
votes
2 answers

Docker: Cannot delete intermediate images from a broken pull

There is a broken image which blocks further pulls. And I cannot remove or delete it What I did: - stopped all containers ("docker ps -a" shows empty list) - cleaned everything with "docker system prune -a") - "docker image ls -a" shows an empty…
teecee
  • 33
  • 1
  • 5
3
votes
1 answer

When does Postgresql do partition pruning with JOIN columns?

I have two tables in a Postgres 11 database: client table -------- client_id integer client_name character_varying file table -------- file_id integer client_id integer file_name character_varying The client table is not…
3
votes
0 answers

Threshold based weight pruning in keras/tensorflow?

Is there a way to prune a Keras model based on a certain threshold? The method prune_low_magnitude() from the tensorflow-model-optimization toolkit only allows pruning based on a defined final sparsity (percentage of remaining weigths). Is there a…
kleka
  • 364
  • 3
  • 14
3
votes
1 answer

Cost Complexity Pruning: Pruned error

Can anybody explain this two statements: In Cost Complexity Pruning, the pruned tree error can never be less than the original tree on the training dataset. In Cost Complexity Pruning, the pruned tree error can never be less than the original tree…
3
votes
2 answers

Pruning git branches

You can prune tracking branches in your repo that no longer exist on the remote repo using: git remote prune [remoteName] However this will only get rid of the tracking branches and not any local branches you have set up in addition, eg.: $ git…
Jez
  • 27,951
  • 32
  • 136
  • 233
3
votes
1 answer

How do I implement a pruning strategy with a DTW algorithm?

I've tried to implement a DTW algorithm for a speech recognition application, which I've done successfully, and I'm now trying to improve the performance of the DTW algorithm by pruning. I've tried searching for an improvement to this algorithms and…
Ahmed Anwar
  • 688
  • 5
  • 25
3
votes
2 answers

alpha beta pruning in python

In alpha, beta pruning algorithm, I have a class in which a function def getAction(self,gamestate) id defined. I made 2 more function in def getAction Like: class BAC: def you(self,gamestate): def me(gamestate,depth,alpha, beta): ------ …
Shilpa
  • 1,815
  • 3
  • 19
  • 23
2
votes
3 answers

How to disable pruning with GWT compiler

How do I disable pruning in the GWT compiler? (I'm trying to use the GWT compiler to create a Javascript version of a some game logic written in Java) Maybe pruning is not the issue? I'm testing with the following Java class and none of the fields…
2
votes
1 answer

Why doesn't torch pruning actually remove filters or weights?

I work with one architecture and trying to sparse it via prune. I wrote functions for pruning, here is one of them: def prune_model_l1_unstructured(model, layer_type, proportion): for module in model.modules(): if isinstance(module,…
Anvar Ganiev
  • 149
  • 8
2
votes
0 answers

Freeze certain weights - TensorFlow 2

I am using a Conv-6 CNN in TensorFlow 2.5 and Python3. The objective is to selectively set certain weights within any trainable layer. The Conv-6 CNN model definition is as follows: def conv6_cnn(): """ Function to define the architecture of…
Arun
  • 2,222
  • 7
  • 43
  • 78
1 2
3
12 13