Stack Overflow
Stack Overflow

Questions tagged [pruning]

Use pruning for questions related to algorithms used on data structures to facilitate generalization and performance optimization.

Pruning is a general technique to guard against the creation of an algorithm too specific to the training data so that it can be applied to other data sets.

References

193 questions
5
votes
2 answers

How to prune a Java program

Let's me start from what I want to do then raising some questions I have. I want to develop a general Java program which is a superset of a number of programs (let's call them program variants). In particular, the general program has methods which…
tuan
  • 433
  • 8
  • 17
5
votes
1 answer

Freezing Individual Weights in Pytorch

The following question is not a duplicate of How to apply layer-wise learning rate in Pytorch? because this question aims at freezing a subset of a tensor from training rather than the entire layer. I am trying out a PyTorch implementation of…
Rahul Vigneswaran
  • 93
  • 7
5
votes
4 answers

How to quickly prune large tables?

I currently have a MySQL table of about 20 million rows, and I need to prune it. I'd like to remove every row whose updateTime (timestamp of insertion) was more than one month ago. I have not personally performed any alterations of the table's…
Electro
  • 2,994
  • 5
  • 26
  • 32
5
votes
2 answers

How can we prune the neural network in R?

I have 30 independent variables in my model. I wanted to prune the neural network based on importance of variables. I have tried using mlp function of RSNNS package, but I don't know what arguments could be given to "pruneFunc" and "pruneFuncParams"…
Saurabh Kumar
  • 149
  • 12
5
votes
2 answers

Random Forest pruning

I have sklearn random forest regressor. It's very heavy, 1.6 GBytes, and works very long time when predicting values. I want to prune it to make lighter. As I know pruning is not implemented for decision trees and forests. I can't implement it by…
hvedrung
  • 467
  • 4
  • 13
4
votes
0 answers

How to implement distinctiveness pruning to my neural network built by PyTorch?

I built a neural network with PyTorch to predict the final marks based on students' assignment marks, lab marks, etc. Although PyTorch has some built-in pruning modules, I am intended to implement distinctiveness pruning to my network, which prunes…
Charlie Xu
  • 41
  • 4
4
votes
1 answer

Can I make pruning to keras pretrained model with tensorflow keras model optimization tool kit?

I have keras pretrained model(model.h5). And I want to prune that model with tensorflow Magnitude-based weight pruning with Keras. One curious things is that my pretrained model is built with original keras model > I mean that is not from…
kaythi swetun
  • 53
  • 10
4
votes
2 answers

How can I accelerate inference speed in TensorFlow when I got sparse matrix from pruning?

I got a sparse weight matrix from Tensorflow-pruning to reduce SqueezeNet. After strip_pruning_vars, I checked the most of elements in weight matrix pruned to 0 successfully. However, the performance of the model didn't increase on what I expected.…
Sangjun Han
  • 41
  • 4
4
votes
2 answers

docker image prune is not working for version < 1.13

Have tried the following commands, but none of them delete the images. sudo docker images prune --filter "dangling=true" sudo docker images prune --all sudo docker images prune -a sudo docker images prune Output for both the commands: REPOSITORY …
Steve
  • 381
  • 1
  • 6
  • 16
4
votes
1 answer

Delete all git branches which have been merged - Fatal: branch name required?

I'm trying to delete all of my merged branches. I've always used git branch --merged | egrep -v "(^\*|master|dev)" | xargs git branch -d but for some reason it won't work anymore, even though I've used this command before. It returns the error…
Erica Stockwell-Alpert
  • 4,624
  • 10
  • 63
  • 130
4
votes
1 answer

Stop Cypher traversal when where condition on reduce() can no longer be satisfied

Suppose I have a neo4j database with a single node type and a single relationship type to keep things simple. All relationships have a "cost" property (as in classical graph problems), whose values are non-negative. Suppose now I want to find all…
Gerardo Lastra
  • 645
  • 5
  • 15
3
votes
2 answers

Swamp/dead-end pruning in non-grid maps

Are there any existing algorithms for finding and avoiding problematic areas (swamps, dead-ends) in pathfinding when using non-grid maps? There are plenty available for grids that either avoid these areas or pseudo-avoid these areas by way of jump…
bendicott
  • 369
  • 2
  • 17
3
votes
1 answer

Pruning decision tree

How to prune decision tree build with ID3 when there are too few examples in the training set. I cannot divide it into training, validation and test set, so that is out of the question. Are there any statistical methods that might be used or…
ioreskovic
  • 5,531
  • 5
  • 39
  • 70
3
votes
0 answers

Partition pruning in Deltatable incremental merge

I want to merge a dataframe which contains incremental data to my base deltatable. I want to achieve partition pruning while doing it to avoid scanning a lot of files. My data is partitioned based on a date field creating the year, month partitions.…
mdoblado
  • 66
  • 4
3
votes
0 answers

How to prune an existing tensorflow/keras model trained on imagenet

I am trying to prune InceptionNetV3 from keras trained on imagenet, right now I am using a tensorflow-datasets which has a subset of imagenet which I use for pruning. Currently my pruned models do not work and returns garbage data when tested using…
onetrillionquestions
  • 31
  • 5
1
2
3
…
12 13