Questions tagged [pruning]

Use pruning for questions related to algorithms used on data structures to facilitate generalization and performance optimization.

Pruning is a general technique to guard against the creation of an algorithm too specific to the training data so that it can be applied to other data sets.

References

193 questions
0
votes
1 answer

How to set prunable layers for tfmot.sparsity.keras.prune_low_magnitude?

I am applying the pruning function from tensorflow_model_optimization, tfmot.sparsity.keras.prune_low_magnitude() to MobileNetV2. Is there any way to set only some layers of the model to be prunable? For training, there is a method…
asti205
  • 154
  • 7
0
votes
0 answers

How to fix "RuntimeError: Function CudnnConvolutionBackward returned an invalid gradient at index 1"

I encountered this problem when I tried to remove some filters and then retrain the network though I have moved both model and data to cuda. It appears that the error is at the backward stage when I called loss.backward(); here is my code: criterion…
0
votes
1 answer

Manually Pruning a Decision Tree

I have generated a simple tree using the rpart() function, however I would like to be able to stop the second split at Petal.Length < 4.9 before it splits by Petal.Width, however I would not like to alter anything else in the tree. The only thing…
user1234
  • 1
  • 1
0
votes
1 answer

Neural Network pruning mechanism

I am working on SqueezeNet pruning . I have some questions regarding the pruning code which is based on the paper : PRUNING CONVOLUTIONAL NEURAL NETWORKS FOR RESOURCE EFFICIENT INFERENCE def compute_rank(self, grad): activation_index =…
0
votes
0 answers

Keras - Filter pruning

currently, I am trying to prune a network (simple convolutional autoencoder) - needless to say without success. First of all, the source I am referring to is blog post: http://machinethink.net/blog/compressing-deep-neural-nets/ In a first step, I…
Arepo
  • 1
0
votes
0 answers

rpart - Find number of leaves that a cp value to pruning a tree would return

I have a requirement where I need to group my categorical variables (having more than 5 category values) into 5 groups based on their association with my continuous variable. To achieve this I am using rpart with "annova" method. So for example my…
user1412
  • 709
  • 1
  • 8
  • 25
0
votes
0 answers

Prune decision tree in R

So I have a decision tree "c.tree1" with 3 different CP values. Now I want to prune it with an exact CP value but the result is the same as "c. tree1" with 3 CP values. Is that weird? c.tree1 <- rpart(certified ~ grade + assignment, data = M1,…
0
votes
1 answer

Pruning Mongodb Data from C# Code

I would like to write some C# code that is called from a job in sitecore, which basically prunes all our mongodb data that is older than 1 year old. What is the exact C# code for doing that? I want to delete just the data, not drop any…
user3034243
  • 145
  • 1
  • 9
0
votes
1 answer

How to iterate through every object in an ElasticSearch index?

This should be easy. I've inserted a number of records into ElasticSearch and have been scouring their documentation but I can't seem to find a way to simply take an index and iterate through it in Node.js I don't have much experience with Elastic,…
dsp_099
  • 5,801
  • 17
  • 72
  • 128
0
votes
1 answer

Pruning data in PostgreSQL table based on timestamp

I'm developing a Spring application that connects to a PostgreSQL database. In my tables, I have some items that are time-based (has a timestamp column) and I want to define a keep-time for these items in an application.properties file. Any items…
Edmond
  • 615
  • 1
  • 5
  • 15
0
votes
1 answer

Spark SQL partition pruning for a cached table

Is partition pruning enabled for cached TempTables in apache spark? If so, how do I configure it? My data is a bunch of sensor readings in different installations, one row contains installationName, tag, timestamp and value. I have written the data…
0
votes
1 answer

Accounting for extremely large size of .git folder in a repository

I have a repository for a client that is 287M. It's about 2 1/2 years old, and that size is not that unusual for the repos I've worked on. What IS unusual is that 181M of that is the .git folder. There are not an excessive amount of branches and…
Oliver Williams
  • 5,966
  • 7
  • 36
  • 78
0
votes
2 answers

How do I eliminate elements from my array if all their elements are empty?

I'm using Ruby 2.4. I have an array of arrays, which looks roughly like this [[2, 3, 4], ["", "", ""], ["a", "b", nil], [nil, "", nil], [151, "", "abcdef"]] How would I eliminate all the arrays in the above list if all of their elements are either…
user7055375
0
votes
1 answer

How to select a node using Alpha Beta

I am implementing an AI for an Othello game using MiniMax with Alpha Beta pruning. I have implemented an Alpha Beta algorithm that tells me the value that I can obtain, but not which node it is that I should select? So my question is how can I use…
0
votes
1 answer

Mysql Partition pruning not working on my subquery

explain SELECT ip_src, (SELECT country FROM ip_location WHERE ip_start between (134744072-500000) and (134744072) and ip_end > 134744072) country_src, ip_dst FROM event e WHERE long_date BETWEEN '2016-03-25 00:00:00' AND…