adabag boosting function throws error when giving mfinal>10

Question

I have a strange issue, whenever I try increasing the mfinal argument in boosting function of adabag package beyond 10 I get an error, Even with mfinal=9 I get warnings.

My train data has 7 class Dependant variable and 100 independant variables and around 22000 samples of data(Smoted one class using DMwR). My Dependant Variable is at the end of the training dataset in sequence.

library(adabag)
gc()
exp_recog_boo <- boosting(V1 ~ .,data=train_dataS,boos=TRUE,mfinal=9)

Error in 1:nrow(object$splits) : argument of length 0
In addition: Warning messages:
1: In acum + acum1 :
longer object length is not a multiple of shorter object length

Thanks in advance.

score 7 · Answer 1 · edited Jun 30 '16 at 01:12

7

My mistake was that I didn't set the TARGET as factor before.

Try this:

train$target <- as.factor(train$target)

and check by doing:

str(train$TARGET)

edited Jun 30 '16 at 01:12

thepule

1,721
1
12
22

answered Jun 29 '16 at 20:14

José Luis Delgado

71
1
1

Even as a Boolean vector this problem also occurs. This solved my end too. – Oeufcoque Penteano Oct 18 '17 at 02:48
The suggestion to check for factor status of train$target by executing `str(train$TARGET)` is wrongheaded. R is case sensitive so the two vectors would not be the same. – IRTFM Jan 01 '18 at 22:11

score 2 · Answer 2 · answered Mar 19 '14 at 16:51

This worked for me:

modelADA <- boosting(lettr ~ ., data = trainAll, boos = TRUE, mfinal = 10, control = (minsplit = 0))

Essentially I just told rpart to require a minimum split length of zero to generate tree, it eliminated the error. I haven't tested this extensively so I can't guarantee it's a valid solution (what does a tree with a zero length leaf actually mean?), but it does prevent the error from being thrown.

Raising Spirit · Answer 3 · 2014-09-22T16:57:25.667

I think i Hit the problem.

ignore this -if you configure your control with a cp = 0, this wont happen. I think that if the first node of a tree make no improvement (or at least no better than the cp) the tree stay wiht 0 nodes so you have an empty tree and that make the algorithm fail.

EDIT: The problem is that the rpart generates trees with only one leaf(node) and the boosting metod use this sentence "k <- varImp(arboles[[m]], surrogates = FALSE, competes = FALSE)" being arboles[[m]] a tree with only one node it give you the eror.

To solve that you can modify the boosting metod:

Write: fix(boosting) and add the *'S lines.

if (boos == TRUE) { 
**   k <- 1
**   while (k == 1){
     boostrap <- sample(1:n, replace = TRUE, prob = pesos)
     fit <- rpart(formula, data = data[boostrap, -1],
         control = control)
**   k <- length(fit$frame$var)
**   }
     flearn <- predict(fit, newdata = data[, -1], type = "class")
     ind <- as.numeric(vardep != flearn)
     err <- sum(pesos * ind)
 }

this will prevent the algorith from acepting one leaf trees but you have to set the CP from the control param as 0 to avoid an endless loop..

I am not quite certain I understand. In my version of boosting(), these lines are already there. — user1965813, Feb 27 '15 at 13:12

score 1 · Answer 4 · edited Jun 29 '15 at 15:07

1

Just ran into the same problem, and setting the complexity parameter to -1 or minimum split to 0 both work for me with rpart.control, e.g.

library(adabag)

r1 <- boosting(Y ~ ., data = data, boos = TRUE, 
               mfinal = 10,  control = rpart.control(cp = -1))

r2 <- boosting(Y ~ ., data = data, boos = TRUE, 
               mfinal = 10,  control = rpart.control(minsplit = 0))

edited Jun 29 '15 at 15:07

C8H10N4O2

18,312
8
98
134

answered Jun 29 '15 at 14:40

Marijana Vujkovic

9
3

score 0 · Answer 5 · answered Oct 25 '13 at 04:46

I also run into this same problem recently and this example R script solves it completely!

The main idea is that you need to set the control for rpart (which adabag uses for creating trees, see rpart.control) appropriately, so that at least a split is attempted in every tree.

I'm not totally sure but it appears that your "argument of length 0" may be the result of an empty tree, which can happen since there is a default setting of a "complexity" parameter that tells the function not to attempt a split if the decrease in homogeneity/lack of fit is below certain threshold.

It has been more than a year since I posted that link. Thanks for bringing it to my attention. The main point there is the warning is generated because some trees are empty, so making cp= -1 (in rpart.control) will force rpart to split until maxdepth, avoiding empty trees. — David, Mar 22 '15 at 07:50

score 0 · Answer 6 · answered Sep 24 '16 at 23:45

0

use str() to see the attributes of your dataframe. For me, I just convert myclass variable as factor, then everything runs.

answered Sep 24 '16 at 23:45

JTD

1

it should be in comment – Enamul Hassan Sep 25 '16 at 00:10

adabag boosting function throws error when giving mfinal>10

6 Answers6

Linked