Questions tagged [boosting]

Boosting is a machine learning ensemble meta-algorithm in supervised learning, and a family of machine learning algorithms that convert weak learners to strong ones. Also: Boosting is the process of enhancing the relevancy of a document or field

From [the docs]:

"Boosting" is a machine learning ensemble meta-algorithm for primarily reducing bias, and also variance in supervised learning, and a family of machine learning algorithms that convert weak learners to strong ones.

Also:

From the docs:

Boosting is the process of enhancing the relevancy of a document or field. Field level mapping allows to define an explicit boost level on a specific field. The boost field mapping (applied on the root object) allows to define a boost field mapping where its content will control the boost level of the document.

181 questions
0
votes
1 answer

Gradient Boosting using Python - General Question

What I want to achieve. My data is in the following format. Daily Natural Gas price settlements. Column A : individual rows from December 2018 - December 2026 Column B : Opening price of gas from December 2018 - December 2026 Column C : Previous…
0
votes
1 answer

Is Random Forest (in python) a boosting algorithm?

I'm looking for the main differences between random forest and gradient boosting and I don't understand whether random forest uses boosting techniques and if not, why. Thanks!
0
votes
0 answers

Differences between adabag and rpart

I've found something strange (at least to me) when using rpart and adabag packages in R (R version 3.5.1 (2018-07-02) -- "Feather Spray")). I'm wondering what is the reason of obtaining different trees when using both packages even if…
0
votes
1 answer

Why are the predict values of gbm (R package) negative?

I analyzed my data with 'gbm' R package. My data is based on a cohort study. Therefore, I ran 'gbm' model based on the 'coxph' results. After constructing a model, I would like to see how this model can predict well. On the other hand, like the…
SJUNLEE
  • 167
  • 2
  • 14
0
votes
1 answer

Python SkLearn Gradient Boost Classifier Sample_Weight Clarification

Using Python SkLearn Gradient Boost Classifier. The setting I am using is selecting random samples (stochastic). Using the sample_weight of 1 for one of the binary classes (outcome = 0) and 20 for the other class (outcome = 1). My question is how…
0
votes
2 answers

AttributeError: 'str' object has no attribute 'fit'

Hi I want to use a simple AdaBoostClassifier on the mushroom dataset which lools smth. like: target cap-shape cap-surface cap-color bruises odor \ 3059 0 2 3 2 1 5 1953 0 5 …
2Obe
  • 3,570
  • 6
  • 30
  • 54
0
votes
2 answers

Error in Adabag boosting function

df1 <- data.frame(ID = c(1, 2, 3, 4, 5), var1 = c('a', 'b', 'c', 'd', 'e'), var2 = c(1, 1, 0, 0, 1)) ada = boosting(formula=var1~., data=df1) Error in cbind(yval2, yprob, nodeprob) : el número de filas de…
0
votes
2 answers

Changing parameter 'learning_rate' for CatBoostRegressor

Is there any possibility to change (decrease) parameter 'learning rate', a gradient step coefficient, during training the model CatBoostRegressor() ? It would reduce the iterations number and quicken the training?
0
votes
0 answers

Using spline transformation in gbm function in R

I am trying to use spline transformation(bs function) in the boosting algorithm in R. (gbm function). However, when I write the following code it throws me an error: gbm(as.integer(cancel) ~ bs(log_tenure), data = train, distribution =…
DS_Enthusiast
  • 65
  • 1
  • 8
0
votes
1 answer

Reproduce boosting of C5.0 trials

I'm using the C50 package with R and need to export models for production. I'm using boosting option, i know that trials are weighted but weights are not specified in my output. I'm not using the weight option for miss-classification, i just need…
Romain R
  • 47
  • 8
0
votes
1 answer

How do normalization and internal optimization of boosting work? And how does that affect the relevance?

I'm new to elastic search. I'm having trouble understanding the calibration and scaling of boost values for fields in a document. As in how should we decide the boosting values for field so that it works as expected. I've gone through some of the…
twarzo
  • 63
  • 2
  • 9
0
votes
1 answer

What happens in Solr when a document field does/doesn't match a term in boost query (bq)?

I was wondering how to interpret boost query. I know if a document has a match on a boost like bq=name:"bob"^5 then it will be given a higher ranking, but in general if you have many terms with different fields what happens when a given document…
muZero
  • 948
  • 9
  • 22
0
votes
1 answer

Can't boost thumbnail field - SOLR

Solr newbie here I am constructing queries to boost certain items on my webpage, and I want to be able to boost fields that contain a thumbnail (image) value: campaign B
Jazzbaron
  • 75
  • 11
0
votes
1 answer

Elasticsearch Query: Boosting specific field

I am using Elasticsearch 2.4.3 and want to boost specific fields in my query. Is this possible? I only see how I can boost an index. Greetings! UPDATE Mapping: "firstName":{"type":"string", "analyzer":"customNGram" }, "lastName":{ …
Timo Ademeit
  • 675
  • 2
  • 7
  • 15
0
votes
1 answer

stop xgboost based on eval_metric

I am trying to run xgboost for a problem with very noisy features and interested in stopping the number of rounds based on a custom eval_metric that I have defined. Based on domain knowledge I know that when the eval_metric (evaluated on the…
1 2 3
11
12