Stack Overflow
Stack Overflow

Questions tagged [boosting]

Boosting is a machine learning ensemble meta-algorithm in supervised learning, and a family of machine learning algorithms that convert weak learners to strong ones. Also: Boosting is the process of enhancing the relevancy of a document or field

From [the docs]:

"Boosting" is a machine learning ensemble meta-algorithm for primarily reducing bias, and also variance in supervised learning, and a family of machine learning algorithms that convert weak learners to strong ones.

Also:

From the docs:

Boosting is the process of enhancing the relevancy of a document or field. Field level mapping allows to define an explicit boost level on a specific field. The boost field mapping (applied on the root object) allows to define a boost field mapping where its content will control the boost level of the document.

181 questions
0
votes
1 answer

How to implement decision trees in boosting

I'm implementing AdaBoost(Boosting) that will use CART and C4.5. I read about AdaBoost, but i can't find good explenation how to join AdaBoost with Decision Trees. Let say i have data set D that have n examples. I split D to TR training examples and…
user3785803
  • 41
  • 8
0
votes
1 answer

using boost in lucene on Cloudant search index performance

I am trying to find how boosting works in cloudant search index. i.e, if I want search by words "some text" and increase the boost for "some" to 4 and "text" to 1. is Cloudant is going to search first for docs which has "some" and then search for…
pa1kumar
  • 1
0
votes
1 answer

Gradient Boosting Tree for feature engineering? (Rank)

I am working on a project where I have clicks/dismisses on web pages and I want to rank the web pages accordingly. I initially did this by writing a simple equation for calculating relevance score but I am hearing that random boosting tree can help…
Rohan Thakkar
  • 1
0
votes
0 answers

Gradient Boosting Classifier-n_estimators

I am trying Gradient Boosting Classifier for my project. I am using 100 samples. I have used Leave one out cross validation. As far as i know, GBC should give good results with large n_estimators. But i am getting low results with large…
user3419487
  • 185
  • 1
  • 9
0
votes
1 answer

Putting higher emphasis in a should filter

I'm trying to prioritize records that have a primary category, over those that have a secondary category, I've found this page https://www.elastic.co/guide/en/elasticsearch/guide/1.x/query-time-boosting.html and It's a basic example I'm not able to…
Moak
  • 12,596
  • 27
  • 111
  • 166
0
votes
1 answer

Sorting with Boosting item solr in sitecore v7

I'm using boosting item for solr seach in sitecore 7.2. I added value in Boost Value then rebuild index so how can i sorting for result item by boosting value? I tried st like that : var…
Cuong Nguyen
  • 61
  • 6
0
votes
1 answer

XGBoost - learning rate

I am running some experiment using XGBoost. I set number of iterations to 1000 and get result - reasonable ones.. Than I tried to do something different: Instead of run 1000 iterations I would like to run 100 iterations, a this repeat 10 times…
gugatr0n1c
  • 377
  • 6
  • 21
0
votes
3 answers

Elastic.co/Elastic search - Relevance feedback with multiple Boosting Queries

I'm trying to implement relevance feedback for Elastic Search (Elastic.co). I'm aware of boosting queries, which allow for the specification of postiive and negative terms, with the idea being to discount the negative terms, while not excluding them…
smck1
  • 1
0
votes
1 answer

How to get the decision tree built at an iteration of the Ada boosting package in R?

I have built a boosting model with 50 decision trees using the "ada" package in R. How can I print the decision tree built at a iteration of "ada"? I can use the "print" function to display the detail of a "rpart" object, is there any similar…
Carter
  • 1,563
  • 8
  • 23
  • 32
0
votes
1 answer

How to use adabag for regression

Th example from the documentation (1) uses a classification example. However, I would need to use regression. How can I do regression adaptive boosting in R? This code results in the following error: > mybag <- boosting(totalUSD ~ ., data =…
user1477388
  • 20,790
  • 32
  • 144
  • 264
0
votes
1 answer

Boosting query is not working properly

{ "sort": [ { "is_active": "asc" } ], "fields": [ "is_job_seeking", "is_active" ], "query": { "bool": { "must": [ { "bool": { "must": { "term": { …
kskaradzinski
  • 4,954
  • 10
  • 48
  • 70
-1
votes
1 answer

R: how to make predictions using gamboost

library(mboost) ### a simple two-dimensional example: cars data cars.gb <- gamboost(dist ~ speed, data = cars, dfbase = 4, control = boost_control(mstop = 50)) set.seed(1) cars_new <- cars + rnorm(nrow(cars)) > predict(cars.gb,…
Adrian
  • 9,229
  • 24
  • 74
  • 132
-1
votes
1 answer

Accuracy on training data in Gradient boosting classifier- scikit

I am training GBC. It is multi class classifier with 12 classes of outputs. My issue is I am not getting 100% accuracy when i predict on the train data. In fact, misprediction happens on dominant set of classes. (my input is imbanalanced and i do…
sranga
  • 123
  • 1
  • 7
-1
votes
1 answer

Understanding the basic idea of Gradient Boosting for machine learning

My understanding of gradient boosting is this... We can make the model much more complex by creating lots of decision trees sequentially. Each decision trees build on each other. The goal of each new tree is to fix the errors where the previous…
asilvester635
  • 81
  • 2
  • 13
-2
votes
1 answer

Error in eval(expr, envir, enclos) : object 'PAY_0.1' not found (Boosting)

I am trying to apply a boosting model but I keep getting this error. Any help at all would be much appreciated. This is a data set from kaggle, UCI credit card data, if you are wondering. DataSplit <-…
anoanoanoano
  • 9
  • 1
1 2 3
…
11
12