Questions tagged [boosting]

Boosting is a machine learning ensemble meta-algorithm in supervised learning, and a family of machine learning algorithms that convert weak learners to strong ones. Also: Boosting is the process of enhancing the relevancy of a document or field

From [the docs]:

"Boosting" is a machine learning ensemble meta-algorithm for primarily reducing bias, and also variance in supervised learning, and a family of machine learning algorithms that convert weak learners to strong ones.

Also:

From the docs:

Boosting is the process of enhancing the relevancy of a document or field. Field level mapping allows to define an explicit boost level on a specific field. The boost field mapping (applied on the root object) allows to define a boost field mapping where its content will control the boost level of the document.

181 questions
1
vote
0 answers

How to quantify similarity of tree models? (XGB, Random Forest, Gradient Boosting, etc.)

Are there any algorithms that quantify the similarity of tree based models such as XGB? For example, I train two XGB models with different datasets for example in cross validation and want to estimate the robustness or consistency of the predictions…
Soerendip
  • 7,684
  • 15
  • 61
  • 128
1
vote
1 answer

Different boosting for the same field in different types in Elasticsearch 2.x with multi_match query

I am trying to do the following as described in the documentation (which is maybe outdated at present date). https://www.elastic.co/guide/en/elasticsearch/guide/current/mapping.html I will adapt the scenario described there to what I want to…
Pedro Lopez
  • 2,236
  • 2
  • 19
  • 27
1
vote
1 answer

Solr - Boosting parent documents based on child document field

I am trying to figure out how to boost my parent documents based on the values within a sub-document. I am currently using Solr 5.3 and everything is indexed correctly. Here is the document structure I'm working with: { id : 1 type_s :…
Nick
  • 21
  • 5
1
vote
1 answer

How can I boost a particular field using Sitecore 7.5 and Solr 4.7?

I have a field called "Page Title" that is part of a base template that I called "Base Titles". All of my content pages inherit this base template. I would like to boost the Page Title field in my search results so that if the search term is found…
Corey Burnett
  • 7,312
  • 10
  • 56
  • 93
1
vote
1 answer

How to install boosting.m1 package in R?

How can I use the function adaboost.M1? I am testing the following codes in R. But I always have the error message: Error: could not find function "adaboost.M1". What packages do I miss?…
0
votes
0 answers

How should i speed up my AdaBoost implementation?

For I school project I've created the following AdaBoost classifier implemententation with Python: from DecisionStump import * from sklearn.base import BaseEstimator class AdaBoost(BaseEstimator): def __init__(self, boosting_rounds): …
0
votes
0 answers

How does XGBoost use MAE as objective function?

XGBoost did not allow to use absolute error as objective function in the past since it is a non-differentiable function and its Hessian is equal to 0. However, it does allow to use it now…
0
votes
1 answer

CatBoostRegressor with loss_function='Lq'

I am not sure how to specify the "q" variable in the "Lq" loss function. I receive the following error message: CatBoostError: /src/catboost/catboost/private/libs/options/catboost_options.cpp:82: Param q is mandatory for Lq loss My code is as…
0
votes
0 answers

Estimation of error in Multiclass Adaboost gives me problems

I'm using a multiclass implementation of multiclass Adaboot by Xin Jin https://github.com/jinxin0924/multi-adaboost/tree/master I want to make use of the SAMME algorithm to solve my problem. Inside the method discrete_boost I want to estimate the…
0
votes
0 answers

Overcoming the 'not implemented yet' error when combining model shrinkage with learning continuation in CatBoost

First of all, thanks to the people that worked on the catboost library, it's amazing! I am researching the combination of learning continuation, posterior sampling and model shrinkage in gradient boosting. I want to see what happens when I use these…
erik
  • 1
  • 3
0
votes
0 answers

Boosting Documents in Apache Solr Based on Multiple Field Values using the DisMax Query Parser with OR Operator

I am attempting to boost documents in Apache Solr based on multiple field values using the DisMax query parser. Since this has to be a multiplicative boost, I can't use bq. Specifically, I want to boost documents that have city values of "Mumbai,"…
Sumit Raj
  • 11
  • 2
0
votes
0 answers

autocorrelation of data in gradient boosting

I try to model the indoor temperatures of 9 rooms in 3 floors (each floor has 3 connected room, marked as a, b, c, d). Meanwhile, I have independent variables as outdoor temperature and outdoor wind speed. If I would like to use room and floor as…
GChen
  • 1
0
votes
1 answer

Best parameters for UMAP + HistGradientBoostingClassifier

I'm trying to find the best parameters for the UMAP (dimensionality reduction) model together with HistGradientBoostingClassifier. The loop I have created is: vectorizer = TfidfVectorizer(use_idf=True, max_features = 6000) corpus =…
Maite89
  • 273
  • 2
  • 8
0
votes
0 answers

How can I find out what features the total score returned from products is based on on Solr?

How can I find out what features the total score returned from products is based on on Solr? I'll print these scores one by one elsewhere. I want to see what the total scores of the products returned from Solr are based on.
0
votes
0 answers

Error: The tuning parameter grid should have columns

For the training of the GBM model I use the defined grid with the parameters. However r constantly tells me that the parameters are not defined, even though I did it. enter image description here Does anyone know how to fix this, help is much…