Stack Overflow
Stack Overflow

Questions tagged [one-hot-encoding]

One-Hot Encoding is a method to encode categorical variables to numerical data that Machine Learning algorithms can deal with. One-Hot encoding is most used during feature engineering for a ML Model. It converts categorical values into a new categorical column and assign a binary value of 1 or 0 to those columns.

Also known as Dummy Encoding, One-Hot Encoding is a method to encode categorical variables, where no such ordinal relationship exists, to numerical data that Machine Learning algorithms can deal with. One hot encoding is the most widespread approach, and it works very well unless your categorical variable takes on a large number of unique values. One hot encoding creates new, binary columns, indicating the presence of each possible value from the original data. These columns store ones and zeros for each row, indicating the categorical value of that row.

1224 questions
3
votes
0 answers

How do I load Python sklearn one hot encoder in golang?

I fit a one hot encoder in Python. I can save it using pickle or joblib for instance. I wonder if I can load it in golang to preprocess my data. import ( "io" "os" "github.com/hydrogen18/stalecucumber" prep…
Robin
  • 605
  • 2
  • 8
  • 25
3
votes
1 answer

what should I encode background class with tf.one_hot?

When I do a classification job, I need to encode a classid with one_hot method. But shuold I encode background class with -1 or 0 with tf.one_hot function? For example: // plan a logits = [0.1, 0.1, 0.2, 0.3, 0.4] classids = [-1,1,2,3,4] // -1 is…
tidy
  • 4,747
  • 9
  • 49
  • 89
3
votes
2 answers

How do I one-hot encode pandas dataframe for whole columns, not for each column?

I want to one-hot encode pandas dataframe for whole columns, not for each column. If there is a dataframe like below: df = pd.DataFrame({'A': ['A1', 'A1', 'A1', 'A1', 'A4', 'A5'], 'B': ['A2', 'A2', 'A2', 'A3', np.nan, 'A6], 'C': ['A4', 'A3', 'A3',…
Hyunseung Kim
  • 493
  • 1
  • 6
  • 17
3
votes
1 answer

Can we use pytorch scatter_ on GPU

I'm trying to do one hot encoding on some data with pyTorch on GPU mode, however, it keeps giving me an exception. Can anybody help me? Here's one example: def char_OneHotEncoding(x): coded = torch.zeros(x.shape[0], x.shape[1], 101) for i in…
JOHNKYON
  • 83
  • 1
  • 7
3
votes
4 answers

Create dummy variables from all categorical variables in a dataframe

I need to one-encode all categorical columns in a dataframe. I found something like this: one_hot <- function(df, key) { key_col <- dplyr::select_var(names(df), !! rlang::enquo(key)) df <- df %>% mutate(.value = 1, .id = seq(n())) df <- df %>%…
Dmytro Fedoriuk
  • 331
  • 3
  • 11
3
votes
2 answers

Using "one hot" encoded dependent variable in random forest

I'm building a random forest in python using sklearn-learn, and I've applied "one hot" encoding to all of the categorical variables. Question: if I apply "one hot" to my DV, do I apply all of its dummy columns as the DV, or should the DV be handled…
Uncle_Timothy
  • 101
  • 1
  • 2
  • 10
3
votes
4 answers

Encode numbers into categorical vectors

I have an vector of integers y <- c(1, 2, 3, 3) and now I want to convert it into an list like this (one hot encoded): 1 0 0 0 1 0 0 0 1 0 0 1 I tried to find a solution with to_categorical but I had problems with data types... Do anyone know a…
Henryk Borzymowski
  • 988
  • 1
  • 10
  • 22
3
votes
3 answers

One Hot Encoding for top categories, NA, and remaining subsumed as 'others' in R

I want to one hot encode my variables only for the top categories and NA and 'others'. So in this simplified example, hot encoding b where freq > 1 and NA: id <- c(1, 2, 3, 4, 5, 6) b <- c(NA, "A", "C", "A", "B", "C") c <- c(2, 3, 6, NA, 4, 7) df…
Sarah
  • 137
  • 9
3
votes
1 answer

Encode multiple label in DataFrame

Given a list of list, in which each sublist is a bucket filled with letters, like: L=[['a','c'],['b','e'],['d']] I would like to encode each sublist as one row in my DataFrame like this: a b c d e 0 1 0 1 0 0 1 0 1 0 0 …
Garvey
  • 1,197
  • 3
  • 13
  • 26
3
votes
2 answers

How to do one hot encoding in R

Each opportunityID have several products I want to have a binary column that says if an opportunity has this product or not. How to do that? Input +---+---------------+--------+----------+----------+ | | Opportunityid | Level | Product1 |…
sara
  • 534
  • 1
  • 9
  • 22
3
votes
1 answer

Dask DummyEncoder not returning all the columns

I tried using dask DummyEncoder for OneHotEncoding my data. But the results are not as expected. dask's DummyEncoder Example: from dask_ml.preprocessing import DummyEncoder import pandas as pd data = pd.DataFrame({ 'B': ['a', 'a',…
Asif Ali
  • 1,422
  • 2
  • 12
  • 28
3
votes
3 answers

Transform one column from categoric to binary, keep the rest

I have a medium large dataframe, for which I want to transform one column with categories to binary columns, one for each category. At the same time, I want to keep the rest of the columns in the dataframe. What would be the easiest way to achieve…
aldorado
  • 4,394
  • 10
  • 35
  • 46
3
votes
3 answers

one hot encoding function

I need to create a function that takes two integer numbers x and N, where N > x and returns a vector of dimension N with all zeros with the exception of component x, in which it has a 1. I managed to do it in the following…
3sm1r
  • 520
  • 4
  • 19
3
votes
1 answer

How to set reference levels in a Spark ML Logistic Regression using OneHotEncoder

I'm working in PySpark using Spark 2.1 to prepare my data to build a logistic regression. I have several string variables in my data and I want to set the most frequent category as the reference level. I first use StringIndexer to encode the string…
Amber Z.
  • 339
  • 3
  • 5
  • 15
3
votes
1 answer

pandas get_dummies cannot handle unseen labels in test data

I have a Pandas DataFrame, train, that I'm one-hot encoding. It looks something like this: car 0 Mazda 1 BMW 2 Honda If I use pd.get_dummies, I'll get this: car_BMW car_Honda car_Mazda 0 0 0 1 1 1 0 …
anon_swe
  • 8,791
  • 24
  • 85
  • 145
1 2 3
…
81 82