Questions tagged [multipleoutputs]

83 questions
1
vote
1 answer

Keras multiple outputs : Not converging

I am building a multiple output keras model model1 = Model(input=ip, output=[main, aux]) model1.compile(optimizer='sgd', loss={'main':cutom_loss, 'aux':'mean_squared error'}, metrics='accuracy') model1.fit(input_data, [main_output, aux_output],…
shaaa
  • 503
  • 1
  • 4
  • 16
1
vote
0 answers

Hadoop MapReduce MultipleOutput remove _temporary directory

I am executing a mapreduce job with mapreduce action in oozie workflow. I am using multipleOutputs in Reducer phase as I want the output to be in different directories. I am able to get the multiple outputs in different directories as expected. But,…
jsanjayce
  • 272
  • 5
  • 15
1
vote
1 answer

java.lang.ClassCastException: org.apache.hadoop.io.serializer.WritableSerialization cannot be cast to org.apache.hadoop.io.serializer.Serialization

I am testing MultipleOutputs using MRUnit. The test cases are getting failed with the following message. java.lang.ClassCastException: org.apache.hadoop.io.serializer.WritableSerialization cannot be cast to…
MJBibin
  • 41
  • 7
1
vote
1 answer

For loop multiple items PHP

I want to output the question number (vraag) with a for loop so it gets 5 elements from the database (from 1 to 5). Then I want to get the answer from the user input (A/B/C/D) Get the answer values from the database based on the question number with…
user6178170
1
vote
0 answers

using OrcNewOutputFormat with MultipleOutputs

My ultimate goal is to spill each reducer's orc output in its own folder, making several external tables stored as orc. I'm trying to reproduce this http://hadoopathome.logdown.com/posts/277986-using-multipleoutputs-with-orc-in-mapreduce and it…
rudnev
  • 2,281
  • 3
  • 22
  • 31
1
vote
1 answer

Hadoop Mapreduce MultipleOutputs Output Console

I see a discrepancy between the console log when i run a mapreduce with and without multipleOutputs. I have a mapper only job that outputs to a text file. Without the MultipleOutputs configured, Code Snippet in my Mapper: context.write(null,new…
Manikandan Kannan
  • 8,684
  • 15
  • 44
  • 65
1
vote
1 answer

Using Multiple Mappers for multiple output directories in Hadoop MapReduce

I want to run two mappers that produce two different outputs in different directories.The output of the first mapper(Send as argument) should be send to the input of the second mapper.i have this code in the driver class import…
Barath
  • 107
  • 2
  • 14
1
vote
3 answers

hadoop MultipleOutputs to absolute path , but file is already being created by other attempt

I use MultipleOutputs to output data to some absolute paths, instead of a path relative to OutputPath. Then, i get the error: Error: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AlreadyBeingCreatedException): Failed to…
cola
  • 691
  • 1
  • 6
  • 15
1
vote
1 answer

MRUnit Example for MultipleOutputs

I have written a Map only hadoop job in which i have used MultipleOutputs concept. The problem here is, i want to test this code with MRUnit. I don't see any working example for MultipleOutputs testing. My mapper code will be like, public void…
1
vote
2 answers

Issue while Writing Multiple O/P Files in MapReduce

I have a requirement to split my input file into 2 output file based on a filter condition. My output directory should looks like below: /hdfs/base/dir/matched/YYYY/MM/DD /hdfs/base/dir/notmatched/YYYY/MM/DD I am using MultipleOutputs class to…
chanchal1987
  • 2,320
  • 7
  • 31
  • 64
1
vote
1 answer

how to output multiple files from a set of different input files for a python script in bash

I already have my python script producing my desired outputfile by passing 5 different inputfiles to it. Every inputfile is in a different folder, and in each folder there are more files which all of them start by "chr" and finish by the extension…
Àngel Ba
  • 371
  • 2
  • 9
0
votes
0 answers

Multiouput stacked regression with a single final estimator

Is there a way to train a stacked regressor with scikit-learn such that a single final estimator is used to return multiple outputs? I have been using sklearn.ensemble.StackingRegressor but, as indicated in the documentation of the .fit() method,…
0
votes
0 answers

Tensorflow 2: how to apply a loss function to only one part of a model (in a multi-output model)?

I am trying to train a multi-output convolutional neural network. The network takes one input, processes the input via a common stem, then branches out into different heads, with one output per head. Currently I am training the network with one loss…
0
votes
1 answer

Spring Cloud Data Flow : Sample application to have multiple inputs and outputs

Spring Cloud Data Flow : Sample application to have multiple inputs and outputs. Can anyone have a sample application to demonstrate spring cloud data flow with multiple inputs and outputs support
0
votes
0 answers

Pandas: Creating multiple new columns from function with multiple output values

Im trying to scrape a website for multiple values regarding a list of books. The links to the book pages are stored in a dataframe. Now I need a function that iterates those links and adds the book values to new columns in the dataframe. I don't…