Questions tagged [batching]

193 questions
0
votes
0 answers

need help to perform batching on my set of data based on subitem count in C#

For instance , i have a list of items and maxBatchCount as 50: Batching would result in: (One batch can have max count as 50 if possible) Batch 1 : Batch 2 :…
0
votes
1 answer

Improve points per seconds writing with InfluxDB

I am trying to improve writing performance between a C client program and a single node of InfluxDB. Currently my record is 2.526K writes per seconds, as seen in the screenshot below: My C program is basically an infinite loop that produces HTTP…
Oscar
  • 1,071
  • 13
  • 26
0
votes
1 answer

Tensorflow batching without extra None dimension?

Is it possible to do batching in tensorflow without expanding the placeholder size by an extra dimension of None? Specifically I'd just like to feed multiple samples via the placeholders through feed_dict. The code base I'm working on would require…
0
votes
1 answer

Reading TFRecords with tf.data.Dataset api increases computation time

My data is in a tfrecords file. This simple code iterates and batches the images with the tf.data.Dataset api. Yet, the computation time per 100 batches increases. Why is this so and how to fix this? import tensorflow as tf import time sess =…
Rob Romijnders
  • 833
  • 1
  • 6
  • 16
0
votes
1 answer

Tensorflow - batching issues

I'm quite new to tensorflow, and I'm trying to train from my csv files using batch. Here's my code for read csv file and make batch filename_queue = tf.train.string_input_producer( ['BCHARTS-BITSTAMPUSD.csv'], shuffle=False,…
BlakStar
  • 147
  • 2
  • 11
0
votes
0 answers

Convnets : do we have separate activation maps for images in a batch

I know that if we input an image of shape [6,128] to a convolutional layer with 5 filters each of shape[3,128] with S=1 and P=0 , then there will be 5 activation maps as output from the layer ..each map has a shape of [4,1] But what about the…
Sarsoura
  • 241
  • 6
  • 17
0
votes
1 answer

Tensorflow MultivariateNormalDiag tensor of shape (None, output_dim, output_dim, output_dim) given mu and sigma of shape (None, 3)

So I am trying to make a tensor of multivariate gaussians using MultivariateNormalDiag I would like to supply two tensors of shape (None, 3) for the mu and sigma parameters like so dist = tf.contrib.distributions.MultivariateNormalDiag(mu,…
rfho_bdss
  • 170
  • 1
  • 18
0
votes
0 answers

Batching with tensor flow contrib not working as expected

I am using the following code for batching using the Tensorflow contrib library. def input_fn_batch(batch_size, train_data): """Input builder function.""" default = [tf.constant([''], dtype=tf.string)] * len(COLUMNS) base_data_values =…
VBK
  • 1,435
  • 1
  • 15
  • 34
0
votes
3 answers

Batch Process - Could not deserialize object

I've been playing around with the Batch processor recently, and in testing it's been working fine. I have since added it to our main project flow and I'm getting a strange issue. The Batch process itself contains nothing but a Logger, and the…
cerestorm
  • 43
  • 7
0
votes
2 answers

400 Bad Request : "Your request couldn't be completed" - ucwa batch request with postman

I sendes this batch request with postman: POST /ucwa/oauth/v1/applications/105177669305/batch HTTP/1.1 Host: lync.myDomain.com Accept: multipart/batching Content-Type: multipart/batching;boundary=6555373f-c163-b72d-5c00-c3cc6cb9cd52 Authorization:…
0
votes
1 answer

Using cyclops-react for batching on a async queue stream

I am trying to use cyclops-react to batch the elements from a queue, based on size, but also on time, so it doesn't block when there are no elements Maybe the functionality is not what I expected or I am doing something wrong The complete code…
0
votes
1 answer

Batching implementation for SQLite Android Database

An operation on my android app's table takes place in batches of N rows. I have a field batch_id in my table which indicates the batch that row belongs to (the first N rows have X as it's batch_id, the next N has Y and so on). The operation on a…
not_again_stackoverflow
  • 1,285
  • 1
  • 13
  • 27
0
votes
2 answers

Batch file to create .txt files with specific names: String001.txt, String002.txt, etc

Ive used the for loop below, but can only get it to ouput an incrementing number as the name. It ignores the string. (1.txt, 2.txt, etc.). For /l %%x (1, 1, 9) do (echo string%%x > %%x.txt) How do I add the static string in front of each…
Glycoversi
  • 77
  • 8
0
votes
1 answer

TensorFlow issue with feed_dict not being noticed when using batching

I have been trying to do the mnist tutorial with png files, and have gotten most things to the point where they make sense. The gist of the code is here however I'm going to walk through what it does and where the issue is happening. I have a…
0
votes
1 answer

Batching for a non-image data set with Tensorflow

I am a beginner in tensorflow. I have a data set with 43 inputs and one output. I am gonna create a mini-batch of the data to run deep learning. Here are my inputs: x = tf.placeholder(tf.float32, shape=[None, 43]) y_ = tf.placeholder(tf.float32,…
Afshin Oroojlooy
  • 1,326
  • 3
  • 21
  • 43