Stack Overflow
Stack Overflow

Questions tagged [bulk-load]

To bulk load means to import a data file in a user-specified format into a database table or view.

351 questions
0
votes
1 answer

HBASE : Bulk load (Is my understanding correct)

Bulk load usually uses map reduce to create a file on HDFS and this file is then assoicated with a region. If thats the case, can my client create this file (locally) and put it on hdfs. See as we already know what keys are , what values, we can do…
user3529980
  • 61
  • 2
  • 5
0
votes
2 answers

AS3 Loading Workflow: XML First, then Multiple Assets

I am working on my first big Actionscript 3 website and trying to decide on the best loading sequence. I am currently using BulkLoader, since filesize wasn't much of an issue for a larger website, but I am definitely open to other approaches. I am…
Marcy Sutton
  • 907
  • 12
  • 22
0
votes
1 answer

Bulk insert in Couchbase using .NET SDK

Im trying to bulk insert into couchbase using the .NET SDK (1.3) but can't find the right syntax. In the SDK documentation under "troubleshooting" it refers to a problem that may occure when "bulk loading". This make me believe it's possible…
Nimrod
  • 370
  • 2
  • 11
0
votes
1 answer

How fast all the data is not adjacent in hbase columns are copied to another new table?

I have one hbase table named Table1,has row T1,T2,T3,...Tn , the new table named Table2. How can I copy all data in (T1,T3,T5 ...) from Table1 to Table2 ? One by one to get the row, then put to the new table is so slow.
lanyun
  • 141
  • 1
  • 4
  • 10
0
votes
2 answers

Large writes cause instability in Cassandra ring

I'm attempting to load a large amount of data into a 10-node Cassandra ring. The script doing the inserts gets ~4000 inserts / s, blocked presumably on network I/O. I launch 8 of these on a single machine, and the throughput scales almost linearly.…
Thanatos
  • 42,585
  • 14
  • 91
  • 146
0
votes
1 answer

SQLXMLBULKLOAD XSD check for element value before load

I am using SQLXMLBULKLOAD library to load a xml file using a xsd. Below is the section from XSD. …
KKR
  • 79
  • 8
0
votes
1 answer

MySqlBulkLoader for Mac / Windows Files

I use MySqlBulkLoader to load files into the table. The issue I have is that this file could come from both Mac and Windows which means the LineTerminator could be \r\n or just \n. Is there a way to load both these with the same code .. meaning can…
wishy
  • 1,748
  • 2
  • 12
  • 14
0
votes
0 answers

SQL Server 2012 Bulk Upload Error

I'm new in SQL. I don't really know why the import wizard won't work so I end up importing using the bulk load. It did work for the rest of my files but with one which is the biggest so far is giving me this error Msg 4832, Level 16, State 1, Line…
Jhun
  • 83
  • 1
  • 9
0
votes
1 answer

How to execute SybaseIQ Load Command in Java

I am developing an application in Java. I have to execute Sybase bulk LOAD command through my code. I am doing it like this: Connection conn = DriverManager.getConnection(); Statement st = conn.createStatement(); Boolean result =…
Neo
  • 93
  • 1
  • 12
0
votes
2 answers

Bulk convert log file date time format from 12 hour clock to 24 hour clock for mySQL database

I am creating a web app to analyze data from a client's custom database. I am having difficulty finding a way how to convert the client's log file entries from 12 hour clock to 24 hour clock. The Database that I am setting this up with cannot read…
Aaron
  • 1
0
votes
2 answers

bulk insert and parse a complex XML file into several tables

I have the following sql stored procedure to bulk insert and parse an xml file and insert its data into several tables in a database. The sql below works, however its inserting duplicate records into the #questions table and the #cards table. Any…
ama
  • 55
  • 1
  • 10
0
votes
1 answer

Cassandra SSTables generation memory consumption / available compression?

I am generating Cassandra SSTables using the bulk loading sample provided at DataStax website. http://www.datastax.com/dev/blog/bulk-loading My question is how much disk space is ideally consumed by the SSTable files ? In my case my data CSV file is…
amey
  • 23
  • 4
0
votes
1 answer

MySQL using bulk SQL statements with c#

I realize that LOAD DATA INFILE can be used to load text/csv data. However, this seems to be limited to inserts. However, is there a way to get MYSQL to bulk import SQL files using c#. My hope is to build up the SQL in a text file and then send it…
Michael Hartmann
  • 574
  • 7
  • 24
0
votes
2 answers

HBase bulk load when using native FS

I have a big list of HBase sql statements that I need to run against an existing instance of HBase database. The SQL statements are in plain text, and the database is running on native file system (instead of HDFS). Thus, I do not have a Hadoop…
Lazer
  • 90,700
  • 113
  • 281
  • 364
0
votes
2 answers

Need help in designing a phone book application on python running on google app engine

Hi I want some help in building a Phone book application on python and put it on google app engine. I am running a huge db of 2 million user lists and their contacts in phonebook. I want to upload all that data from my servers directly onto the…
Arun
  • 43
  • 2
  • 10
1 2 3
…
23 24