Questions tagged [bulk-load]

To bulk load means to import a data file in a user-specified format into a database table or view.

351 questions
0
votes
1 answer

Titan BatchLoading berkeleydb not persistent

i really cant figure out where my problem is. Im using Titan 0.5.0 (It's the same problem with the newer Titan versions...) I want to load a bunch of vertices and edges from a csv file with 100k entries (each line results in at least 3 nodes and…
0
votes
1 answer

Java & Cassandra - 2 CQLSSTableWriter Instances

I'm trying to find the most effective way to multithread a bulk load of data into multiple tables within a keyspace in Cassandra from a Java program. Here's my Keyspace/Table declaration: CREATE KEYSPACE IF NOT EXISTS articles WITH replication =…
ev0lution37
  • 1,129
  • 2
  • 14
  • 28
0
votes
1 answer

MS SQLXML. Import XML with specified namespace

I have to import XML data into a SQL Server database. I have the following XML (for example): With…
Sergey Nikitin
  • 845
  • 2
  • 13
  • 25
0
votes
3 answers

MySQL to AppEngine

I'm from Brazil and study at FATEC (college located in Brazil). I'm trying to learn about AppEngine. Now, I'm trying to load a large database from MySQL to AppEngine to perform some queries, but I don't know how i can do it. I did some testing with…
0
votes
0 answers

How to import 1 million rows in .csv format in MySQL workbench 6.2 ce

How can I import 1 million or more data (.csv format) in MySQL Workbench? Importing small amounts of data is easy but I am unable to store anything as large as 1 million data. The data is in a table with 15 columns and 0.4 million rows.
xtramous
  • 1
  • 1
0
votes
1 answer

How do I utilize the TPT FileName attribute to list multiple files?

The documentation of Teradata's tbuild bulk utility states that I can list multiple files if I set FileList = 'Y'. It does not, however, mention how to do so. I have tried something similar to this: VARCHAR FileList = 'YES', VARCHAR FileName …
Andy
  • 49,085
  • 60
  • 166
  • 233
0
votes
1 answer

Hive load CSV: load part of columns (or column mapping)

I have CSV file with 20 columns but I need only three of them. Is is possible to load part of columns? Something like column mapping during the bulk load in MySQL.
Tioma
  • 2,120
  • 9
  • 35
  • 52
0
votes
1 answer

Error in SQLXMLBulkLoad

Am I missing anything or this is a SQL Server bug!? When I use bulk load, I get 0 for a filed that is a foreign key from other table. The parent table does not have any record with key 0!! Here are tables in the database: CREATE TABLE xmlAction( …
Nicole
  • 57
  • 9
0
votes
2 answers

Fragmented XML Bulk Load to SQL Server in C#

I have an XML that contain information resulted from scanning systems on different domains. The XML corresponds to the tables in database that are nested as follows: Domains Computers Volumes Folders Files My goal…
Nicole
  • 57
  • 9
0
votes
2 answers

Will a bulk loader preserve order of rows while inserting

If I use an sql bulk loader to load 10 000 rows into an oracle database from a flat file, will the rows be inserted in the same order as they appear in the file? For example, let us say there is a unique key column that is automatically incremented…
Victor
  • 16,609
  • 71
  • 229
  • 409
0
votes
1 answer

Incremental UnorderedBulkOp calls to 'execute' are exponentially slower

I am trying to write a custom bulk upload script using the new mongo bulk apis. I am using UnorderedBulkOp which works really fast initially, but after being called several times it begins to hang. I've tried using log lines and it seems that after…
Comart
  • 64
  • 2
  • 8
0
votes
1 answer

Bulk replace of content of SQL Server tables

My ASP.NET MVC application has a number of web servers accessing a SQL Server database via Entity Framework 6. The database has 2 tables, with a one to many relationship between them. Once a day, the entire contents of both tables needs to be…
Rob Gutie
  • 31
  • 3
0
votes
1 answer

How to set parent for datastrore entity during bulkloading data by appcfg.py on Google App Engine?

I'm trying to bulkload data using appcfg.py as described here. I got it working except setting parent entity, I can't seem to find info on how to set a parent entity for entity being created by the import. Can you point me to the right direction or…
Janusz Skonieczny
  • 17,642
  • 11
  • 55
  • 63
0
votes
1 answer

Date fields and Django's loaddata

Can a date be loaded into a DateField using Django's loaddata admin feature? I have a JSON file that I'm using to bulk load data into my app. When you dumpdata, date fields are outputted in the format yyyy-mm-dd. However, if you try loading data…
mshafrir
  • 5,190
  • 12
  • 43
  • 56
0
votes
1 answer

Neo4j Bulk Import for Windows

I am running Neo4j 2.0.2 on a Windows 2012 server and have a need to import hundreds of millions of nodes/relationships quickly (a day). Are there any bulk import tools or processes that can be used on windows? I have attempted to load multiple…