Stack Overflow
Stack Overflow

Questions tagged [bulk-load]

To bulk load means to import a data file in a user-specified format into a database table or view.

351 questions
3
votes
1 answer

Gather stats on an Index or drop create?

Does dropping and recreating an index have the same effect as to using dbms.gather_index_stats? (Does it have the same effect as rebuilding/updating the index) Or are these two completely different things that should not be compared to one another?
Avias
  • 354
  • 1
  • 4
  • 14
3
votes
2 answers

How to read a ARRAY of types returned from a stored proc using java?

This is a continuation of the question posted under the following location: Java program to pass List of Bean to a oracle stored procedure - Pass entire list at one shot rather than appending objects one after the other I have been trying to…
sandy
  • 243
  • 2
  • 7
  • 19
3
votes
1 answer

Performing bulk load in cassandra with map reduce

I haven't got much experience working with cassandra, so please excuse me if I have put in a wrong approach. I am trying to do bulk load in cassandra with map reduce Basically the word count example Reference :…
Arun A K
  • 2,205
  • 2
  • 27
  • 45
3
votes
1 answer

Exception during bulk loads do Cassandra 1.1

I'm getting exception while bulk loads with sstableloader. I'm using JDK 1.6.0_25 64bit, Ubuntu 12.04 server. Ipv6 is turned off. Network communication between hosts works correctly. I'm going crazy ;-( Exception in thread "Streaming to…
tomekkup
  • 353
  • 2
  • 14
3
votes
2 answers

Bulk load XML referring to auto-increment parent-id

In short: I want to do an XML Bulk Load to a SQL Server (2008) database and generate auto-increment-id's for a parent, that can be used in the child. This seems limited by the scope: the parent-node is not finished, so not inserted yet. Does…
Yahoo Serious
  • 3,728
  • 1
  • 33
  • 37
3
votes
1 answer

BulkLoading the R* tree with spatialindex library

After successfully building the R* tree with spatial library inserting records one-by-one 2.5 million of times, I was trying to create the R* tree with bulkloading. I implemented the DBStream class to iteratively give the data to the BulkLoader.…
arthur
  • 1,034
  • 2
  • 17
  • 31
3
votes
0 answers

Referring to an attribute in a different element in the XSD schema

I’m using XML Bulk Load (SQLXML 4.0) into SQL Server 2008. This works ok. I need to create a relationship between elementA and elementB in the SQL tables using XSD. Since the id attribute in elementA is unique, how do I add (reference?) this to…
norm
  • 319
  • 2
  • 8
3
votes
2 answers

Error while bulk load in hbase

I am trying Hbase - bulkLoad through Java MapReduce program. I am running my program in Eclipse. But I am getting the following error: 12/06/14 20:04:28 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId= 12/06/14…
Pradeep Bhadani
  • 4,435
  • 6
  • 29
  • 48
2
votes
1 answer

Overload CQRS pattern with multiple database calls

I am working on a .NET 6 project with EF core 6.0. The project is build using Clean Architechture and CQRS pattern. My question is more general and I am looking more for opinions rather than straight answers. So imagine that I have a command that…
Plamen Michev
  • 40
  • 4
2
votes
2 answers

Batch Insert: Using Single vs. Multiple Statements

In a single transaction, is there any significant performance difference between doing batch insert with a single statement like: -- BEGIN TRANSACTION INSERT INTO films (code, title, did, date_prod, kind) VALUES ('B6717', 'Tampopo', 110,…
Cemre Mengü
  • 18,062
  • 27
  • 111
  • 169
2
votes
1 answer

bulk loading data into a b+tree

I have built a b+tree index of my own, with all the operations for insert/delete/search over the index. To accelerate the insertion of a huge dataset, I would like to implement bulk-loading as well to be able to experiment with large datasets. What…
Pirooz
  • 1,268
  • 1
  • 13
  • 24
2
votes
1 answer

Why does PostgreSQL use so much memory during multiple insert than copy?

I have been practising bulk load using Laurenz Albe' s blog https://www.cybertec-postgresql.com/en/postgresql-bulk-loading-huge-amounts-of-data/. The problem start when I changed it a little bit. The table is the same: CREATE TABLE t_sample ( a…
Umut TEKİN
  • 856
  • 1
  • 9
  • 19
2
votes
1 answer

Bulk out-of-order data import into QuestDB

I'm looking into using QuestDB for a large amount of financial trade data. I have read and understood https://questdb.io/docs/guides/importing-data but my case is slightly different. I have trade data for multiple instruments. For each instrument,…
eyevz
  • 63
  • 6
2
votes
0 answers

Bulk load aborted with some files not yet loaded

I am doing bulk load in Hbase But getting error while loading Hfiles. 11:02:49.909 ERROR org.apache.hadoop.hbase.tool.LoadIncrementalHFiles - ------------------------------------------------- Bulk load aborted with some files not yet…
madhuri tilekar
  • 31
  • 3
2
votes
2 answers

Can we load multiple data source into single table structure simultaneously?

I know 2008 is outdated but a need is a need irrelevant to sources I am using SSIS 2008 and SQL Server 2008 R2 , My requirements are Load multiple source file data using Bulk load in control flow (Each File size is 20 Gig .txt files-- In total 150…
vikki
  • 23
  • 4
1 2 3
…
23 24