Stack Overflow
Stack Overflow

Questions tagged [bulk-operations]

60 questions
1
vote
1 answer

Oracle Archive and Purge Options

I am trying to figure out what are the best options to perform archive and purge given our situation. We have roughly 50 million records in say Table A. We want to archive data into a target table and then purge those data in the source table. We…
John Al
  • 159
  • 1
  • 11
1
vote
2 answers

Insert thousands of records from Java to Oracle, how can I get the best performance?

I need to make a batch process in java that will read a file of a variable amount of records (though can safely assume 5k+), treat them and then insert the records into an oracle 11g database. I need to do it via call(s) to a stored procedure. I…
Jorge Fortson
  • 13
  • 4
1
vote
1 answer

How to improve the performance of this insert statements for huge data ingest?

I have a requirement to insert huge (50GB of random data) into my database, so that I can use a backup application to check the de-duplication ratio. I have written a small procedure like below This is taking more than 1 hour. I don't know how to…
simi
  • 21
  • 4
1
vote
2 answers

Implementing Type 2 SCD in Oracle

First I would like to say that I am new to the stackoverflow community and relatively new to SQL itself and so please pardon me If I didn't format my question right or didn't state my requirements clearly. I am trying to implement a type 2 SCD in…
user8740527
  • 67
  • 2
  • 7
1
vote
0 answers

Oracle Insert Performance

I insert data from external table to my table that is range partitioned and have two local indexes. My case, I have to insert records under 60 seconds for each flat file because new one comes. A flat file consists +5 M records and 2 GB.(volume :…
mehmet sahin
  • 802
  • 7
  • 21
1
vote
3 answers

Understanding 'BULK COLLECT' in Oracle Function

Given the following Oracle function: CREATE or REPLACE FUNCTION foo(id NUMBER, category VARCHAR) RETURN CHAR IS TYPE MY_ARRAY2 IS TABLE OF NUMBER; MY_ARRAY MY_ARRAY2; BEGIN SELECT my_id BULK COLLECT INTO my_array FROM my_table RETURN ( …
Kevin Meredith
  • 41,036
  • 63
  • 209
  • 384
1
vote
1 answer

Is it good to drop and recreate index frequently

We have a performance issue for a table which has indexes. It takes 1 hour to load, but if we drop the indexes and recreate them after each load it executes in 30 minutes. Is it a feasible solution to drop and recreate the indexes for that table…
Mahesh Malpani
  • 1,782
  • 16
  • 27
1
vote
2 answers

Track the rows which were updated or encrypted

I want to scrub(or encrypt) the email information from a few tables which are older than a few years. This I am planning to do as part of a job, next time when I run the job how can I omit the rows which are already scrubbed or encrypted. I am…
TomJava
  • 499
  • 1
  • 8
  • 24
1
vote
1 answer

MongoDB initializeOrderedBulkOp() : Update(push to array) only if find() returns null

I am using Bulk Operations in mongodb. I have a situation where I need to push an object into an array field if the conditions are not met. Here if there are no items in configs that match itype and prefix, then it should push the object into the…
ashwin mahajan
  • 1,654
  • 5
  • 27
  • 50
1
vote
0 answers

Using PLSQL, how can I read rows with blob field that holds a text file with a million numbers and insert into another table

I have a table with 20 rows. Each row has a blob field that holds a txt file. Inside the text file is a million unique 10 digit numbers. How can I read and insert those numbers into another table in an efficient manner using oracle sql and plsql.…
Hoja0512
  • 11
  • 1
1
vote
0 answers

bulkWriteResult in mongo , nMatched and no of documents updated does not match

i using the aggregate framework for updating the user stats for all users, which is somewhere around 50k , out of which 30k have atleast single order delivered. Now the query i am using is var orderIds = db.delivery.find({"status":…
user29578
  • 689
  • 7
  • 21
1
vote
2 answers

Couch db bulk operations

So I've been trying to move data from one database to another. I've already move them but I need to clear the documents which I've already moved from the old database. I've been using ektorp's execute bulk to perform bulk operations. But for some…
Vebito
  • 154
  • 1
  • 10
1
vote
2 answers

Is this a valid mapping for a REST API?

I've come up with the mapping that follows while working on the REST API of a system where users are able to create and manage resources of different types. // READ OPERATIONS GET /objects => read collection meta GET /objects/[id] …
Jacoscaz
  • 159
  • 1
  • 7
0
votes
1 answer

Multiple Columns and different Join Conditions for Oracle update

I have 2 tables , 1 is location and the Other one is Look up table. I have to look into the look up table for the location values and if they are present mark them as 'Y' and 'N' along with their corresponding values I have written individual…
user2815115
  • 69
  • 1
  • 1
  • 8
0
votes
1 answer

Oracle database table delete best practices

Environment: Oracle 12C Got a table with about 10 columns which include few clob and date columns. This is a very busy table for an ETL process as described below- Flat files are loaded into the table first, then updated and processed. The insert…
RKA
  • 221
  • 3
  • 14
1
2
3 4