Bulk update a database
Methods to bulk update a database with single or multiple columns of data. This could be either unique data for each row or same data for a column.
Questions tagged [bulkupdate]
299 questions
0
votes
1 answer
How to remove many to many from a queryset in Django
I have a queryset
Class SmallFoo(Model):
text = models.CharField()
Class Foo(Model):
small_foo = models.ManyToManyField(SmallFoo)
e.g.Foo.objects.filter(id__in=[2,4,6]).update(small_foo__remove=[1,2])
I want to do something like above…
Akamad007
- 1,551
- 3
- 22
- 38
0
votes
1 answer
Bulk updation in hibernate
Bulk updation working fine on local system but takes hours to execute on testing servers.Though the DB is not much in use and contains 150 000 records.
Session session=hibernateTemplate.getSessionFactory().openSession();
String sqlQuery =…
shadow3
- 107
- 1
- 5
0
votes
1 answer
Is there an upper limit on the number of documents you can update in PyMongo?
I am updating ~600,000 documents in a mongo collection using some PyMongo code that looks like this
bulk = coll.initialize_ordered_bulk_op()
for index, row in df.iterrows():
bulk.find({ '_id': ObjectId(row['id']) }).update({ '$set': { "X":
…
Alice Mortlock
- 1
- 2
0
votes
0 answers
Mongo Bulk Write using Hadoop Map Reduce
These are my steps to include:
I have to include JSON file from S3.
File contains uid, ag, gn, yob, scrtp attribute.
I have to make key as uid and value as ag, gn, yob, scrtp value, and that is included in HashMap collection.
Reducer will reduce it…
Ronak Kabra
- 11
- 5
0
votes
1 answer
Query for Bulk update in Mysql
Consider the following table(T) in mysql.
id c1 c2
1 10 100
2 20 200
3 30 300
Suppose I want to update "c1" of the row with id=2. I can do the following.
UPDATE T set col1=20 where id=1;
Suppose I want bulk update.
INSERT INTO T(id,c1)…
Avinash142857
- 129
- 2
- 13
0
votes
0 answers
Bulk update in mongodb(3.3) with node.js(4.4.4)
I am trying to update some records in MongoDB using Node js. But I am getting following error : TypeError: bulkop.find(...).updateOne is not a function . Also, bulkop.execute() is not working for me .Can you please check what I am doing wrong…
Abhi
- 29
- 2
0
votes
1 answer
how to perform bulk updation operation in mongodb using node.js
I am trying to update bulk of documents in collection using mongodbwith different values for field. I have unique Id for each document. I need to update bulk of records in single update command. How do we update bulk of documents.
Please suggest the…
mukund shelke
- 429
- 1
- 4
- 12
0
votes
2 answers
Bulk updating in Laravel with specific where condition for each row
I am developing a database-driven website using Laravel. Now I am having a problem with updating database. I want to run bulk update. Normally I run like this.
$data = [
[
'col_1'=>$value1
],
[
…
Wai Yan Hein
- 13,651
- 35
- 180
- 372
0
votes
1 answer
content replacement in S3 files when unique id matched in both the sides by using big data solutions
I am trying to explore on a use case like "we have huge data (50B records) in files and each file has around 50M records and each record has a unique identifier. And it is possible that a record that present in file 10 can also present in file 100…
Krish
- 135
- 1
- 3
- 11
0
votes
1 answer
Bulk clear ManyToMany after object traversal
I have the following data models:
class ArticleSet(Model):
pass
class Article(Model):
article_set = ForeignKey(ArticleSet, related_name = 'articles')
attachments = ManyToManyField(Attachment, related_name='articles')
Now I have an…
physicalattraction
- 6,485
- 10
- 63
- 122
0
votes
2 answers
Oracle BEST PRACTICE to update 50 million child rows in a table using value from parent table
I have a child table with 100 million rows and need to update 50 million rows of a column using the value from the parent table. I have read around that assuming if we have enough space, it would be the fastest to "create table as select", but I…
user3224907
- 758
- 2
- 15
- 40
0
votes
1 answer
mysql bulk update performance when `WHERE` filter is not satisfied
bulk update like this:
update table_name set price='x1' where sku='x1'; #updated because sku=x1 exist
update table_name set price='x2' where sku='x2'; #ignored because sku=x2 does not exist
update table_name set price='x3' where sku='x3'; #ignored…
Mil0R3
- 3,876
- 4
- 33
- 61
0
votes
2 answers
Data upsert issue using BulkWriteOperation in Java
I am trying to upsert millions of data using BulkWriteOperation, but my code is giving exception when my query condition is not satisfying but a document is available with that id.
Here is my code :-
if(provisionSubscriberList.size()>0){
…
Devendra Singh
- 640
- 6
- 12
0
votes
1 answer
csv file with delimiter other than comma in php
I insert data into table as bulk upload,
$handle = fopen($_FILES['file_clg']['tmp_name'], "r");
fgetcsv($handle);
while (($data = fgetcsv($handle, 1000, ",")) !== FALSE) {
$collegename =…
Renjitha22
- 213
- 1
- 7
- 22
0
votes
2 answers
How to update a bulk of data in Oracle db by not bypassing any trigger?
We are running a pretty uncommon erp-system of a small it-business which doesn't allow us to modify data in an extensive way. We thought about doing a data update by exporting the data we wanted to change directly from the db and by using Excel VBA…
matt
- 65
- 10