Stack Overflow
Stack Overflow

Questions tagged [bulk-load]

To bulk load means to import a data file in a user-specified format into a database table or view.

351 questions
0
votes
1 answer

Error during bulk load in SQL Server 2016

I am trying to use bulk insert for a .txt file, which is separated using a comma, but a few columns also have a double quotes, because of which when bulk insert is used, some rows are not inserted properly. I am using bulk insert with fmt file but…
NancyJoe
  • 41
  • 1
  • 2
  • 5
0
votes
0 answers

how to generate hfiles then bulk load into hbase with spark?

everyone,I have tried varieties of methods to achieve hbase bulkload with spark. such as opencore,scala load,however,they can work on local master with spark,not yarn.my codes follow. Dataset sqlDF = spark.sql(sql); JavaRDD rowJavaRDD =…
Yanjing Wang
  • 46
  • 7
0
votes
0 answers

Hdfs load Hbase Utility

I have tried the following command to load the data from hdfs to hbase table. The job is loading the data into hbase table but not into the respective columns (meaning value of col1 is loaded into col2, value of col2 is loaded into col5 and so on).…
Adithya Sajjanam
  • 53
  • 1
  • 7
0
votes
1 answer

HBASE Bulk load replication

We have a HBase based system where we would like to bulk load a few million rows on a daily basis in production. We think that HBase Bulk Load will be a good option compared to puts - the bulk load feature uses a MapReduce job to output table data…
Akshay Gehi
  • 362
  • 1
  • 12
0
votes
0 answers

Bulk export of data from multiple table from mysql database

I need to export 100's of rows from different table in to a csv file. I have tried by exporting it but am getting memory limit exceeds error. Also I have Changed the limit in ini file but i couldn't proceed further. Please post the solution if…
Vidhya Bala
  • 1
  • 1
0
votes
0 answers

Postgres: truncate / load causes basic queries to take seconds

I have a Postgres table that on a nightly basis gets truncated, and then reloaded in a bulk insert (a million or so records). This table is behaving very strangely: basic queries such as "SELECT * from mytable LIMIT 10" are taking 40+ seconds.…
Alex Weinstein
  • 9,823
  • 9
  • 42
  • 59
0
votes
1 answer

Can I do cell merging in hbase?

Suppose that I have a column that is updated incrementally other than overwriting (like a bitwise-ored integer flag or a sum column). For example (assuming only 1 version): Existing Cell: [key: 'k1', f1:sum: 100] Upcomming New Cell: [key: 'k1',…
user1206899
  • 1,564
  • 1
  • 11
  • 15
0
votes
0 answers

How to handle more than a thousand images in the ListView of winforms?

Hello StackOverFlow Community, I am trying to load more than a thousand images in my listview but Im getting the OutOfMemoryException. I want to be able to load the images as the user scroll down like a lazy loading experience. how can I achieve…
nickaldri
  • 1
0
votes
0 answers

LoadIncrementalHFiles increases used memory and fails after a while

I wrote about 300 directories containing HFiles into my HDFS (with a Spark application). They are saved to HDFS like…
D. Müller
  • 3,336
  • 4
  • 36
  • 84
0
votes
1 answer

Bulk loading with LoadIncrementalHFiles and subdirectories

I wrote a Spark application that generates HFiles to be used for bulk loading with the LoadIncrementalHFiles command later. As the source data pool is very big, the input files are splitted into iterations that are processed one after the other.…
D. Müller
  • 3,336
  • 4
  • 36
  • 84
0
votes
1 answer

Apex Batch class for the array for records from Inbound REST Service

I have to upsert around 80 K records on daily nightly batch. I was thinking of using the REST service to get the records in an array, and create a batch apex to upsert them in Salesforce. I will not be getting the CSV and is out of question. Will I…
Sachin
  • 1
0
votes
0 answers

.Net SqlClient BULK INSERT hanging

We are using .Net SqlClient to bulk insert data from a remote server to our SQL Server. Somedays our ETL fails so we are trying to figure out the reason for that. What we can notice is that a bulk insert, let's call it BI1 is hanging for too long…
Vincent Teyssier
  • 2,146
  • 5
  • 25
  • 62
0
votes
1 answer

TSQL insert into table with bulkcolumn -- needing two bulkcolumn inserts into same row

TSQL insert into table with bulkcolumn -- needing two bulkcolumn inserts into same row I need to run a query with two bulkcolumn inserts into the same row. I am trying: However, I get the error: Invalid object name 'BulkColumn' Is this just a…
JosephDoggie
  • 1,514
  • 4
  • 27
  • 57
0
votes
1 answer

PL/SQL Switching two columns from two tables

Suppose I have two tables (tblA and tblB) and want to switch the second column of each table (tblA.Grade and tblB.Grade) as shown: +-------------------------------------+ | table a table b …
N Din
  • 40
  • 5
0
votes
2 answers

Bulk import in NEO4j

Data (snippet) in node file: C0243192 C1522005 C1524024 C1524059 C1623416 C1959616....... Header file for Node file: conceptID:ID Relationship(snippet) file date: C0000039,C0001555,AQ_ C0000039,C0001688,AQ_ C0000039,C0002776,AQ_ ..... Header…
gaurav1207
  • 693
  • 2
  • 11
  • 26
1 2 3
…
23 24