Questions tagged [bulk-load]

To bulk load means to import a data file in a user-specified format into a database table or view.

351 questions
3
votes
2 answers

SQLXMLBulkLoad via VBScript

I'm running the following code: Set objBL = CreateObject("SQLXMLBulkLoad.SQLXMLBulkLoad") objBL.ConnectionString = "provider=SQLOLEDB.1;data source=mySQLServer;database=myDB;uid=SA;pwd=myPword" objBL.ErrorLogFile = "c:\error.log" …
Dexter
  • 795
  • 2
  • 13
  • 27
3
votes
1 answer

How to set schema for janusgraph for batch-loading using python

I am trying to bulk-load data into a janusgraph 0.2 over HBase. I am using gremlinpython library of python. For bulk-loading, I set storage.batch-loading to true, and now have to define the schema for the graph. I found documentation to set schema…
Tushar Aggarwal
  • 827
  • 1
  • 10
  • 26
3
votes
1 answer

Load S3 data into Aurora MySQL instance

I'm trying to load the data in S3 into Aurora MySQL instance. I did it using PySpark and the performance of that is at 4 GB per hour. current_df.write.format('jdbc').options( url=url, driver=jdbc_driver, …
data_addict
  • 816
  • 3
  • 15
  • 32
3
votes
3 answers

Bulk Load Data Conversion Error - Can't Find Answer

For some reason I keep receiving the following error when trying to bulk insert a CSV file into SQL Express: Bulk load data conversion error (type mismatch or invalid character for the specified codepage) for row 2, column 75 (Delta_SM_RR). Msg…
ls101
  • 177
  • 5
  • 17
3
votes
1 answer

IF ELSE Condition inside FORALL Oracle

Can you guys share with how to do IF ELSE Inside a FORALL? This is my current code that working fine. FOR DECLARATION; TYPE t_column1 IS TABLE OF USERS.column1%TYPE; TYPE t_column2 IS TABLE OF USERS.column1%TYPE; arr_column1 …
shukor
  • 33
  • 1
  • 3
3
votes
1 answer

Creating XML Schema for Bulk Load to SQL Server - Child Element Describes Parent

I have an XML document that I'm working to build a schema for in order to bulk load these documents into a SQL Server table. The XML I'm focusing on looks like this: BI BI
B. Hanson
  • 31
  • 1
3
votes
2 answers

why hbase KeyValueSortReducer need to sort all KeyValue

I am learning Phoenix CSV Bulk Load recently and I found that the source code of org.apache.phoenix.mapreduce.CsvToKeyValueReducer will cause OOM ( java heap out of memory ) when columns are large in one row (In my case, 44 columns in one row and…
CrazyPig
  • 137
  • 12
3
votes
2 answers

Read XML file into SQL Server database

I'm trying to read an XML file into a database table that already exists. The problem is that the XML tags and the database columns don't have the same name although they have the same datatype. Therefore I'd like to "translate" the XML tags into…
Simon.S
  • 107
  • 1
  • 1
  • 9
3
votes
2 answers

MonetDB bulk load with auto increment

I am trying to load csv files into monetdb table(s) with auto increment PK/Id columns using copy into from file.... table has auto increment PK column. table has more columns than incoming csv files. csv file doesnt have Pk/Id column. Is…
Azar
  • 61
  • 6
3
votes
3 answers

sstableloader. The error: could not achieve replication factor 2 (found 1 replicas only), check your keyspace replication settings

I try to use the sstableloader utility for BulkLoad. SStables were created by using the script like https://github.com/yukim/cassandra-bulkload-example/blob/master/src/main/java/bulkload/BulkLoad.java. When I start the sstableload on the node5…
Dimaf
  • 653
  • 1
  • 11
  • 25
3
votes
2 answers

Region splitting in Hbase

How many regions can be served by one region server? Basically i got a hadoop job which is doing bulk load in hbase but looking at hbase master UI , i could see that whole data traffic is moving to single region server.Because of which single region…
Shashi
  • 2,686
  • 7
  • 35
  • 67
3
votes
0 answers

Using SQLXML Bulk Import with complicated schema

I'm trying to figure out how to use SQLXML bulk load for a rather complicated XML schema I have no control over (It's nominally a "standard"). A small example would be:
Matt Sieker
  • 9,349
  • 2
  • 25
  • 43
3
votes
1 answer

Hbase Bulk loading exception (HFile version)

I am loading data into HBase from HDFS. FileOutputFormat.setOutputPath(job, output); HTable table = new HTable(conf, tableName); HFileOutputFormat.configureIncrementalLoad(job, table); ....... LoadIncrementalHFiles loader = new…
3
votes
1 answer

Query WHERE clause with multiple OR read from file

I have a table with details of data transfers. One of the fields is an IP associated with the transfer. I need to develop a query which will get me a subset of the rows in the table matching one of 79 IP's. There are 608 distinct IP's in the…
shaun
  • 560
  • 1
  • 11
  • 29
3
votes
2 answers

What is the difference between Disabling and Re-enabling an index compared to Dropping and Re-creating it?

As the question states, what is the difference between the two in terms of performance, and which is better for what kind of scenarios? Or does these two have the same effect? What would be the pros and cons of each if it applies? From what I…
Avias
  • 354
  • 1
  • 4
  • 14
1 2
3
23 24