Stack Overflow
Stack Overflow

Questions tagged [bulk-import]

38 questions
5
votes
2 answers

Import text file to SQL Server using Bulk Insert

This is my sql BULK INSERT dbo.Account FROM 'G:\Import\Account3.txt' WITH ( FIELDTERMINATOR = '" | "' ) GO When I run the sql i got this error Msg 4866, Level 16, State 1, Line 1 The bulk load failed. The column is too long in the data file…
riza
  • 51
  • 1
  • 1
  • 4
2
votes
1 answer

How to Bulk Import data from file into Netezza DB?

I want to bulk import data from a file present on my local into the Netezza Database using NZSQL language. I tried with below query but, I am not able to do it. create external table ext_tab ( login_email VARCHAR(10),identifier int,first_name…
sujay777
  • 41
  • 5
2
votes
0 answers

Trouble with importing CSV into SQL Server using BULK IMPORT when the CSV has formatting errors

I am trying to import a .CSV file into my SQL Server database. This is the script I am using: BULK INSERT FROM '/data.txt' WITH ( FIRSTROW = 2, FORMAT='CSV', ERRORFILE = '/RowErrors.txt', MAXERRORS = 100 ) The trouble is my CSV…
DrkStr
  • 1,752
  • 5
  • 38
  • 90
2
votes
1 answer

SQL Server Bulk Insert - How to define missing fields?

I'm sure this is a common problem, but I just can't seem to find exactly the help I'm looking for. Apologies! I'm trying to perform a bulk insert from a CSV file—the table I need to insert the data into has a few fields that cannot be null—like a…
Joshua
  • 107
  • 1
  • 4
  • 12
2
votes
1 answer

BCP data import, invalid time format error

I have failed to load a text file's data to my db's table with the persistent error invalid time format. I have changed the time format to include a T between the date and time, to no avail. I also substituted the year, month, date delimiter from .…
ssn
  • 439
  • 5
  • 14
2
votes
1 answer

bulk import of xml data in to sql server

I have a set of xml files that I want to parse the data of and import in to a sql server 2012 database. The provided xml files will be validated against a schema. I am looking as to what is the best method of doing this is. I have found this:…
amateur
  • 43,371
  • 65
  • 192
  • 320
1
vote
0 answers

MySqlBulkLoader error importing pipe delimited file

I am using MySqlBulkLoader to import a pipe delimited file, with over 250K rows, to a MySQL database table using a vb.net application. This will be a daily task so I am trying to get this as automated and fast as possible. I have no control over the…
JPC
  • 33
  • 4
1
vote
1 answer

How to Bulk import with validations and create versions using paper_trail?

I am having an array of hashes(around 20k) that I need to import but with validations and have to create the versions as well using paper_trail. arr = [{some_1_id: '1', some_2_id: '2', some_3_id: '3', amount: '123'}, {some_1_id: '1', some_2_id: '2',…
Mohd Anas
  • 634
  • 1
  • 9
  • 22
1
vote
2 answers

Bulk import/update of data into database

I have a large XML document (~10 mb) that contains data. I need to parse this XML and go through my database to update it. There are 3 cases: New data is present in the XML since last time - insert it into the DB An item has changed - update it in…
Paul J
  • 777
  • 2
  • 8
  • 18
1
vote
1 answer

WSO2 API Manager, is it possible to import bulk users without the password expiring after 24 hours?

I imported bulk users in WSO2 API manager, but all the users' passwords expired in 24 hours. I had to systematically change each and every user's password a couple days later. How can I avoid this? Is there a way to change the expiration time?
Lilp
  • 11
  • 4
1
vote
2 answers

Importing non-existing rows using BCP/BULK IMPORT (SQL Server)

I'm attempting to load files into a SQL Server database. I have familiarity with using bulk import and generating format files using BCP to reorganize columns. However, I'm attempting to do 2 new things that I've never tried before. I've been given…
Philippe Haussmann
  • 528
  • 4
  • 11
1
vote
1 answer

Connection Error while bulk insert in elasticsearch in python

I have written the code to import json to elasticsearch, but I have got Connection Error as 'Connection aborted.', error(104, 'Connection reset by peer' The code is from pyelasticsearch import ElasticSearch import sys, json ES_CLUSTER =…
Sai Sri Krishna Kotha
  • 113
  • 2
  • 12
1
vote
1 answer

My values in money column are changed when bulk insert is used

I have a table where I store amount in money. When I used to insert these values from my that table to another table; values changes. In my first table value of a column 'PRICE' is 130 but when bulk insert was used, it was inserted as 129.60 in…
Sarbjit Singh
  • 47
  • 9
1
vote
1 answer

Bulk Import CSV into Cassandra 2.0.3

I want to bulk upload CSV into cassandra 2.0.3. Right now I have successfuly converted the CSV into sstables. However when I run the sstableloader , there is an error message as below. Is this error affecting my bulkload as I do not find the…
user2081818
  • 309
  • 2
  • 10
0
votes
0 answers

Error Handling when using Redis Bulk Import

I'm using redis-cli to do some bulk importing 800mil keys transfer. When I use it if some command was not able to execute for some reason how do I know which command failed the output won't say which command failed so that I can retry etc. Any…
Sheldom
  • 21
  • 1
  • 4
1
2 3