Questions tagged [external-tables]

To be used for External tables. These tables don't necessarily have data in the data warehouse(or database directory).

Hive

An EXTERNAL table points to any HDFS location for its storage, rather than being stored in a folder specified by the configuration property hive.metastore.warehouse.dir(Location of default database for the warehouse). See also official Hive docs on Managed vs External Tables

Oracle

External tables allow Oracle to query data that is stored outside the database in flat files. The ORACLE_LOADER driver can be used to access any data stored in any format that can be loaded by SQL*Loader. No DML can be performed on external tables but they can be used for query, join and sort operations.

381 questions
0
votes
0 answers

External table ORA-29913: error in executing ODCIEXTTABLEOPEN callout.Error in opening file

I have setup a simple Oracle external table test. The database we're using is 11g. I have followed the following steps : First I created a directory : create or replace directory INTF_DIR AS '/orabin/hrtst/TEST/' ; This is the external table…
divya.trehan573
  • 454
  • 1
  • 12
  • 28
0
votes
2 answers

Greenplum: Find associated error table of any external table

is there any way to find out the list of all error tables associated with each external table. Actual Requirement: I am using External tables in Greenplum and data coming from source in form of files,data ingestion to Greenplum via external tables.…
0
votes
1 answer

External table from compressed parquet files (e.g., gz.parquet) in Hive/Impala

How do I create an external table from a collection of compressed parquet files (e.g., gz.parquet) in Hive/Impala?
PTDS
  • 217
  • 3
  • 8
0
votes
4 answers

External Table in Hive - Location

The below table returns no data while running a select statement CREATE EXTERNAL TABLE foo ( ) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\073' LINES TERMINATED BY '\n' LOCATION '/user/data/CSV/2016/1/27/*/part-*'; I need my hive to point to a…
0
votes
2 answers

How to recognize new columns from RDBMS to Hive External table?

I have a Hive External table X in HDFS. Files from RDBMS will keep coming to the folder location of the table X. Last week there was a new column added to RDBMS, and the files came into the external table with the new column's data. I know that i…
AKC
  • 953
  • 4
  • 17
  • 46
0
votes
2 answers

How do i resolve error when Hawq complaints for : missing data for column "SoldToAddr2"

We have small cluster of pivotal hadoop-hawq system. we have to read one external table. ie select * from ext_table But when i issued query in Hawq complaints about following error : Error Hawq complaints for : missing data for column "SoldToAddr2"…
NEO
  • 389
  • 8
  • 31
0
votes
0 answers

External table fails when date column has two digit hour

I'm using an External Table in Oracle 11g. I have a date field in the last column of the file. I parse that in into a TIMESTAMP column in my table definition: CREATE TABLE e_tbl_one ( FOPV_KEY INTEGER, FACILITY …
Paul
  • 3,725
  • 12
  • 50
  • 86
0
votes
0 answers

Unacceptable slow hive queries

I am running Hive 0.14 on a HDP2 cluster. My dataset was built using the kite sdk and registered to Hive using external tables. See my table layout below: hive> describe hivetweets; OK created_at bigint from…
dominik
  • 613
  • 2
  • 6
  • 10
0
votes
1 answer

Create an external table in HIVE with multiple sources

I want to create an external table in HIVE which takes input from multiple databases. Eg: I want to create bigTable (A,B,C,D,E,F) with sources coming from db1.table1(A,B) and db2.table2(C,D,E,F,A) Also, the bigTable has to update when db1.table1…
underwood
  • 845
  • 2
  • 11
  • 22
0
votes
0 answers

query regarding using external table concept in plsql

While using external table one BAD file was generated. BAD file(“abc.bad”) has data like “E51″,12345,555333,”anbd”,”kksksk” E51″,12345233,55333,”anbd”,”kksksk” How can I insert above data into table in a single column as varchar. currently the…
y2j
  • 207
  • 3
  • 5
  • 13
0
votes
1 answer

PreProcessor in Oracle External Tables

I seem to be having an issue whenever I add the preprocessor clause into my external tables statement. Without the preprocessor line it all works fine but as soon as I add it I get assorted errors depending on where I put it in the access parameters…
Matt Damon
  • 323
  • 1
  • 6
  • 18
0
votes
1 answer

Closing a file in Oracle External table

I use external table to read a file from a folder in the system. After reading the file,when i try to move the read file to archive,i get FILE IN USE error. Is there a mechanism to close the file or something in external tables.
theDbGuy
  • 903
  • 1
  • 9
  • 22
0
votes
0 answers

external table bad files

I am using external table for ETL. The access driver creates a bad file which contains records which were bad in some way like data type mismatch. However, constraint violations like unique constraint violation are not written to Bad file by access…
user2599052
  • 1,056
  • 3
  • 12
  • 27
0
votes
1 answer

oracle external table iterating files

I'm loading files into Oracle via external table. Files will be dropped into the directory about one per minute. What is the best method to iterate through these files to load? Once loaded, I don't need connection to that file any longer but need…
0
votes
2 answers

how do i read Visual foxpro Database as External table in oracle 10g database?

I have couple of vfp 9.0 .dbc and .dbf files i am trying to setup these tables as external tables, but from information i googled it seems like that oracle only support .CSV files is that even possible I will be…
shinobi92
  • 127
  • 2
  • 16