Questions tagged [external-tables]

To be used for External tables. These tables don't necessarily have data in the data warehouse(or database directory).

Hive

An EXTERNAL table points to any HDFS location for its storage, rather than being stored in a folder specified by the configuration property hive.metastore.warehouse.dir(Location of default database for the warehouse). See also official Hive docs on Managed vs External Tables

Oracle

External tables allow Oracle to query data that is stored outside the database in flat files. The ORACLE_LOADER driver can be used to access any data stored in any format that can be loaded by SQL*Loader. No DML can be performed on external tables but they can be used for query, join and sort operations.

381 questions
0
votes
1 answer

External table throwing error (sometimes)

I had created an external table in Oracle 11g. It throws the error of file not found sometimes. The file is present in the oracle external table directory with all the permissions provided to the folder/file. The thing that is odd is that the error…
Chakraborty
  • 123
  • 1
  • 2
  • 8
0
votes
2 answers

Choosing few columns in external table

I have a scenario wherein, I have a file(resides in ADLS) which contains 30 columns , but when i am creating external table.. i wanted to pick only 5 columns. My question is : is it possible to selectively choose the columns while creating external…
ravibhat
  • 811
  • 1
  • 7
  • 19
0
votes
1 answer

create a remote external tables

I have the following infrastructure: Local machine with Windows OS, named A, with Oracle 12c installed. Remote machine with Windows OS, named B, mapped into machine A. I am trying to create an external table on B, "AS SELECT" from an internal table…
mikcutu
  • 1,013
  • 2
  • 17
  • 34
0
votes
1 answer

Inserting data from .csv file using Oracle's external tables

I want to insert data from .csv file to my table. Can I do it with organization external and oracle_loader or do I need to do something else? SQL> create table teachers_ext ( 2 first_name varchar2(15), 3 last_name…
0
votes
1 answer

external table data error in toad for oracle

I am trying to create an external table in toad but getting the error shown below: Here is my code for the external table, it is executed successfully but when I click on the data tab in toad it gives error as shown in the above screenshot. CREATE…
zain ul abidin
  • 197
  • 2
  • 13
0
votes
1 answer

Hive - partition external table by content of data

I have a bunch of gzipped files in HDFS under directories of the form /home/myuser/salesdata/some_date/ALL/.gz , for instance /home/myuser/salesdata/20180925/ALL/us.gz The data is of the form \t count1,count2,count3 So…
Craig
  • 1,929
  • 5
  • 30
  • 51
0
votes
1 answer

Oracle External Table

Not sure if this is the right place for this question but as I could not found the answer on Oracle or through Google. Can I back up my table (say table A) data from Oracle using external table, and is the right way to do it? The data will be older…
ashim
  • 67
  • 1
  • 2
  • 12
0
votes
1 answer

what's the best practice to create an external hive table based on a csv file on HDFS with 618 columns in header?

This question is different than what I have found on stackoverflow due to the size of data, it is NOT duplicated. We are using Cloudera. I have seen solution for small xlsx files with only handful columns in header, in my case the csv file to be…
Choix
  • 555
  • 1
  • 12
  • 28
0
votes
0 answers

external table preprocessor is not working

--the preprocessor is showing as an error when in sql developer oracle 12G CREATE TABLE WPP_EXT ( ACCOUNT_ID VARCHAR2(50), SER_NUM VARCHAR2(100) ) ORGANIZATION EXTERNAL ( TYPE ORACLE_LOADER default directory EXT_DIR access…
Nick
  • 117
  • 1
  • 9
0
votes
2 answers

Hive Table is MANAGED or EXTERNAL - issue post table type conversion

I have a hive table in XYZ db named ABC. When I run describe formatted XYZ.ABC; from hue, I get the following.. that is Table Type: MANAGED_TABLE Table Parameters: EXTERNAL True So is this actually an external or a managed/internal hive table?
Ani Menon
  • 27,209
  • 16
  • 105
  • 126
0
votes
1 answer

Create external table in Greenplum using parquet file stored in s3

I am trying to create an external table in Greenplum database on an Amazon ec2-cluster. My source file is parquet and stored in s3. My question is: What protocol should I use to read the data from the parquet file? If I use "s3://" with file…
mas
  • 145
  • 8
0
votes
3 answers

Hive external table - Select unmatched record

I have created two Hive external tables (SQL query will work) which points to location where I need to compare two output. I need to compare both tables and select unmatched records. TableA id sdate edate tag S1 20180610 20180611 0 S2…
0
votes
1 answer

Spectrum Same External Table Shows in Multiple Schemas (svv_external_tables)

It's a really simple test actually. I create a couple external schemas and create an external table in one of the schemas and then querying svv_external_tables shows the table exists in ALL schemas!! What am I missing? create external schema…
0
votes
2 answers

Parallel loading of Files/URIs to external table in greenplum

If I specify multiple URIs for LOCATION in CREATE EXTERNAL TABLE in greenplum database, will it load the files in parallel? or does it make no difference loading the whole file versus splitting the files into multiple files and loading them…
Deepak K M
  • 521
  • 1
  • 5
  • 13
0
votes
1 answer

how to load csv in oracle using external table

I want to load csv into oracle using external table. there is 1 column which needs to turn into a separate table using FK. csv NAME,OPCO,CATEGORY,PRE_APPROVED,PRE_APPROVED_REQUESTEREXT_PRE_APPROVED_REQUESTER,EXT_PRE_APPROVED_REQUESTER,Authorized…
shorif2000
  • 2,582
  • 12
  • 65
  • 137