Stack Overflow
Stack Overflow

Questions tagged [external-tables]

To be used for External tables. These tables don't necessarily have data in the data warehouse(or database directory).

Hive

An EXTERNAL table points to any HDFS location for its storage, rather than being stored in a folder specified by the configuration property hive.metastore.warehouse.dir(Location of default database for the warehouse). See also official Hive docs on Managed vs External Tables

Oracle

External tables allow Oracle to query data that is stored outside the database in flat files. The ORACLE_LOADER driver can be used to access any data stored in any format that can be loaded by SQL*Loader. No DML can be performed on external tables but they can be used for query, join and sort operations.

381 questions
0
votes
1 answer

What are Azure Data Explorer external table partitions good for?

Adding pertition to the external table definition does not help with a query on the partition. Blob path example /data/1234/2021/12/02/9483D.parquet /data/1235/2021/12/02/12345.parquet Partition (pseudo syntax not the real one) :…
user998888
  • 11
  • 3
0
votes
1 answer

ADF Unable to connect to Synapse Link SQL Pool External Tables

I am trying to create an ADF Linked Service connection to a Synapse Link Serverless SQL Pool connected to ADSL Storage. I can successfully get a connection but when I try and use a dataset to access the data I get a permission issue. I can…
Richard H
  • 67
  • 9
0
votes
1 answer

How can I create external tables with Hive?

This is the script I run on Hive: CREATE EXTERNAL TABLE 'people'( 'name' string, 'surname' string, 'age' string) ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.avro.AvroSerDe' STORED AS INPUTFORMAT …
Riccardo Lamera
  • 105
  • 1
  • 13
0
votes
0 answers

How to update existing hive external table partition

I have hive external table, partitioned with year , month , day, hour. Now want to remove hourly partition, and have only year, month, day partitions, what is the best way to do it?
manjuchowdary20
  • 1
  • 1
0
votes
1 answer

External Table on file without terninator

let's suppose I have a file like this: 101010AAAABBB where I don't have a symbol for separating the different fields and I want to load it into an external table In the definition of my external table I would usually put access parameters (records…
Mark
  • 9
  • 5
0
votes
1 answer

DBeaver dont show meta data of external table

I have external tables (spectrum in S3). I can query them without any problem but when im trying to expand my table columns im getting this error: Does someone knows how can I fix it and show the external table meta data?
Alan Mil
  • 189
  • 1
  • 2
  • 9
0
votes
1 answer

Hive External table returning inconsistent results on EMR

I am facing an issue. In my case this behavior is random. After loading an hive external table and running msck repair successfully (Job 1) we have a subsequent spark job which pulls the data from these tables and loads to some other table (Job2).…
Roy
  • 1
  • 1
0
votes
1 answer

How to modify the source file path of a BigQuery external table in Airflow?

There is a process which exports some CSV files to GCS and puts the current datetime into the path,…
elaspog
  • 1,635
  • 3
  • 21
  • 51
0
votes
1 answer

How to load correct data in redshift spectrum table?

I am trying to load data from s3 bucket to spectrum table but data is not showing correct. Could you please help me to resolve the below issue. Example: website is one column where data is - www.calidadhh.com/\ but while loading into table it is…
Shivika
  • 209
  • 3
  • 15
0
votes
1 answer

Azure Synapse Polybase/External Tables - Can we get the line numbers from a file while we create an external table

I'm trying to get the line numbers from a file while reading and loading it to a table using Polybase in Azure Synapse. For example, say the file(csv) has 3 columns, I need to load the target table which has 4 (3 from from the file and a column to…
Vikram Reddy
  • 3
  • 2
0
votes
1 answer

In SQL External table take a time for select and insert data into temp table

I am using external table of main database to Datawarehouse database. While selecting data from external table to # table it take almost 9 min, sometime it take more time. How I can improve this performance of external table?
S. Deshmukh
  • 314
  • 4
  • 19
0
votes
1 answer

Oracle External Table RECORDS DELIMITED BY '",\n"' not working, how can I delimit by a character and newline in the same time?

I am trying to read large CSV files with lots of Newline characters in them. this is how the data looks like in the CSV file. "LastValueInRow", "FirstValueInNextRow", I would like to use " + , + NEWLINE + " as records delimiter…
Mario Douh
  • 49
  • 6
0
votes
1 answer

Dynamically building DBMS_CLOUD.CREATE_EXTERNAL_TABLE, Execute Immediate doesn't work

I'm facing an issue when I'm trying to build a table dynamically using DBMS_CLOUD.CREATE_EXTERNAL_TABLE inside a stored procedure or packaged program. A dbms_ouput.put_line of the dynamic code will produce the correct code which i can copy and run…
B-Rad
  • 25
  • 6
0
votes
1 answer

Location and filename of most recent BADFILE when using external tables

Is there a way to detemine location/filename of latest BADFILE? When I select from enternal table with BADFILE 'mytable_%a_%p.bad', how do I find out what specific values were %a and %p replaced with? Or am I stuck with having mytable.bad which I…
zwei
  • 57
  • 1
  • 1
  • 4
0
votes
1 answer

it's possible do Row Level Security for Polybase external table in SQL Server 2019?

I need to enable row-level security on an external table pointing to Oracle in SQL Server 2019. I have only been able to find that it is possible to do it with external tables in Azure Synapse. Is there any mechanism or alternative like the use of…
Leandro
  • 3
  • 1
1 2 3
…
25 26