Stack Overflow
Stack Overflow

Questions tagged [external-tables]

To be used for External tables. These tables don't necessarily have data in the data warehouse(or database directory).

Hive

An EXTERNAL table points to any HDFS location for its storage, rather than being stored in a folder specified by the configuration property hive.metastore.warehouse.dir(Location of default database for the warehouse). See also official Hive docs on Managed vs External Tables

Oracle

External tables allow Oracle to query data that is stored outside the database in flat files. The ORACLE_LOADER driver can be used to access any data stored in any format that can be loaded by SQL*Loader. No DML can be performed on external tables but they can be used for query, join and sort operations.

381 questions
3
votes
2 answers

How to a Drop Poly Base external table if exists?

I have loaded the File data from Azure blob storage to Azure SQL DW external table through poly-base. Now the File present in Blob container has been updated. Now I want to load the fresh data. Can any one suggest how the fresh data can be loaded to…
ravi kiran
  • 371
  • 1
  • 5
  • 17
3
votes
2 answers

In Spark, does CREATE TABLE command create an external table?

Based on the following thread in GitHub (https://github.com/databricks/spark-csv/issues/45) I understand that CREATE TABLE + Options (like JDBC), will create a Hive external table?. These type of tables don't materialize themselves and hence no data…
jmdev
  • 729
  • 1
  • 6
  • 13
3
votes
1 answer

External table limitations

Now i am working on external tables... While i do like its flexibility. I would like to know these things about external table - Like in SQL Loader we can append data to the table . Can we do that in External table ? In external table , we cannot…
divya.trehan573
  • 454
  • 1
  • 12
  • 28
3
votes
1 answer

Unable to create EXTERNAL TABLE to Azure SQL Server on Azure SQL Data Warehouse

Unable to create EXTERNAL TABLE at Azure SQL Data Warehouse pointing to Azure SQL Server. CREATE EXTERNAL DATA SOURCE EX_SOURCE WITH ( TYPE = RDBMS, LOCATION = 'SERVER.database.windows.net', DATABASE_NAME = 'DB_NAME', CREDENTIAL =…
Sandris Višķers
  • 86
  • 6
3
votes
1 answer

how to use "like" command in below query

I am importing text file through SQL*Loader into an Oracle table but i don't want to give the specific name of the file, I want to import only the .txt file extensions file. look the below code : create or replace PROCEDURE EXT_TABLE AS A1 NUMBER…
y2j
  • 207
  • 3
  • 5
  • 13
2
votes
1 answer

Oracle External Tables Date Error

I get the following errors while loading data into Oracle 11g R2 with EXTERNAL TABLES. error processing column DATE_M in row 1 for datafile C:\app\S\admin\orcl\dpdump\TABLE_EXT.txt ORA-01847: day of month must be between 1 and last day of…
bonsvr
  • 2,262
  • 5
  • 22
  • 33
2
votes
2 answers

Can DBT directly connect to Google sheets?

we currently have a DBT instance that sits over our Google BigQuery data warehouse. Now we've recently been asked to incorporate some data from Google Sheets into our modelling. With that, is it possible for DBT to connect directly with Google…
dlsupaolo11
  • 23
  • 3
2
votes
0 answers

External table from existing data with additional column

This is my first question ever so thanks in advance for answering me. I want to create an external table by Spark in Azure Databricks. I've the data in my ADLS already that are automatically extracted from different sources every day. The folder…
intruderr
  • 355
  • 1
  • 7
2
votes
1 answer

Snowflake ingestion: Snowpipe/Stream/Tasks or External Tables/Stream/Tasks

For ingesting data from an external storage location into Snowflake when de-duping is necessary, I came across two ways: Option 1: Create a Snowpipe for the storage location (Azure container or S3 bucket) which is automatically triggered by event…
Yasaman
  • 53
  • 4
2
votes
1 answer

Retrieve filename while using external table

I'm trying to retrieve filename while doing a select from an external table using Synapse Analytics. I didn't find any way but I was thinking that in the REJECT_ROW_LOCATION ( when some rows are rejected) the file created contains the name of the…
MrCaptain Alex
  • 169
  • 1
  • 13
2
votes
2 answers

External table read issue on 19c

we are migrating DB from Oracle 11g -> 19 and facing issue with external table. Old and new db have exactly same table definition and pointing to the same file (db running on different hosts but pointing same qtree). Old DB can query file without…
FFF
  • 25
  • 6
2
votes
0 answers

How to insert data into table which is having new line character in SQL?

Hi I am creating external table which is loading data from S3 Bucket file. But for some column I am getting CRLF due to which data is going to another row and not loading perfectly. Could you please help me how can I resolve this? Example: Draft…
shivam
  • 75
  • 1
  • 3
  • 11
2
votes
2 answers

How to delete an external table in Hive when the hdfs path has been deleted?

I've removed my HDFS path /user/abc, and some Hive tables were stored in /user/abc/data/abc.db , with a rm -R command. Despite having my regular tables correctly deleted with Hive SQL, my external tables didn't drop, with the following error: [Code:…
Eve
  • 59
  • 1
  • 10
2
votes
1 answer

Hive 3.1 cannot create external table that copy schema from internal/managed table

we try to make an external hive table which its schema is similar from existing internal/managed table and the data for ecternal will be inserted next step. Below the code to create external table with copy schema of managed table CREATE EXTERNAL…
m hanif f
  • 406
  • 1
  • 7
  • 20
2
votes
1 answer

External table not refreshing data Snowflake

Say that I have an external table in Hive and the csv file in the external table's S3 location looks like below. +----+------+ | ID | Name | +----+------+ | 1 | A | | 2 | B | +----+------+ If I change the data in the file like below, I am…
Sarath Subramanian
  • 20,027
  • 11
  • 82
  • 86
1 2
3
…
25 26