Stack Overflow
Stack Overflow

Questions tagged [external-tables]

To be used for External tables. These tables don't necessarily have data in the data warehouse(or database directory).

Hive

An EXTERNAL table points to any HDFS location for its storage, rather than being stored in a folder specified by the configuration property hive.metastore.warehouse.dir(Location of default database for the warehouse). See also official Hive docs on Managed vs External Tables

Oracle

External tables allow Oracle to query data that is stored outside the database in flat files. The ORACLE_LOADER driver can be used to access any data stored in any format that can be loaded by SQL*Loader. No DML can be performed on external tables but they can be used for query, join and sort operations.

381 questions
0
votes
1 answer

Azure Synapse - Unable to create External table Error 401 Unauthorized

I have a service principal using which I am trying to create an external table for Azure Data lake gen1. The external table creation fails with the error: Error occurred while accessing HDFS: Java exception raised on call to HdfsBridge_IsDirExist.…
user961
  • 453
  • 6
  • 20
0
votes
1 answer

Connecting Azure SQL to local external table Error: A network-related or instance-specific error occurred

In SSMS, from a query window in an Azure SQL database, I'm trying to select data from external tables in a local SQL server. I'm getting the following error: A network-related or instance-specific error occurred while establishing a connection to…
Velocedge
  • 1,222
  • 1
  • 11
  • 35
0
votes
0 answers

Issue with calling Azure stored procedure using external tables from C#

I have a stored procedure in one of my Azure databases that links to external tables from another database. If I run this stored procedure in the DB it runs fine, returning the data I expect. If I call the same stored procedure with the same input…
Alison
  • 1
  • 1
0
votes
2 answers

Create External Table pointing to S3

How do we create an external table using Snowflake sql that points to a directory in S3? Below is the code I tried so far, but didn't work. Any help is highly appreciated. create external table my_table ( column1 varchar(4000), column2…
Sarath Subramanian
  • 20,027
  • 11
  • 82
  • 86
0
votes
2 answers

Column Level Security in Synapse Data Warehouse for External Table

I understand Column level security works on Table in Synapse Data warehouse but I am looking for applying Column level security to External table which references data from Azure Data Lake Gen 1. I am unable to find details relating to External…
Venk AV
  • 67
  • 1
  • 10
0
votes
1 answer

Error using Polybase to load Parquet file: class java.lang.Integer cannot be cast to class parquet.io.api.Binary

I have a snappy.parquet file with a schema like this: { "type": "struct", "fields": [{ "name": "MyTinyInt", "type": "byte", "nullable": true, "metadata": {} } ... …
Tino
  • 63
  • 4
  • 13
0
votes
0 answers

External Hive Table with 0 records

I want to create an external hive table in spark AWS with just the schema and 0 records. Expectation is when i select the external hive table, i should see just the schema with no records.
Tharun Kumar
  • 363
  • 3
  • 5
0
votes
1 answer

Where we can find ddl script of external table in oracle(any system table)

I tried with below code but unable to get the DDL script, SELECT DBMS_METADATA.get_ddl ('TABLE', 'TABLE_NAME', 'OWNER') FROM dual Is there any oracle system table where we can see definition of External table.
CMK
  • 40
  • 2
  • 10
0
votes
2 answers

ad-hoc slowly-changing dimensions materialization from external table of timestamped csvs in a data lake

Question main question How can I ephemerally materialize slowly changing dimension type 2 from from a folder of daily extracts, where each csv is one full extract of a table from from a source system? rationale We're designing ephemeral data…
Anders Swanson
  • 3,637
  • 1
  • 18
  • 43
0
votes
0 answers

Is field mode "REPEATED" not supported for external tables in BigQuery?

Are repeated fields secretly not supported for external tables in BigQuery? The UI validator always displays the error message Unsupported field mode: REPEATED no matter what the query is, even if I'm not trying to select any of the columns with…
J Galt
  • 1
0
votes
1 answer

External Table Help - Problem with FIELDS TERMINATED BY ',' if additional comma exists in a value in the field

I have a comma delimited txt file and I am using an external table to load the data down below: create table test_ext_table CUSTOMER_ID NUMBER, CUSTOMER_NAME VARCHAR2(255), CUSTOMER_NUMBER NUMBER) ORGANIZATION…
tryingToLearn
  • 17
  • 5
0
votes
1 answer

how do we copy external tables from one schema to another schema in same postgresql database

I have two schema's in one database 1) public 2) test In public i have list of external tables like ext_table1,ext_table_2,ext_table_3 How do i copy those tables to test schema from public in the same database?
user8545255
  • 761
  • 3
  • 9
  • 21
0
votes
1 answer

Snowflake External Table Partition - Granular Path

Experts, We have our JSON files stored in the below folder structure in S3 as /appname/lob/2020/07/24/12,/appname/lob/2020/07/24/13,/appname/lob/2020/07/24/14 stage @SFSTG = /appname/lob/ We need to create a external table with partition based on…
gopinath kolanchi
  • 141
  • 2
  • 13
0
votes
0 answers

Snowflake External Table Refresh

Experts, Have a questions on External Table refresh. We are having a external table pointing to the S3 folders and refresh it manually using Alter command. We have process in Nifi which will place a file in S3 folder and another process in talend…
gopinath kolanchi
  • 141
  • 2
  • 13
0
votes
1 answer

Loading a CLOB over 32mb using an external table

I have an external table whose definition looks like this: -- Create table create table EXT_EXTRACT_XMLS ( extract_type VARCHAR2(100), clob_filename VARCHAR2(100), xml_clob CLOB ) organization external ( type ORACLE_LOADER default…
EdG
  • 137
  • 1
  • 10
1 2 3
…
25 26