Questions tagged [external-tables]

To be used for External tables. These tables don't necessarily have data in the data warehouse(or database directory).

Hive

An EXTERNAL table points to any HDFS location for its storage, rather than being stored in a folder specified by the configuration property hive.metastore.warehouse.dir(Location of default database for the warehouse). See also official Hive docs on Managed vs External Tables

Oracle

External tables allow Oracle to query data that is stored outside the database in flat files. The ORACLE_LOADER driver can be used to access any data stored in any format that can be loaded by SQL*Loader. No DML can be performed on external tables but they can be used for query, join and sort operations.

381 questions
0
votes
1 answer

How to handle bad files generated by external tables

I've always developed shell scripts on server Unix where the script before runs the SQL-Loader for loading the file to be inserted into an Oracle table and after verifies if it's been generated any BAD file and in that case for example it sends an…
Mark
  • 9
  • 5
0
votes
1 answer

External tables - Cross Database queries - Creating Database Scoped Credential

We are using SQL Server 2012 on AZURE. I would like to use queries from different databases; As azure does not allow us to query from different databases, I decided to create an external table. However, when I try to create CREATE DATABASE SCOPED…
Justin
  • 321
  • 1
  • 5
  • 19
0
votes
2 answers

Creating file for inserted records in the database

I have a PLSQL application, in so some part of the application I need to store the data in the database table (AUDIT_LOG) from external table (EXT_TAB_AUDIT_LOG) when entry in the external table matches some regexp. The issue is that I want to…
0
votes
0 answers

Issue with the usage of external tables

I have a PLSQL ABC(example name) application that uses external table. A brief overview of the application is as follows. The application uses a log pool on the unix server, a file(containing some records) is placed by another application in the log…
0
votes
2 answers

Snowflake External Table creation returns invalid property 'auto_refresh' for 'different storage type from cloud provider'

I'm receiving this error invalid property 'auto_refresh' for 'different storage type from cloud provider' when creating an external table after following the guidelines in this snowflake doc Refreshing External Tables Automatically for Azure Blob…
0
votes
0 answers

Oracle External tables and CSV KUP-04035

I'm facing an error trying to import a CSV file in a Oracle external table. I search for this issue but I do not find a solution that fit my case. I'm iporting a CSV file with filed delimiter and no fields name row. The create table ... end…
AlexMI
  • 824
  • 1
  • 15
  • 36
0
votes
1 answer

Azure SQL DB external table throws the error after adding column at the end of csv

I need help in following- Old CSV file has 3 columns- id, fname, lname New CSV file has 4 columns- id, fname, lname, dob I have u updated the external schema as below- CREATE EXTERNAL TABLE [dbo].[employee] ( [id] [int] NOT NULL, [fname]…
0
votes
1 answer

create Azure DATABASE SCOPED CREDENTIAL

I am trying to create external table. During creation had issue with scoped credential. Is it possible to create Azure DATABASE SCOPED CREDENTIAL with Active Directory service account? CREATE DATABASE SCOPED CREDENTIAL [cred] WITH IDENTITY = 'Azure…
0
votes
0 answers

Granting SELECT permission on table still does not apply

I have created an external table on my db with ADMIN user. CREATE EXTERNAL TABLE ext.mytable (...) WITH (DATA_SOURCE = [DB in another server],SCHEMA_NAME = N'dbo',OBJECT_NAME = N'otherTable') My external tables are in schema ext. Only administrator…
Simone
  • 2,304
  • 6
  • 30
  • 79
0
votes
2 answers

what possible ways to include external tables in TYPO3

Since TYPO3 uses doctrine it is possible to use tables from multiple databases in one instance (with some restrictions like no joins). But what is possible at all? At the moment I need two external tables for an extension and instead of using them…
Bernd Wilke πφ
  • 10,390
  • 1
  • 19
  • 38
0
votes
0 answers

How to upload CSV data to Oracle database, when your Oracle image runs in docker when mistakes Oracle are: 29913, 29400?

I have issue with uploading files to my database through an external table: I can create, read, drop directories, tables by anton_gridushko user, but have no idea why I have troubles when I try to load data to created table. I used this tutorial…
Anton84
  • 1
  • 1
0
votes
1 answer

redshift partition external table by part of a string

I haven't seen an answer after days of searching - so here goes I have an Athena database with a table foo. Adding it to Redshift I use this command: create external schema athena_schema from data catalog database 'my-catalog-db' iam_role…
J Anderson
  • 31
  • 1
  • 9
0
votes
1 answer

Snowflake S3 Stage/External table and S3 versioning duplicates

I want to use AWS S3 as external storage and use Snowflake external tables to query the data. To not lose/overwrite any data, I have enabled versioning on the S3 bucket. When multiple versions of a file exists, they will show as duplicates in…
0
votes
1 answer

Retrieve "filename" from gcp storage during dbt-external-tables sideload?

I have a simple 9 column report that I'm sideloading into bigquery via the dbt-external-tables module. version: 2 sources: - name: my_schema database: my_project loader: gcloud storage tables: - name: my_table_raw …
sgdata
  • 2,543
  • 1
  • 19
  • 44
0
votes
1 answer

file not found in directory Oracle

I am trying to perform the following task: create TABLE tpch10.ext_part ( p_partkey NUMBER(10, 0), p_name VARCHAR2(55), p_mfgr CHAR(25), p_brand CHAR(10), p_type VARCHAR2(25), p_size …
Maltem
  • 29
  • 8