Questions tagged [external-tables]

To be used for External tables. These tables don't necessarily have data in the data warehouse(or database directory).

Hive

An EXTERNAL table points to any HDFS location for its storage, rather than being stored in a folder specified by the configuration property hive.metastore.warehouse.dir(Location of default database for the warehouse). See also official Hive docs on Managed vs External Tables

Oracle

External tables allow Oracle to query data that is stored outside the database in flat files. The ORACLE_LOADER driver can be used to access any data stored in any format that can be loaded by SQL*Loader. No DML can be performed on external tables but they can be used for query, join and sort operations.

381 questions
0
votes
2 answers

Introduce HDFS folder information into Hive external table

I have an HDFS directory structure like this: /home/date_1/A/file.txt /home/date_1/B/file.txt /home/date_2/A/file.txt /home/date_2/B/file.txt ... I can create an external table CREATE EXTERNAL TABLE table_name(col1 int, col2 string) ROW FORMAT…
C. Luo
  • 45
  • 1
  • 8
0
votes
1 answer

Use the number of characters as delimiter sql

I have this exercise: having this type of text file 10012020/07/057 10022020/07/055 10032020/07/100 10042020/07/079 10052020/07/103 10062020/07/098 10072020/07/104 10082020/07/101 10092020/07/104 10102020/07/063 Insert the records in an external…
0
votes
1 answer

SQL Server Polybase create external table ERROR to Oracle with column datatype TIMESTAMP WITH TIME ZONE

Created database scoped credential and an external datasource to Oracle OK. Creating external table on Orcle table with a column datatype TIMESTAMP WITH TIME ZONE fails no matter what datatype I try to use. CREATE EXTERNAL TABLE…
0
votes
2 answers

Bigquery table with GCS data source does not affect data changed into gcs

I am pretty new in bigquery. I have created bigquery table from gcp console where GCS CSV file is used as data source. I think when i delete any row, that should also be deleted from GCS file. But practically it's not happening.
0
votes
2 answers

How to upload a flat file without using SQL*loader and external table in oracle database?

Can anyone let me know how to upload a flat-file without using SQL*loader or external table in oracle database? Like is there any function available in oracle to complete this task? Please let me know the different ways to upload flat files apart…
Mogit
  • 7
  • 1
0
votes
0 answers

Dynamically Load Multiple CSV files to Oracle External Table

I am trying to load my oracle external table dynamically with multiple .csv files. I am able to load one .csv file but as soon as I alter with new .csv file name, the table gets rewritten. I have multiple .csv files in a folder which changes…
0
votes
1 answer

Select on External table running very very slow on Azure SQL

We have external table created, we need to run select on the table and select all the records, the select runs very very slow. Its not completing even after 30 mins, the table contains around 2millon recs We also need to query this table from…
0
votes
1 answer

Queries performances on ADLS gen 2

I'm trying to migrate our "old school" database (mostly time series) to an Azure Data Lake. So I took a random table (10 years of data, 200m records, 20Gb), copied the data in a single csv file AND also to the same data and created 4000 daily files…
0
votes
0 answers

Reading data from Oracle cloud storage to target database

My application Fusion BICC is dumping data into oracle cloud object storage in the form of csv. I need to upload this data in my target database. so I am uploading data in external table and then comparing data of external table and target table…
0
votes
1 answer

Is there a possibility to create external table in Azure SQL Data Warehouse pointing to only few folders from the specified location?

I have been trying to create an external table in Azure SQL Data Warehouse by considering only some folders instead of all from the azure Datalake location. But I'm not able to do so. Request for help in this regard. Below is the example for this…
0
votes
0 answers

Safe sequences for external tables

Goal: I'm looking for a stable and cheap way to find specific rows in large external tables, specifically for using Snowflake, where the external files can only be read, but not modified (delivered as-is on storage). Pratical example: A large XML…
0
votes
1 answer

How to get all XML file names from a directory using EXTERNAL TABLE

I am trying to get all XML file names present in a directory in order to feed them to a procedure which pulls data out of those files. Could anyone help with how I can get the file name using the EXTERNAL TABLE. I am having trouble with ACCESS…
0
votes
0 answers

Netezza External table trims decimals after 0

I am trying to create an external table file from the netezza database. There is one Numeric column in the table with value 0.00. The external table file generated stores only 0 and truncates the rest of it. However, when on using nzsql from the…
Jenny
  • 355
  • 1
  • 2
  • 10
0
votes
1 answer

Oracle External Table - No Rows Selected

I've created an external table using the following definition CREATE TABLE EXT_TABLE (CID NUMBER, CNAME VARCHAR2(20), FEES NUMBER) ORGANIZATION EXTERNAL ( TYPE ORACLE_LOADER DEFAULT DIRECTORY TEST_DIR ACCESS PARAMETERS (RECORDS DELIMITED BY…
Jey.Guru
  • 1
  • 5
0
votes
2 answers

Sql Server 2019 External Table to SAP HANA ignoring Schema in Location clause

I'm looking for a better way to bring in data from Hana into our Sql Server EDW. Currently we're using OpenQuery but I really want to get to using Sql Server's External Tables functionality because then I can easily push much of the compute…
Rachel Ambler
  • 1,440
  • 12
  • 23