Stack Overflow
Stack Overflow

Questions tagged [external-tables]

To be used for External tables. These tables don't necessarily have data in the data warehouse(or database directory).

Hive

An EXTERNAL table points to any HDFS location for its storage, rather than being stored in a folder specified by the configuration property hive.metastore.warehouse.dir(Location of default database for the warehouse). See also official Hive docs on Managed vs External Tables

Oracle

External tables allow Oracle to query data that is stored outside the database in flat files. The ORACLE_LOADER driver can be used to access any data stored in any format that can be loaded by SQL*Loader. No DML can be performed on external tables but they can be used for query, join and sort operations.

381 questions
0
votes
1 answer

How to create a external table when date is in between s3 path

I have s3 bucket as below, s3://rawzone/toyoto/2020-11-04/ inside each date I have 4 files s3://rawzone/toyoto/2020-11-04/Company.json s3://rawzone/toyoto/2020-11-04/sales.json s3://rawzone/toyoto/2020-11-04/transport.json …
Xi12
  • 939
  • 2
  • 14
  • 27
0
votes
1 answer

Db2 external table creation with FIXED format

I am trying to create/select an Db2 external table with the FIXED format, but whitout any success. Here is what I have tried: From an IBM pdf (https://www.tridex.org/wp-content/uploads/Db2ExternalTables_Tridex.pdf page 21): db2 "CREATE EXTERNAL…
Steph
  • 47
  • 1
  • 8
0
votes
1 answer

Change column name of an external partitioned parquet table in hive without null/lost data

I have the following table: CREATE EXTERNAL TABLE aggregate_status( m_point VARCHAR(50), territory VARCHAR(50), reading_meter VARCHAR(50), meter_type VARCHAR(500) ) PARTITIONED BY( insert_date VARCHAR(10)) STORED AS PARQUET LOCATION '
jaruro2810
  • 13
  • 4
0
votes
0 answers

Azure synapse External Table - Parameterise location

Is it possible to pass a parameter(date) to the location of the Azure Synapse External Table? LOCATION='/Windows/Folder/File_name_yyyy-MM-dd.csv' I want to parameterise yyyy-MM-dd and File_name_yyyy-MM-dd.csv as a parameter which changes every day.…
Vivek KB
  • 49
  • 6
0
votes
1 answer

How to get schema while dynamically creating external table in synapse serverless sql

I want schema through get metadata activity so it can be passed as an output to stored procedure
sakshi agarwal
  • 1
0
votes
1 answer

Preprocessor on Oracle external table, batch seems not executed. What is missing?

On a Windows server 2016, we have an Oracle Database 12c Standard Edition Release 12.2.0.1.0 - 64bit Production running. The goal is to have an external table created with a "preprocessor" command, triggering a batch file that will retrieve file…
Sunchaser
  • 11
  • 3
0
votes
1 answer

Blob container doesn't allow the creation / reading of an external table. Is there any way to trace the exact problem?

About a month ago, all the external tables built upon parquet files(ADLS Gen2, Synapse) stopped working with the following error message: Unexpected error encountered checking whether directory exists or not: AbfsRestOperationException: Operation…
Raul
  • 1
  • 3
0
votes
1 answer

Kusto external table displays 2001-01-01 00:00:00.0000000 for cell that has value 01/01/0001 00:00:00

This is the value of the column in the csv: 01/01/0001 00:00:00 The external table value for this column is: 2001-01-01 00:00:00.0000000 Column is defined in the kql as: lastModifiedDate: datetime. Any reason why this is happening and how to resolve…
boa_hancock
  • 11
  • 2
0
votes
1 answer

How do I put a csv into an external table in SNowflake?

I have a staged file and I am trying to query the first line/row of it because it contains the column headers of the file. Is there a way I can create an external table using this file so that I can query the first line? I am able to query the…
user18466310
  • 51
  • 7
0
votes
3 answers

External table Always insert in a new file, is there any way to write to same file?

I have a external table in SQL Server which points to CSV files in folder of Azure blob storage, I enabled polybase export and trying to insert data using insert query. It works but it always creates new file. Is there any way I can write to single…
Jigar Jadav
  • 51
  • 6
0
votes
0 answers

org.apache.hadoop.io.nativeio.NativeIO$POSIX.stat(Ljava/lang/String;)Lorg/apache/hadoop/io/nativeio/NativeIO$POSIX$Stat

package Product import org.apache.spark.sql.{SparkSession} import org.apache.spark.sql.types.{IntegerType, StringType, StructField, StructType, TimestampType} object ProductUser { def main(args: Array[String]) { val spark =…
Karthika V
  • 9
  • 1
0
votes
1 answer

External Table I created pulls partial characters from string column and adds numbers to integer column

CREATE TABLE SKILL_LEVEL_DIM_X ( SKILL_LEVEL_ID INTEGER ,SKILL_LEVEL_NAME VARCHAR(50) ,SKILL_LEVEL_DESCRIPTION VARCHAR(500) -- ,CRE_DTTM DATE NOT NULL DEFAULT SYSDATE -- ,UPD_DTTM DATE NOT NULL DEFAULT SYSDATE ) ORGANIZATION EXTERNAL…
ddaya11
  • 3
  • 1
0
votes
0 answers

Unable to create hive external table in apache spark in Intellij

This the command I written for creating external table in Intellij val ex_table= spark.sql("Create EXTERNAL TABLE IF NOT EXISTS userdf.ex_table(Id Int,Name String,Time Timestamp) PARTITIONED BY(Location String) STORED AS PARQUET LOCATION…
Karthika V
  • 9
  • 1
0
votes
1 answer

Can same topic be configured to multiple s3 buckets?

I am trying to refresh external table using SNS in snowflake. I have followed this tutorial to refresh. https://www.youtube.com/watch?v=PCNa3d6rMO0 it is working as expected.but when I use same topic to trigger another table in another S3 bucket.…
Xi12
  • 939
  • 2
  • 14
  • 27
0
votes
2 answers

How to read csv file and return external table query in python?

I am trying to read csv file and create a external table query by the dataframe. Please help me how can achieve my goal? Example: Sppose I have df like this- df = pd.DataFrame({'A': [1,2,3], 'B': [True, False, False], 'C': ['a', 'b',…
Shivika
  • 209
  • 3
  • 15
1 2 3
…
25 26