Questions tagged [external-tables]

To be used for External tables. These tables don't necessarily have data in the data warehouse(or database directory).

Hive

An EXTERNAL table points to any HDFS location for its storage, rather than being stored in a folder specified by the configuration property hive.metastore.warehouse.dir(Location of default database for the warehouse). See also official Hive docs on Managed vs External Tables

Oracle

External tables allow Oracle to query data that is stored outside the database in flat files. The ORACLE_LOADER driver can be used to access any data stored in any format that can be loaded by SQL*Loader. No DML can be performed on external tables but they can be used for query, join and sort operations.

381 questions
0
votes
1 answer

How to add a timestamp column in Hive at the time of external table creation

I have a csv file in hdfs and need to create a external table in Hive. I also need to add a extra column timestamp that should by default hold the value of record insert timestamp. I read that it is not possible in hive to set a default value like…
user7127675
0
votes
1 answer

How to filter the ListEntitiesAsync method from Azure Functions External Table binding

I successfully implemented the tutorial to get an Azure Function working with a Google Drive Spreadsheet. The sample code returns all the items in the file. I want to return a single row by applying a fliter. Is it possible? I tested the following…
Luis Beltran
  • 1,704
  • 12
  • 13
0
votes
1 answer

Cannot Catch error when querying an invalid External Table

When you have an external table created based on a non-existing table from another Azure SQL database. SELECT * FROM invalid_external_table The following error message is thrown: Msg 46823, Level 16, State 1, Procedure Error retrieving data…
0
votes
2 answers

Load float data into external table in Oracle

I'm having a troubles with loading FLOAT data into the external table... Data like that: +00000700000,00. Any ideas how to do this? FLOAT EXTERNAL or FLOAT(15) does not work... Of course in CREATE statement I have FLOAT column. FLOAT will only load…
Lui
  • 594
  • 3
  • 10
  • 23
0
votes
1 answer

Creating external table and loading this data into another table inside procedure

I'm trying to create a procedure, which allows to load data from file into external table. Next it should create: sequence and trigger, which allow to generate automatically the ID during the inserting data from external table into other table. I…
Lui
  • 594
  • 3
  • 10
  • 23
0
votes
1 answer

Unable to connect with On Premise Sql Server from Azure Sql db

I am having two Sql Server Databases: On-Premise : See the image below. We have a static IPassociated with this server in order to access remotely from other development machines. Machine is deployed in Location A and is accessible from Location B…
user240141
0
votes
2 answers

Hive from JSON Error

I can't make this json into hive table somehow, either become all null data or not able being selected. i just need all the same fields with my DDL, and if it's structured inside it, i want to let it as a string instead try to parse that. The only…
code-addict
  • 137
  • 2
  • 12
0
votes
0 answers

Create a SQL Server CREATE TABLE statement using T-SQL

The creation of a SQL Server External Table requires remote tables to be made accessible by running code of the following format on the local database: CREATE EXTERNAL TABLE [TABLE_NAME] ( [Id] [int] NOT NULL, [Name] [int] NULL, ) WITH…
0
votes
0 answers

How load JSON file into external table

We had an old framework which reads the data from external table and processes it. Now I want to use the same but this time I will get data from Handsontable Json. Here I want to do it in a bulk insert into external table so that it's easy for me to…
Shiv
  • 13
  • 7
0
votes
1 answer

Read Excel Files from External Tables

I am tasked to create a template that will be Filled up by Business Users with Employee Information, then our program will load this into the Database using External Tables. However, our Business Users constantly change the template by adding,…
Migs Isip
  • 1,450
  • 3
  • 23
  • 50
0
votes
0 answers

Hive external table(non partitioned) with different file structures in the same location

My hive external table(non partitioned) has data in an S3 bucket. It is an incremental table. Until today all the files that come to this location through an Informatica process, were of the same structure and all the fields are included columns in…
spark_dream
  • 326
  • 2
  • 8
  • 23
0
votes
0 answers

Numeric precision lost with external table

I have a problem with an external table. I have a file with couple of numbers and I want to load them into an external table. The problem is that when I load the data into the table, the precision is not good for me. I need to load data into the…
Novice
  • 7
  • 2
0
votes
1 answer

hive load external table from dynamic location(partitioned)

I need to create a hive table(external) to load data generated by another process. I need to be partitioned by date, But the problem is, there is a random string in the path. Example input paths…
Thelight
  • 359
  • 1
  • 5
  • 15
0
votes
1 answer

External table with nested value json

I am trying to create an external table handle data like this: {"Id":"1","att":{"value":0.5}} I wrote the following query but it is not working: CREATE EXTERNAL TABLE IF NOT EXISTS table_1 (Id bigint, att double), path) but it gives null for the…
Obadah Meslmani
  • 339
  • 3
  • 15
0
votes
1 answer

Dynamically Identify Columns in External Tables

Dynamically Identify Columns in External Tables We have a process wherein we upload employee data from multiple legislations (ex. US, Philippines, Latin America) via a SQL Loader. This happens at least once a week and the current process is they…
Migs Isip
  • 1,450
  • 3
  • 23
  • 50