Stack Overflow
Stack Overflow

Questions tagged [external-tables]

To be used for External tables. These tables don't necessarily have data in the data warehouse(or database directory).

Hive

An EXTERNAL table points to any HDFS location for its storage, rather than being stored in a folder specified by the configuration property hive.metastore.warehouse.dir(Location of default database for the warehouse). See also official Hive docs on Managed vs External Tables

Oracle

External tables allow Oracle to query data that is stored outside the database in flat files. The ORACLE_LOADER driver can be used to access any data stored in any format that can be loaded by SQL*Loader. No DML can be performed on external tables but they can be used for query, join and sort operations.

381 questions
0
votes
2 answers

can multiple csv's can be read using external table in oracle without specifying list of file names?

I have 150 odd csv files but there file name may vary. so i want to know whether in external table concept can we use *.csv where we provide file name list. LOCATION (*.csv)
lobh
  • 33
  • 7
0
votes
1 answer

Import hour, minute, second from csv to timestamp column in external table

I'm trying to convert a csv data file to an oracle database table. To do so I'm going by an external table as described here. The timestamp in my csv is separated into the date (yyyy-mm-dd) on one side and the time (hh24:mm:ss) on the other. My…
Frazic
  • 77
  • 9
0
votes
0 answers

ORACLE - What is the Problem with date in External Table?

I'm trying to load data from a CSV file. The date value in the file is correct. And in the table, some values are incorrect. CREATE TABLE "TABLE" ( "TIMESTAMP" VARCHAR2(4000) ) ORGANIZATION EXTERNAL ( TYPE ORACLE_LOADER …
qskyhigh
  • 107
  • 1
  • 7
0
votes
1 answer

Oracle's user_external_locations equivalent in Postgres

In postgres, is there a system table that stores the mapping between foreign (external) table and its corresponding file on the disk. Similar to location and table_name mapping in user_external_locations table in oracle. I have used foreign file…
Sarika
  • 3
  • 3
0
votes
1 answer

select * returns null values for timestamp after creating external table on orc files stored in hdfs

I am creating an external table on top of orc files stored in hdfs. I have process_timestamp column with a timestamp in the data files. After creating a table, I performed MSCK REPAIR TABLE . However, while querying the table timestamp…
lone_ranger
  • 75
  • 4
0
votes
1 answer

Issue with non-printable char while exporting CSV data (Windows-1252) to hive

I am trying to create a hive table on top of following CSV dataset using OpenCSVSerde WITH SERDEPROPERTIES ("quoteChar"='\"', "separatorChar"=',') but the hive table is losing the £ sign, and showing the replacement character �.…
Amit
  • 1
0
votes
1 answer

How do I create one Hive Table when I have multiple files (in the exact same folder/directory) that have the exact same columns?

I have about 10 files in the same HDFS location. All files have the exact same columns (about 15) and each are about 100 rows. Each file represents data I have received on over the last 10 months (data is refreshed monthly). I would like to create…
Rspktcod
  • 23
  • 6
0
votes
2 answers

Hive external table delimited by commas, but comma present in data

I have some data coming in from an external source of the format: user_id, user_name, project_name, position "111", "Tom Petty", "Heartbreakers", "Vocals" "222", "Ringo Starr", "Beatles, The", "Drummer" "333", "Tom Brady", "Patriots", "QB" And I…
Craig
  • 1,929
  • 5
  • 30
  • 51
0
votes
0 answers

drop external table hangs

Oracle 9.2.0.1 T1 is an external table accessed through a cursor from another database by using database link I give command drop table T1; which time outs with ORA-4021
DesignerAnalyst
  • 178
  • 6
0
votes
0 answers

msck repair table not working on unpartitioned table - hive config issue

I have an unpartitioned EXTERNAL table: CREATE EXTERNAL TABLE `db.tableName`( `sid` string, `uid` int, `t1` timestamp, `t2` timestamp) ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe' WITH SERDEPROPERTIES ( …
dreddy
  • 463
  • 1
  • 7
  • 21
0
votes
2 answers

SQL Server 2019 Polybase Create External Table error "This operation requires PolyBase to be enabled in the target server"

I`m using SQL Server 2019 preview version (15.0.1000.34) with Polybase services installed on localhost/SQL2019 named instance (Windows 10) and Azure Data Studio, I wish to add an External Table from Oracle db (remote server) and getting an error…
Alexey Chibisov
  • 188
  • 1
  • 10
0
votes
1 answer

How to read a UTF-8 character with External Table correctly

I have a CSV file encoded in uft8. There is text in a field of the record In the text are characters that are coded with two characters. e.g. in the word Österreich Character Ö is encoded as O and ¨ and not as Ö If I open the file in the editor,…
hotfix
  • 3,376
  • 20
  • 36
0
votes
0 answers

How can we handle null values for Data type INTEGER while using Federated/External tables for Google Bigquery?

While Using below query ,i am getting the error . bq mk --use_legacy_sql=false --nullmarker="\N" --external_table_definition=/tmp/bqschema dataflowjson.TEST1 FATAL Flags parsing error: Unknown command line flag 'nullmarker' Run 'bq help' to get…
DataVishesh
  • 197
  • 1
  • 5
0
votes
1 answer

BigQuery could not parse "\N" as INT or DATETIME using nullMarker: "\N" in table definition for external federated table

I am using \N for null either for INTEGER or DATETIME data types in the JSON table definition(nullMarker:"\N") for external tables but then also BigQuery is not able to parse it and throwing the below error: error message: Could not parse '\N' as…
flametech
  • 21
  • 4
0
votes
1 answer

Is it possible to use a joined table as a basis for a model?

What are my options for molding existing database table(s) to my model in rails? I have a has_one and belongs_to relation between two tables, but I'd like to join them and use that as a model (and select only the fields relevant). As this is an…
Ig Norand
  • 23
  • 3
1 2 3
…
25 26