Questions tagged [database-metadata]

Metadata is "data about data". In database terminology, this set of metadata is referred to as the catalog. The SQL standard specifies a uniform means to access the catalog, called the information schema, but not all databases implement it, even if they implement other aspects of the SQL standard. For an example of database-specific metadata access methods, see Oracle metadata.

Meta Data:

Metadata is “data about data”. An item of metadata describes the specific characteristics about an individual data item. In databases, metadata describes the structural components of tables and their elements. For example, metadata about an element could include data types, name of data, size and many more characteristics about that element. It would also give information about the tables the database is storing, information, such as length of fields, number of columns, where the tables are located and other pertinent information. One of the main uses for met data is to provide a link between the information creator and the information users. Metadata allows the users to speed up the search for individual data. This is done by being able to set parameter for searches, allowing the filtering of unwanted information. Metadata can be stored either internally, in the same file as the data or externally, in a separate area. Both have advantages and disadvantages. If the data is stored internally, the metadata is together with the data making more easily accessible to view or change. However, this method creates high redundancy. If metadata is stored externally, the searches can become more efficient. There is no redundancy but getting to this metadata may be a little more technical. There are certain formats that must be used, such as Uniform Resource Identifier(URI) to get to the metadata if this format is not used the metadata becomes inaccessible. All the metadata is stored in a data dictionary or a system catalog. All programs that access data in the database work through a DBMS. The DBMS uses the data dictionary to look up the required components and relationships. Any changes made to the database structure are automatically recorded in the data dictionary. This makes the data dictionary manager’s job a lot easier because any modification of programs that are affected by the changed structure is not necessary.

Metadata at the most basic level is simply defined as “data about data”. An item of metadata describes the specific characteristics about an individual data item. In the database realm, metadata is defined as, “data about data, through which the end-user data are integrated and managed.” (Rob & Coronel, 2009) Metadata in a database typically store the relationships that link up numerous pieces of data. “Metadata names these fields describes the size of the fields, and may put restrictions on what can go in the field (for example, numbers only).” (Sheldon, 2001).

“Therefore, metadata is information about how data is extracted, and how it may be transformed. It is also about indexing and creating pointers into data. Database design is all about defining metadata schemas.” (Sheldon, 2001) Metadata can be stored either internally, in the same file as the data, or externally, in a separate area. If the data is stored internally, the metadata is together with the data, making it more easily accessible to view or change. However, this method creates high redundancy. If metadata is stored externally, the searches can become more efficient. There is no redundancy but getting to this metadata may be a little more technical.

All the metadata is stored in a data dictionary or a system catalog. The data dictionary is most typically an external document that is created in a spreadsheet type of document that stores the conceptual design ideas for the database schema. The data dictionary also contains the general format that the data, and in effect the metadata, should be. Metadata is an essential aspect of database design, it allows for increased processing power, due to the fact that it can help create pointers and indexes.

Useful Resources:

217 questions
0
votes
2 answers

Viewing Historical Metadata of BigQuery Tables/Datasets

Is there a way to view historical information about BigQuery tables over time? For example, if I wanted to check how the size of a table has changed? Attempts: None, because I am unaware if this is doable.
0
votes
0 answers

export metadata to create mysql table from excel using pentaho or php laravel

i want to ask is it possible to create a SQL DDL create query MySQL table from information.schema columns that saved in excel file? my metadata in an excel file is like: metadata what i want is from that metadata, it is able to create a CREATE DDL…
0
votes
1 answer

What is the meaning of last_modified_timestamp in BigQuery

I am running the below query, trying to understand the meaning of last_modified_timestamp. Is it when the data in the table was last updated (DML operation) or when the table structure was last modified (DDL operation). SELECT * FROM…
0
votes
0 answers

Java DatabaseMetaData getIndexInfo Parameter approximate

I want to check, if a column in a database has a unique-constraint. Therefor this code-snippet is used: try (ResultSet rs = pCon.getMetaData().getIndexInfo(null, pSchema, pTable, true, false)) { while (rs.next()) if…
ses
  • 168
  • 1
  • 11
0
votes
0 answers

Database metadata table design

I'm working on a blog website with an Admin Panel. It consists of Articles, Categories, Tags, and Updates tables. The updates is a meta-data table which tracks any updates in any other table. What is the best way to link the updates to the others?…
0
votes
2 answers
0
votes
1 answer

How to retrieve DDL of a postgres table using Java JDBC?

There is a requirement to update the table frequently by truncating and then populating it again using a dump file. While doing that I first delete the reference keys. This reduces the time of populating the table. Can I retrieve below similar…
Mayur
  • 11
  • 1
0
votes
1 answer

Hive query - Get list of all View Names for given Table Name

Is there a way to query and fetch list of all View Names for a given Hive Table? If we created three Views for the table. Given Table name as CRICKET_STATS, how to get output as, CRICKET_AUS_VW CRICKET_SA_VW CRICKET_IND_VW HIVE DDL SCRIPT CREATE…
Vasanth Subramanian
  • 1,040
  • 1
  • 13
  • 32
0
votes
1 answer

SQL Server partitions: finding min / max value from metadata (i.e. sys.partition_range_values) rather than the table itself

I've an unique requirement for finding min / max value from a partition's range values. The idea is to gain on response time by querying metadata rather than the table itself. for e.g. I've a table partitioned on business date. when I do a min / max…
0
votes
1 answer

Trying to Retrieve column name but gets column index from metadata via IBM JDBC driver

I am using the jdbc driver for IBM DB2 Z/OS(version 4.13.127) and I am trying to get table information from the metadata. I am having a different behaviour from what I was expecting : instead of retrieving the column names, I get the column…
krakig
  • 1,515
  • 1
  • 19
  • 33
0
votes
1 answer

Column statistics in oracle 19?

Does an extended metadata table exist in oracle 19 holding column statistics from all tables? I know there is the table ALL_TAB_COL_STATISTICS which stores histogram, min, max, num distinct values etc. but I need additional statistics such as mean,…
0
votes
1 answer

Update model from database not updating metadata

My project has stopped updating the metadata when I add new tables or stored procedures. Its on Visual Studio 2017. with .net framework 4.6.1 I use the Update model from database wizard and after selecting the new item and clicking finish. If I…
0
votes
0 answers

Check if a table exists using Java

I am trying to perform a check on the database for a table using the below snippet: But the problem is, if the table or the view is empty the condition tables.next() does not evaluate to true, how to handle this scenario? DatabaseMetaData dbm =…
D.Amudha
  • 1
  • 1
0
votes
0 answers

COLUMN_NAME loop Oracle Database

I have some problems with my code. I want to extract the column names from my table. Everything works fine in mySQLWorkbench and it shows me all of my column names. For example the output in mySQL Workbench is : nr,height,length The output on my…
0
votes
0 answers

i want to fetch all tables in one database and display in jsp

like so @SuppressWarnings("unchecked") public List getTableColumns(DataSource dataSource) throws MetaDataAccessException{ List table= (List) JdbcUtils.extractDatabaseMetaData(dataSource, new…
rjabcd
  • 1
  • 1