Questions tagged [database-metadata]

Metadata is "data about data". In database terminology, this set of metadata is referred to as the catalog. The SQL standard specifies a uniform means to access the catalog, called the information schema, but not all databases implement it, even if they implement other aspects of the SQL standard. For an example of database-specific metadata access methods, see Oracle metadata.

Meta Data:

Metadata is “data about data”. An item of metadata describes the specific characteristics about an individual data item. In databases, metadata describes the structural components of tables and their elements. For example, metadata about an element could include data types, name of data, size and many more characteristics about that element. It would also give information about the tables the database is storing, information, such as length of fields, number of columns, where the tables are located and other pertinent information. One of the main uses for met data is to provide a link between the information creator and the information users. Metadata allows the users to speed up the search for individual data. This is done by being able to set parameter for searches, allowing the filtering of unwanted information. Metadata can be stored either internally, in the same file as the data or externally, in a separate area. Both have advantages and disadvantages. If the data is stored internally, the metadata is together with the data making more easily accessible to view or change. However, this method creates high redundancy. If metadata is stored externally, the searches can become more efficient. There is no redundancy but getting to this metadata may be a little more technical. There are certain formats that must be used, such as Uniform Resource Identifier(URI) to get to the metadata if this format is not used the metadata becomes inaccessible. All the metadata is stored in a data dictionary or a system catalog. All programs that access data in the database work through a DBMS. The DBMS uses the data dictionary to look up the required components and relationships. Any changes made to the database structure are automatically recorded in the data dictionary. This makes the data dictionary manager’s job a lot easier because any modification of programs that are affected by the changed structure is not necessary.

Metadata at the most basic level is simply defined as “data about data”. An item of metadata describes the specific characteristics about an individual data item. In the database realm, metadata is defined as, “data about data, through which the end-user data are integrated and managed.” (Rob & Coronel, 2009) Metadata in a database typically store the relationships that link up numerous pieces of data. “Metadata names these fields describes the size of the fields, and may put restrictions on what can go in the field (for example, numbers only).” (Sheldon, 2001).

“Therefore, metadata is information about how data is extracted, and how it may be transformed. It is also about indexing and creating pointers into data. Database design is all about defining metadata schemas.” (Sheldon, 2001) Metadata can be stored either internally, in the same file as the data, or externally, in a separate area. If the data is stored internally, the metadata is together with the data, making it more easily accessible to view or change. However, this method creates high redundancy. If metadata is stored externally, the searches can become more efficient. There is no redundancy but getting to this metadata may be a little more technical.

All the metadata is stored in a data dictionary or a system catalog. The data dictionary is most typically an external document that is created in a spreadsheet type of document that stores the conceptual design ideas for the database schema. The data dictionary also contains the general format that the data, and in effect the metadata, should be. Metadata is an essential aspect of database design, it allows for increased processing power, due to the fact that it can help create pointers and indexes.

Useful Resources:

217 questions
2
votes
2 answers

Why I cannot debug a DatabaseMetaData?

I've a strange situation with a little application in Java using a JDBC-OBDC. I'm inspecting a Database using the DatabaseMetaData Class. When I execute the program, everything works without anyproblem. But when I want to debug to see the values…
jomaora
  • 1,656
  • 3
  • 17
  • 26
2
votes
3 answers

Is there a quick way to report database metadata in SQL Server 2005?

Are there any system stored procs to report the stats and metadata of a database itself in SQL Server 2005? What I need is a quick way to output a list of tables, the size of each table, the number of rows in each table and so on. Stored procs for…
flesh
  • 23,725
  • 24
  • 80
  • 97
2
votes
2 answers

Get column name, data type, size and comments of Oracle table

How can I get column name, data type, size and comments of table? I tried SELECT all_tab.column_name, all_tab.data_type, all_tab.data_length, col_com.COMMENTS FROM all_tab_columns all_tab JOIN user_col_comments col_com ON…
GoingMyWay
  • 16,802
  • 32
  • 96
  • 149
2
votes
2 answers

How can i see metadata, lineage of data stored in AWS redshift?

I am using solutions like cloudera navigator, atlas and Wherehows to get Hadoop, HDFS, HIVE, SQOOP, MAPREDUCE metadata and lineage. Now we have a data warehouse in AWS redshift as well. Is there a way to extract metadata or lineage or both…
2
votes
1 answer

How to filter tables using Connection.getMetaData().getTables

I have a huge schema that contains my application table, I need to return these tables only. I've used the following: ResultSet publicTables = jdbcConnection.getMetaData().getTables(null, schema, "USER_%", dataTypes); The problem is, I've 6 tables…
Muhammad Hewedy
  • 29,102
  • 44
  • 127
  • 219
2
votes
2 answers

How to find a table with a primary key with a certain column name in Microsoft SQL?

In Microsoft SQL, if I want to get information about where a column with a certain column name appears in my database, I can run this query: select * from information_schema.columns where column_name = 'XXXXX'; This query returns a wealth of…
Vivian River
  • 31,198
  • 62
  • 198
  • 313
2
votes
3 answers

Find table containing two particular columns in SQL Server

I would like to find all the tables containing two particular separate columns in SQL Server. The first column name is "LIKE '%A%'" (Meaning it contains the substring "A") and the second column name is "LIKE '%B%'" (Meaning it contains the substring…
Neo
  • 696
  • 1
  • 14
  • 33
2
votes
1 answer

DatabaseMetaData().getTables() - is very slow any alternative?

DatabaseMetaData().getTables() - is very slow, Is there any alternative of this? Following is my actual code : connection.getMetaData().getTables(null,null,null,new String[] {"TABLE", "VIEW"} );
2
votes
3 answers

Is there a way to test if modifying table column will succeed in SQL?

I have a tool that applies a lot of changes to a database. Many changes concern modifying column types, sizes, etc. Is there any (possibly Oracle-specific) way to tell in advance if given ALTER TABLE change will succeed and not fail because of too…
user319799
2
votes
1 answer

JDBC code is giving IllegalAccessError for MySql

I am getting the following error while retrieving the database tables primary keys, foreign keys and the columns information. Basically I am aware that IllegalAccess is related to the accessing private methods etc. May be it is due to incompatible…
phoenix
  • 985
  • 3
  • 17
  • 38
2
votes
1 answer

Conversion between types in entity framework 6

I am getting the metadata from an edmx file so I can generate mappings for code first. The challenge is: there is multiple types of the same name in two different namespaces and they don't convert. Is there a way to convert them? Cannot convert from…
Rick Rat
  • 1,732
  • 1
  • 16
  • 32
2
votes
2 answers

How to get the metadata of a mysql table on sailsjs

I was wondering if you can get the metadata or the entire structure of the table and columns using sailsjs or waterline's mysql module
mateeyow
  • 1,306
  • 1
  • 17
  • 38
2
votes
1 answer

Can't get foreign key using JAVA DatabaseMetaData

i want get foreign key using java DatabaseMetaData and tried. but i got just foreign key referring pk column and couldn't get referring unique column. i tried using getCrossReference(), getImportedKeys() pattern and same result. here is my code and…
user3273956
  • 21
  • 1
  • 4
2
votes
4 answers

Pulling data from Java application to Salesforce, where should i start?

I'm new in programming, and I'm trying to do a something like this. I have data(Objects, Fields & Records) in a Java based web application. I need that data on salesforce.com. How do i achieve this? by diggin in stack for an hour i came across…
user3116
  • 25
  • 5
2
votes
0 answers

Oracle:Why is select from user_ind_columns so slow?

Oracle version: Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production I'm trying to get metadata from my Oracle database (I'm a bit of a noob at Oracle, more of a Sybase man). When I do select * from USER_IND_COLUMNS it…
Vinny Roe
  • 903
  • 4
  • 8