Stack Overflow
Stack Overflow

Questions tagged [data-profiling]

Data profiling is the process of examining the data available in an existing data source and collecting statistics and information about that data.

Data profiling is the process of examining the data available in an existing data source (e.g. a database or a file) and collecting statistics and information about that data.

Data profiling is an analysis of the candidate data sources for a data warehouse to clarify the structure, content, relationships and derivation rules of the data. Profiling helps to understand anomalies and to assess data quality, but also to discover, register, and assess enterprise metadata.

36 questions
0
votes
1 answer

XSLT: Copy two files into one common structure

I try to merge result of SSIS Data Profiler Task for several tables into one XML for inspection of the results within one single file inside "Data Profiler Viewer". The whole problem shrinks to the stronly simplified XML-trasformation here: File 1…
Christian4145
  • 513
  • 1
  • 9
  • 31
0
votes
1 answer

generate PostgreSQL stats / data profiling

I would like to automate data profiling on PostgreSQL with a free tool, a tool that inspects data content through a column profile or percentage distribution of values. like max, min, avg.
rachid el kedmiri
  • 2,376
  • 2
  • 18
  • 40
0
votes
1 answer

Extract pattern from dataset

I have a table with several columns filled with data from different parameters. As some of the rows might share the same column values I'd like to extract the most repeating values for each column so I can get a profile of the most common values for…
Bruno Fernandes
  • 427
  • 2
  • 6
  • 14
0
votes
2 answers

Data Profiling on a File through SSIS

I'm new to SSIS Development. I need some guidance from experts on SSIS. Following are the list of questions : We are having files with sizes from 1GB to 25 GB of type txt or dat files with tab delimited . Some times,these file might contain invalid…
user145610
  • 2,949
  • 4
  • 43
  • 75
-1
votes
5 answers

Tool for table_schema and table_name relationship

Do you know any tools for profiling,to see the structure and relationship of each tables inside the db? it is look like this one : See screenShot below, For bigger resolution, Please click here. Thanks In advance. Any help much more appreciated! :)
Database Admin
  • 83
  • 2
  • 10
-2
votes
1 answer

DB2 : Need to get the list of columns and distinct value counts for a given db2 table

For data profiling purpose , I just need to get the idea if a columns in a given table has values populated or not. For that, I need to get the list of columns and distinct value counts for a given db2 table.
Edayadulla M
  • 101
  • 2
  • 4
1 2
3