Stack Overflow
Stack Overflow

Questions tagged [data-quality-services]

Data Quality Services is a feature first deployed with SQL Server code-named "Denali" for automating data cleansing tasks

From Microsoft's website on DQS:

SQL Server Data Quality Services (DQS) is a knowledge-driven data quality product. DQS enables you to build a knowledge base and use it to perform a variety of critical data quality tasks, including correction, enrichment, standardization, and de-duplication of your data. DQS enables you to perform data cleansing by using cloud-based reference data services provided by reference data providers. DQS also provides you with profiling that is integrated into its data-quality tasks, enabling you to analyze the integrity of your data.

39 questions
1
vote
1 answer

SQL DQS Domain properties 'Use leading values'

In the SQL DQS Client knowledge base (domain management), there is a checkbox for 'Use leading values'. I am looking for use case example of this please. "Select this checkbox to specify that the leading value in a group of synonyms will be output…
variable
  • 8,262
  • 9
  • 95
  • 215
1
vote
0 answers

DQS and Azure SQL

So I know that DQS isn't available in Azure, at least not yet. I was wondering though, is it possible to link an on-prem instance that holds the information to an Azure processing task and create a hybrid? I just wondered if this has been…
user1663003
  • 149
  • 1
  • 10
1
vote
1 answer

SSIS DQS Cleansing Task stuck randomly

I have a number of packages that are running Data Quality check for some of our customer data. At times, the DQS task will be stuck in one of the packages randomly. There is no pattern how it gets stuck. Sometimes restarting the SQL Server works,…
user6811593
  • 13
  • 2
1
vote
0 answers

How can i write regular expression to check is numeric in DQS domain rule?

I'm new in ssis and dqs ,i want use the dqs to check is data numeric or no,for that purpose in the dqs client,define numeric domain and in the domain define rule with this image: for example i check this number: 125a2sd56 that rule return to me…
behzad razzaqi
  • 275
  • 2
  • 8
  • 23
1
vote
0 answers

Azure DW + DQS + MDS Architectures

What is a typical architecture if I want to use MDS and DQS for my Azure environment. I've been trying to search for some references and couldn't find a clear solution. Currently what I only know if I want to use DQS and MDS for my Azure DW is that…
mtryingtocode
  • 939
  • 3
  • 13
  • 26
1
vote
1 answer

Moving an SSIS DQS Task between environments

I'm using SQL Server 2012 and we have created an SSIS package that uses the Data Quality Services (DQS) Cleansing transformation. Everything works great, except when we try to move the SSIS package from the DEV environment to QA or PROD. The SSIS…
Daniel Rusch
  • 91
  • 1
  • 10
1
vote
0 answers

Calibrator error "Failed to execute calibrator, or an error occurred during calibration."

I am using: Microsoft SQL Server 2014 - 12.0.2000.8 (X64) Feb 20 2014 20:04:26 Copyright (c) Microsoft Corporation Enterprise Edition (64-bit) on Windows NT 6.3 (Build 9600: ) (Hypervisor) And I got this error... "Failed to execute…
Chicago1988
  • 970
  • 3
  • 14
  • 35
1
vote
1 answer

Data Quality Services (DQS) Error after installing SQL Server 2012 SP2

When I open the DQS client, I get this error message: Message Id: VerificationFrameworkVersionNotCompatible A new version of .NET or Data Quality Services was installed on this machine. In order to continue to work with DQS please run…
Adolfo Socorro
  • 21
  • 5
1
vote
0 answers

Matching Policy between multiple data sources in DQS

I'm New with MDS and DQS. I'm working on DQS matching Policy. We can create matching Policy only on a Single data Source? My Scenario is : If I have 2 data Sources, say PDMS and PNO. Can we set the trust score on the Data Sources. If so, Can we set…
user3607647
  • 51
  • 2
  • 14
1
vote
0 answers

How to create the domain rule to remove prefix from Name domain in DQS

My source data contains a name and address column. So I have created 2 domain in DQS. My data is looking like Name Address NSLIJ David Adr1 NSLIJ John Adr2 NSSSK Peter Adr3 Dyanaa Adr4 How can I create the domain rule on…
user3607647
  • 51
  • 2
  • 14
1
vote
2 answers

DQS - matching empty domains

Is it a way to configure matching rules in the DQS Data Quality Project to ignore matching the empty domains? I find it very strange if two empty domain values are considered as match for 100%. I always can, of course, write the newid() in all the…
Andrey Morozov
  • 7,839
  • 5
  • 53
  • 75
1
vote
1 answer

"Value already exists as a correcting value" error when cleansing data with DQS

In SQL Server 2012 Data Quality Services, I need to clean the data in Term Based Relation as follows: String Replaceto** Wal walmart** Wlr walmart** Wlt walmart** Walmart That is the words "wal","wlr", and…
Arun Kumar
  • 337
  • 3
  • 7
  • 20
1
vote
2 answers

Data quality Services Internal behaviour

When creating a knowledge basis on DQS, we can only select SQL Server and Excel from the drop down. I want to query oracle. To do that, I thought of creating a view on SQL Server that selects from a Oracle linked server but I'm worried about…
Diego
  • 34,802
  • 21
  • 91
  • 134
1
vote
1 answer

DQS SSIS package hangs in VS2010

I have a package that is used for DQS cleansing. I have nearly 650,000+ records to clean however after about 350,000 records processed I get a symptom that hangs my project up. For example, I will close my visual studio project/solution but once I…
M_devera
  • 95
  • 1
  • 9
1
vote
2 answers

How do I configure Referential Integrity type rules in DQS?

I have a scenario where I need to validate a domain using values in another domain. Rule is : Each value in domain 1 must exist in domain 2. The list of unique values in second domain will be around 50 million. How do I do this in DQS?
ash
  • 236
  • 1
  • 7
1
2
3