Questions tagged [data-comparison]

74 questions
2
votes
2 answers

Visual Studio 2010 DataCompare table comparison

In Visual Studio 2010 do you have the ability to compare the data of a database between 2 databases. I wanted to use this to copy data from one database to another. These databases have the exact same structure. But when I do a compare I see only 65…
Wessel Kranenborg
  • 1,400
  • 15
  • 38
2
votes
2 answers

How to compare data with varying number of values

I'll try to explain my problem as well as I can. I have to compare data of same type, saved in a MySql database but containing a varying number of values. I build my database like this (probably not the best): -- -- Table structure for table…
Lothereus
  • 3,819
  • 1
  • 15
  • 13
2
votes
1 answer

How to compare each value at the same position from multiple datasets in R

Suppose I have three datasets which have the same…
Shinzi Katoh
  • 291
  • 3
  • 11
2
votes
3 answers

Schema compare with MS Data Tools in VS2008

When performing a schema compare having db_owner rights on the target database results in the following error: The user does not have permission to perform this action. Using the SQL Server Profiler I figured out this error occurs executing a…
Ralf de Kleine
  • 11,464
  • 5
  • 45
  • 87
2
votes
1 answer

Return an alternate value when several criteria are met within a cell range with common IDs

I have a table with several rows featuring an ID column, a Value column and a RealValue column. The challenge is, within the "Values" with the same ID, if they are consistent, the RealValue remains the same as Value; if they are not consistent…
smoodin
  • 35
  • 3
1
vote
1 answer

How to compare rows show the reason of uniqueness in new column?

I have the following data: Name Age Country Occupation Hobby 0 A 23 DE Job holder Fishing 1 A 23 DE Job holder Gardening 2 A 23 DE Job holder Fishing 3 A 23 DE Job holder Reading 4 B 15 SW Job holder Fishing 5 B 15 SW Job…
1
vote
0 answers

Datacompy library: how to save report string into a Excel file?

I need to save the report in .xlsx format. I'm comparing between two data frames using Datacompy, but how can I save the final result as an Excel sheet. How can I save it as a Excel?
1
vote
0 answers

How to include sample rows with unequal values on spark version of datacompy

I am stating to explore spark to speed up processing and have been recently exploring spark datacompy. The only issue I am having is that I cannot find a way to print a sample of unequal values when found. Using the non-spark version of datacompy…
1
vote
2 answers

Pyspark how to compare two data frame without a unique/primary identifier

I am trying to compare two data set derived from hive and snowflake. These data set doesn't have unique identifier or primary key defined. so the challenge here is to verify the transaction of company from hive against respective snowflake…
cloud_hari
  • 147
  • 1
  • 8
1
vote
1 answer

Need column comprised of data from date two weeks ago for comparison

Let me start by saying that I am somewhat new to SQL/Snowflake and have been putting together queries for roughly 2 months. Some of my query language may not be ideal and I fully understand if there's a better, more efficient way to execute this…
1
vote
2 answers

Row wise comparison of a matrix with a vector in R using vectorization

I want to compare each row of a matrix with a vector and generate an index of the first value from the ith row that is less than the ith value in the vector. The values in each row of the matrix are sorted in decreasing order. Since the number of…
1
vote
1 answer

Compare two oracle database tables and it values in effective way

Two oracle database like DatabaseA and DatabaseB. Both are mirror database. Each database has 20 tables. DatabaseA is pointing to old approach Spring batch and It is same as production. Spring batch was modified for design problem. New Spring batch…
vigneshwaran m
  • 351
  • 2
  • 12
1
vote
2 answers

How to compare data in tables across SQL Server and Postgres?

I'm migrating data from SQL Server 2017 to Postgres 10.5, i.e., all the tables, stored procedures etc. I want to compare the data consistency between SQL Server and Postgres databases after the data migration. All I can think of now is using Python…
Underoos
  • 4,708
  • 8
  • 42
  • 85
1
vote
1 answer

Sorting csv / dataframes using Python and DataCompy reports

I am trying to compare two csv files (not sorted) and would like to get a report like SAS Proc compare. I am using datacompy and sorting the dataframe before comparing but datacompy reports are showing that 'no rows are in common'. Please let me…
AKS
  • 184
  • 2
  • 18
1
vote
1 answer

Can you export the comparison dataset in Visual Studio 2015

Is there functionality that I am missing within Visual Studio Data Tools (2015) that allows you to export the results of a data comparison? It looks like you can only export the DML script generated? Thanks!
RJ7
  • 883
  • 9
  • 17