Questions tagged [data-consistency]
126 questions
0
votes
1 answer
DolphinDB - Verify data consistency during database migration
I have some Oracle and MySQL databases migrated to DolphinDB with dataX and mysql plugins, and I want to check if the migrated data is consistent with the source.
I’ve tried the following 2 methods:
Compare the number of records between source and…
Eva Gao
- 402
- 1
- 7
0
votes
1 answer
How to manage Data consistency between two microservices?
I have two microservices, e.g M1 and M2. M1 is responsible for managing user transactions e.g orders. When an order is completed, the summary data is sent to M2 via Message bus. M2 is reponsible for generating reports on orders. Our transactions…
Siraj ur Rahman
- 213
- 3
- 13
0
votes
1 answer
Spring Data: How to maintain cache consistency in transactional methods?
Let's assume we have a standard Spring Boot application with JPA. We have repositories, services and REST controllers. On the service layer, we have this:
@Service
public class UserService {
@Autowired
private UserRepository userRepo;
…
Martin Häusler
- 6,544
- 8
- 39
- 66
0
votes
1 answer
Data consistency in DAOs
Looking up "dao data consistency" or "data access layer data consistency" on Google returns nothing useful
Suppose I have to write DAOs that use a SQL db as datasource and let's say that my schema enforces most (but not all) of the business data (?)…
Federico Bocchieri
- 15
- 4
0
votes
1 answer
Data Consistency check in ADF Copy activity with Source as Query on Teradata Table and Sink as CSV in Azure Blob
Source: Query on a Teradata table
Sink: Csv file in Azure Blob Storage
Aim: I want the Copy activity to fail if the count in the source query and copied rows do not match.
Looking at the documentation for Supported data stores and scenarios, it does…
Nirupam Nishant
- 209
- 3
- 10
0
votes
1 answer
Flutter List after storing all data in a for-loop, when out of loop replace all stored records with the last record. Why's that?
I want to pass data from json to a list. I load the list with data into a for-loop, and it works as expected, loading 6 records into my list. But when I verify when for-loop is done, my list keep only the last data in all 6 records. Why's that?
This…
user310563
- 13
- 3
0
votes
2 answers
How to share data between microservices without sync RPC (use topics as changelogs) and deal with consistency?
I learned about using Kafka's topics as a changelog to avoid doing synchronous RPC, but I don't understand how we deal with consistency as topics are not persistent (retention policy).
i.e, I run an application, 2 microservices:
The User Service,…
Julien Elkaim
- 131
- 9
0
votes
0 answers
Atomic Deletion in Mongodb
I have the following collections in my MongoDB
Task:
{
_id: string;
name: string;
}
Employee:
{
_id:string;
name: string;
tasks: string[];// contains the ids of the assigned tasks.
}
I want to delete a task if it's not assigned to any employee, so…
0
votes
1 answer
Cassandra atomicity with delete partition key which belong to different tables
I have a use case where i need to perform delete from three tables in cassandra . The partitioning key is same for all the tables example :-
Db_name/table1/1111
Db_name/table2/1111
Db_name/table3/1111
Which operation i shall use Put/batch in order…
invincible
- 73
- 5
0
votes
1 answer
How to prevent concurrent INSERT in Oracle
During race condition, How to validate number of rows inserted to table A based on permitted row count defined in table B.
#Table A
CAMPAIGN_ID ISSUE_LIMIT_PER_USER
----------- --------------------
1000000111 1
#Table B
OFFER_ID …
Prabhat Kumar
- 21
- 5
0
votes
1 answer
In a distributed program, how to recovey its corresponding data when a process crashes
I have a distributed program, for example, it has ten process, and all of them will execute some job, all job info will storage to a same MySQL database. At a same moment, there was a lot of running job in database, and they are belong to different…
hehe
- 173
- 3
- 13
0
votes
1 answer
Reliably fetch LDAP (AD) updates
I need to sync users and groups from LDAP server. Currently only Active Directory is required.
I've looked at whenChanged attribute as suggested here. But it will be tricky to detect delete operations, I guess.
Are there any protocols to do that,…
Artsiom the Brave
- 192
- 2
- 10
0
votes
0 answers
How do i satisfy business requirements across microservices with immediate consistenc?
Let’s assume I’m in the context of an admin panel for a webshop. I have a list of orders. Those orders are payed for and are ready to ship. The (admin) user would like to start making shipments based on the items ordered.
Imagine there are 2…
Jens
- 35
- 3
0
votes
1 answer
Oracle how child table behave when data from parent table is modified?
Scenario: We have table A (Parent Table) referring to table B (Child Table) and also we have Foreign Key Index for every Foreign Key.
Operation: Now when any user is deleting a row from table A then table B is getting locked even if there are no…
Sujit Kumar Swain
- 21
- 4
0
votes
1 answer
message consistency test scenario in Kafka
i'm building a POC that contains a Kafka cluster deployed on Kubernetes and three spring boot apps that read from kafka and write to jms and vice versa.
I want to know how data integrity and consistency is ensured for example:
If a producer node…
aymen0406
- 127
- 10