Stack Overflow
Stack Overflow

Questions tagged [outbox-pattern]

The Outbox Pattern is based on Guaranteed Delivery pattern and looks as follows: When you save data as part of one transaction, you also save messages that you later want to process as part of the same transaction.

40 questions
1
vote
1 answer

The significance of keeping NServiceBus Outbox document record for 7 days in CosmosDB

As per NServiceBus Azure Cosmos DB persistence documentation, the outbox deduplication data is kept for 7 days by default. However, this can easily add hundreds of outbox documents in a day for a high volume transaction DB. I understand we can…
Ankit Vijay
  • 3,752
  • 4
  • 30
  • 53
1
vote
1 answer

Is QLDB compatible with the Outbox Pattern?

I have a use case for which QLDB makes the most sense. I also think the Outbox pattern makes sense for data reliability. However, I am worried about polluting the Journal with the outbox entries. My understanding is that while I can have my 'outbox'…
fun_hat
  • 547
  • 2
  • 7
  • 25
0
votes
1 answer

In-Memory Outbox with MassTransit

We wish to implement an outbox pattern at the producer level to ensure delivery to the Azure Service Bus, i.e. hold the message in the outbox only till the service bus is unavailable or down and send it as soon as it is available. The mandate from…
animat089
  • 97
  • 1
  • 9
0
votes
1 answer

messages does not delivered to RabbitMQ while using mass transit and outbox pattern

im using Outbox Pattern with MassTransit, when i publish message, it will remain in the OutboxMessages table in the data base and it wont deliverd to broker and here is the configuration: packages:
HassanJalali
  • 77
  • 9
0
votes
0 answers

run debezum source conncector with custom single message transformer

It is being developed to attach smt (single message transforms) to the debezium mysql source connector. I implemented debezium smt by referring to the documentation, put the smt and mysql source connector jar files into the docker image of kafka…
gun bos
  • 51
  • 4
0
votes
0 answers

Why is throwing the exception: AddMassTransit() was already called and may only be called once per container?

I'm adding the configuration of Mass transit for azure service bus in my ConfigureServices. I'm using .Net6 and Mass Transit 8.0.15. I'm debugging my project ti check if I'm getting the right connection string for the azure service bus but I get an…
Laura Díaz
  • 85
  • 1
  • 9
0
votes
1 answer

Outbox Pattern vs Debezium

I am trying to understand if there's a fundamental difference between what the 2 are trying to achieve. I have a use case of landing my postgres data to data lake, and these are the 2 paved-road approaches that i have. Option 1. Create an outbox…
Kshitij Kohli
  • 4,055
  • 4
  • 19
  • 27
0
votes
1 answer

Mass transit does not track my command after publish

my goal is to use mass transit transactional outbox pattern with rabbitmq and here is the configuration: private static void AddOutboxPattern(IServiceCollection services) { services.AddMassTransit(configuration => { …
HassanJalali
  • 77
  • 9
0
votes
1 answer

MassTransit Transactional Outbox Default Isolation Level

I've been using the MassTransit v8.0.13 Transactional Outbox for a few months, but now I'm wondering about the default transactional level set on it. I'm using Postgres and when I setup the Transactional Outbox, by default it sets the isolation…
JoaoVelho
  • 17
  • 2
0
votes
0 answers

Micro services failure scenarios

I have a basic question related to any micro service: This is the architecture for my micro-services: order-service <-----kafka----> payment-service I am using outbox-pattern with saga. My question is: What if order_service crashes just after…
Abhijeet Sachdev
  • 33
  • 2
  • 7
0
votes
0 answers

how to handle 1 to many outbox message with Kafka Outbox pattern?

i have a kafka APP using outbox pattern, becoz i wanna take the advantage for deduplication by using CDC (change data capture) The pattern workflow will look like: poll message begin db transaction get api records prepare db insert records…
user192344
  • 1,274
  • 6
  • 22
  • 36
0
votes
0 answers

How to store/send linking events using event sourcing?

I have an endpoint which is linking entity1 to entity2 (many to many), so after they were linked I need to send an integration event. I am using event sourcing and outbox pattern. So what must be the aggregate of my event? entity1 or entity2 What…
Gor Grigoryan
  • 297
  • 1
  • 7
0
votes
0 answers

Outbox pattern and Inbox pattern is not guaranteed your delivery as well. How can i be safe for the message broker?

There is an event and I want to make sure it delivered. You know, in the outbox pattern, we save the event to the db before sending it to the message broker and delete it after publishing. However, if I apply it in inbox pattern, we first read the…
doğukan güney
  • 1
0
votes
1 answer

how to implement outbox like pattern with third party api

I am implementing integration with a third party system, that I don't have a control over it, and use rabbitmq as message queue to publish a message after doing some updates on the third party system, my implementation as the following…
tarek salem
  • 540
  • 1
  • 6
  • 20
0
votes
1 answer

NServiceBus Outbox pattern with SQL question

Im trying to figure out how exactly outbox is suppose to work with NServicebus but I'm not quite sure I get it. Here is the current scenario that we have: Service1 Service2 Service3 ServiceN Each of the services has its own database where it holds…
Bola
  • 718
  • 1
  • 6
  • 20
1
2
3