Questions tagged [alpakka]

Alpakka is the collective name for various Akka Streams connectors, integration patterns, and data transformations.

Alpakka is a community-driven initiative that provides connectors, integration patterns, and data transformations that are built with Akka Streams. This toolkit is meant to be a "modern alternative to Apache Camel" (hence its name, which is a homophone of "alpaca," a relative of the camel, and was first used as a code name for an old akka-camel module).

From an introductory blog post:

Akka Streams already has a lot that are useful for integrations. Defining processing pipelines is what the Akka Streams DSL is all about and that is exactly what you need for operating on streaming data that cannot fit in memory as a whole. It handles backpressure in an efficient non-blocking way that prevents out-of-memory errors, which is a typical problem when using unbounded buffering with producers that are faster than consumers.

Connectors:

  • AMQP
  • Apache Geode
  • AWS DynamoDB
  • AWS Kinesis
  • AWS Lambda
  • AWS S3
  • AWS SNS
  • AWS SQS
  • Azure Storage Queue
  • Cassandra
  • Elasticsearch
  • File
  • FTP
  • Google Cloud Pub/Sub
  • HBase
  • IronMq
  • JMS
  • MongoDB
  • MQTT
  • Server-sent Events (SSE)
  • Slick (JDBC)
  • Spring Web

Integration Patterns:

  • Splitter

Data Transformations:

  • Parsing Lines
  • JSON
  • Compressing/decompressing
  • Comma-Separated Values (CSV)
  • RecordIO Framing
  • Extensible Markup Language (XML)

Additional Links:

217 questions
0
votes
1 answer

How to insert case objects to mysql with alpakka slick connector

I'm writing some code to insert data into MySQL. I've decided to use Alpakka Slick Connector. Using that example: https://developer.lightbend.com/docs/alpakka/latest/slick.html#using-a-slick-flow-or-sink I've successfully added data to DB, but it…
Mateusz Gruszczynski
  • 1,421
  • 10
  • 18
0
votes
1 answer

Does actor/agent system make iPaaS redundant?

Let's assume, that I have application, that uses Akka (possibly with Alpakka and/or Lagom). Can I still benefit from iPaaS like Red Hat JBoss Fuse? If yes, what is that benefit? If no, that how is called part of actor system that is an alternative…
spam
  • 1,853
  • 2
  • 13
  • 33
0
votes
1 answer

FileTailSource throws null pointer exception

I wrote the following Alpakka code val fs = FileSystems.getDefault val resource = getClass.getResource("countrycapital.csv") val source = FileTailSource.lines(Paths.get(resource.toURI), maxLineSize = 8092, pollingInterval = 10000 seconds) I have a…
Knows Not Much
  • 30,395
  • 60
  • 197
  • 373
0
votes
1 answer

Alpakka Cassandra Flow Usage

I am reading the documentation of Alpakka Cassandra here It makes it very easy to use Cassandra as a source and a sink. but what about flow usage. By flow usage I mean is that I am not using Cassandra as a source or a sink. but to Lookup Data. is…
Knows Not Much
  • 30,395
  • 60
  • 197
  • 373
0
votes
0 answers

Create AMQP queue in exchange with Alpakka

I want to create a queue within an existing exchange for reading. Another application is publishing messages to this exchange and fanning them out to all member queues. I want my new application to be an additional subscriber to these messages. The…
Synesso
  • 37,610
  • 35
  • 136
  • 207
0
votes
1 answer

Durable subscriber with JMS Connector Alpakka

Using Alpakka, we can create a non-durable subscriber for any topic using the below code: Source jmsTopicSource = JmsSource .textSource(JmsSourceSettings .create(connectionFactory) .withTopic("topic") …
NiranjanK
  • 427
  • 2
  • 6
  • 23
-1
votes
1 answer

Consume messages from IBM JMS queue with Alpakka

There are 100 message in IBM queue (insert_queue). I want to consume 10 and store in a object and process 10 consumed message and wait for some time, then acknowledge the 10 consumed messages. My sample code: public void consume(String queueName,…
1 2 3
14
15