Questions tagged [ignite]

Apache Ignite™ is a memory-centric distributed database, caching, and processing platform for transactional, analytical, and streaming workloads delivering in-memory speeds at petabyte scale. It provides high-performance, in-memory computing capabilities for large data sets.

What is Apache Ignite for?

Apache Ignite provides a framework for in-memory computing operations on large scale data sets. It supports the following features:

  • Memory-centric, strongly consistent, distributed storage
  • Distributed SQL - supports ANSI SQL in-memory and on-disk transactional database
  • Distributed Key-Value - supports in-memory and on-disk key-value transactional data grid
  • In-Memory Compute grid - supports collocated computations and executor services
  • In-Memory Service grid - supports clusters and compute contracts
  • In-Memory Streaming - supports data streaming services like Kafka
  • In-Memory File system - supports the IGFS (Ignite filesystem)

Apache Ignite architecture combines the performance and scale of in-memory computing together with the disk durability and strong consistency in one system. When native persistence is turned on, Ignite functions as a memory-centric system-of-record, where most of the processing happens in memory on cached data, but the superset of data and indexes gets persisted to disk.

When persistence is turned off, Ignite functions as a memory-only store, in which case it can be treated as a Distributed Cache, In-Memory Database (IMDB) or In-Memory Data Grid (IMDG).

Resources

2980 questions
6
votes
2 answers

Cluster wide connection resources management in Ignite, using Hikari

How can I manage resources on ignite. Given the application i am developing, i have a few connections that i used to keep, (JDBC/SAP/others). I used to keep all the connections in a pool and manage them using HIKARI. Now given that now I can have…
frewper
  • 1,385
  • 6
  • 18
  • 44
6
votes
2 answers

Is ignite cache thread safe?

I have plans to load cache concurrently from multiple threads. The simplest form of this would be: IgniteCache cache = ignite.getOrCreateCache("ints"); ExecutorService es =…
St.Antario
  • 26,175
  • 41
  • 130
  • 318
6
votes
3 answers

Apache Ignite vs redis cluster(use partition) vs other solution

Hi I looking for In memory data grid or similar one. My use case. Data griding in memory. scale out available. backup node available. persistent backup available. (optional) free or opensource solution I did googling and I found candidates below -…
moon
  • 165
  • 1
  • 3
  • 6
6
votes
3 answers

Ignite Server mode vs Client Mode

Ignite has two modes, one is Server mode, and the other is client mode.I am reading https://apacheignite.readme.io/docs/clients-vs-servers, but didn't get a good understanding of these two modes. In my opinion, there are two use cases: If the…
Tom
  • 5,848
  • 12
  • 44
  • 104
6
votes
1 answer

Apache Ignite vs. Apache Storm (in-depth)

Apache Ignite and Apache Storm are two rather different technologies in many aspects - especially since Storm has one very specific use-case, while Ignite has quite a large set of tools under one roof. As I understand it, the core of Ignite is its…
Make42
  • 12,236
  • 24
  • 79
  • 155
6
votes
1 answer

apache ignite query

I have created a cache using Automatic Persistence, connecting to Mysql database. 1 million rows are populated on startup into that node. Node is in PARTITIONED mode When I try retrieving data from that Cache using SQL queries, it always returns…
GGN
  • 85
  • 11
5
votes
1 answer

Apache Ignite: Caches unusable after reconnecting to Ignite servers

I am using Apache Ignite as a distributed cache and I am running into some fundamental robustness issues. If our Ignite servers reboot for any reason it seems like this breaks all of our Ignite clients, even after the Ignite servers come back…
Sovietaced
  • 133
  • 1
  • 11
5
votes
4 answers

How to fix "Could not initialize class org.apache.ignite.IgniteJdbcThinDriver" error in Apache Ignite?

The Problem I'm trying to connect to a Apache Ignite server with Apache Ignite built-in tool, SQLLine. I get the error: java.lang.NoClassDefFoundError: Could not initialize class org.apache.ignite.IgniteJdbcThinDriver Background I have Apache Ignite…
MoffeeCug
  • 63
  • 1
  • 5
5
votes
1 answer

Apache Ignite - (jvm-pause-detector-worker) Possible too long JVM pause:

After using apache ignite 2.6, I am getting this warning constantly on JBoss start and stop. Could you please help me to know whats wrong configuration will lead this warnings. Please let me know if you need any more details
Sanjay
  • 71
  • 1
  • 6
5
votes
1 answer

Using Ignite on JDK 9

I am having trouble using Ignite on JDK 9. I have the following minimal testcase: package no.ovstetun.ignite; import org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi; import org.junit.Test; public class FailingIgniteTest { @Test public…
5
votes
2 answers

KAFKA compared to modern In Memory Memory Data Grid (IMDG)

I have some IMDG experience I am rather new to KAFKA. I am trying to understand the use case for Kafka. I understand it is a streaming/messaging platform. A lot of its issues have some contra parts in the modern In Memory Data Grids. Can you shed a…
Alexander Petrov
  • 9,204
  • 31
  • 70
5
votes
2 answers

Apache Ignite as transparent cache for Postgresql tables

Is it possible to use Apache Ignite as transparent cache for several tables in PostgreSQL RDBMS and to query that cache using Ignite SQL? For example like this: Application (via SQL) ---> Apache Ignite (if data is not loaded) ---> Postgresql I'm new…
JohnGray
  • 656
  • 1
  • 10
  • 27
5
votes
3 answers

get Keys from IgniteCache

I have to get all keys stored in IgniteCache, unfortunately this method is not implemented in Ignite. I'm using java client. I thought it is a common method, what is the reason Ignite team didn't implement it? Is there any efficient solution for…
Forin
  • 1,549
  • 2
  • 20
  • 44
5
votes
1 answer

Ignite C++ and Cache Affinity

I am using Apache Ignite 1.8.0 for caching on a cluster. I am using the C++ API and am accessing the same cache from both Java and C++. This works fine but I would like to also use affinity collocation to execute tasks on the same node that has…
Sumit
  • 113
  • 8
5
votes
3 answers

Apache Ignite performance of multi-tenant approaches

I'm working in a project that must maintain a lot of records in cache (Apache Ignite), this records are divided by companies. Ex: Company; product; quantity CompA; A; 15 CompA; B; 10 CompB; A; 20 CompB; B; 12 My doubt is about performance between…
Ramon Rosa
  • 51
  • 2