Questions tagged [ignite]

Apache Ignite™ is a memory-centric distributed database, caching, and processing platform for transactional, analytical, and streaming workloads delivering in-memory speeds at petabyte scale. It provides high-performance, in-memory computing capabilities for large data sets.

What is Apache Ignite for?

Apache Ignite provides a framework for in-memory computing operations on large scale data sets. It supports the following features:

  • Memory-centric, strongly consistent, distributed storage
  • Distributed SQL - supports ANSI SQL in-memory and on-disk transactional database
  • Distributed Key-Value - supports in-memory and on-disk key-value transactional data grid
  • In-Memory Compute grid - supports collocated computations and executor services
  • In-Memory Service grid - supports clusters and compute contracts
  • In-Memory Streaming - supports data streaming services like Kafka
  • In-Memory File system - supports the IGFS (Ignite filesystem)

Apache Ignite architecture combines the performance and scale of in-memory computing together with the disk durability and strong consistency in one system. When native persistence is turned on, Ignite functions as a memory-centric system-of-record, where most of the processing happens in memory on cached data, but the superset of data and indexes gets persisted to disk.

When persistence is turned off, Ignite functions as a memory-only store, in which case it can be treated as a Distributed Cache, In-Memory Database (IMDB) or In-Memory Data Grid (IMDG).

Resources

2980 questions
5
votes
1 answer

indexed Apache Ignite cache vs. optimized, in-memory CassandraDB

For a complex real-time Apache Storm topology I need aggregates of my data (stored in CassandraDB) for some computation steps. So far the data is queried when needed with CQL (Cassandra Query Language) and aggregated in a Storm bolt. That is a bit…
Make42
  • 12,236
  • 24
  • 79
  • 155
5
votes
2 answers

Apache Ignite Loading Twice with Spring-Boot?

I'm prototyping something with Spring-Boot 1.2.7.RELEASE and Apache Ignite 1.4.0 and noticed something a little odd, maybe it's a just a logging configuration. It looks like Apache Ignite is trying to start twice with Spring? If I comment out the…
szxnyc
  • 2,495
  • 5
  • 35
  • 46
5
votes
1 answer

Apache Ignite indexing performance

I have a cache with string as a key and TileKey (class below) as a value, I've noticed that when I execute a query (below) the performance is affected almost linearly by the cache size even though all the fields that are used in the query are…
Black0ut
  • 1,642
  • 14
  • 28
4
votes
1 answer

Apache Ignite Load balancing Ignite Service on a single node not working?

Ignite cluster node does not perform load balancing on multiple instances of a service deployed on it. I have a single node Ignite cluster, on which I have deployed a service, using deployMultiple method. final var igniteServices =…
4
votes
2 answers

Apache Ignite - Partition Map exchange causes deadlock when used with write through enabled cache

We have Ignite running in server mode in our JVM. Ignite is going into deadlock in following scenario. I have added the thread stack at the end of this question a.Create a cache with write through enabled b.In CacheWriter.write() implementation …
4
votes
1 answer

Apache Ignite - select query returns 0 records but data exists in cache

We are using Apache Ignite 2.9.0. Its a 5 node cluster with Zookeeper discovery. We create table in Ignite by executing DDL statements from Intellij. Then we are able to see all data by running select queries from Intellij itself. Today after wiping…
Shades88
  • 7,934
  • 22
  • 88
  • 130
4
votes
1 answer

Apache Ignite Frequent Cache Close Exception

We are using Apache Ignite as a cache for speeding up our Authorization and Permission calls. During the application load on a client, the application hits Ignite cache with around 18 times with get calls and during this period, we get frequent…
4
votes
1 answer

Can Spark executors be spawned in already running java process (Ignite JVM)

I am working on a project where I need to share execution state across different spark application. I decided to go with apache-ignite as a shared memory storage between different spark application. I was thinking of going with embedded ignite mode…
Amar Gajbhiye
  • 484
  • 5
  • 17
4
votes
1 answer

Failed to retrieve Ignite pods IP addresses

I am trying to run apache ignite cluster using Google Kubernetes Engine. After following the tutorial here are some yaml files. First I create a service - ignite-service.yaml apiVersion: v1 kind: Service metadata: # Name of Ignite Service used by…
wadhwasahil
  • 468
  • 7
  • 28
4
votes
1 answer

Apache Ignite vs Apache Kafka

A bit of n00b question. If I were to use Apache Ignite for Messaging and Events, is there still a need for using Kafka? Essentially what (if any) additional Features would Kafka give me over Ignite? Thanks in advance
sigmazen
  • 223
  • 2
  • 4
  • 14
4
votes
1 answer

Does Hazelcast supports SQL queries like Apache Ignite?

Looking for comparison with Apache Ignite - does Hazelcast have SQL support?
Joe
  • 11,983
  • 31
  • 109
  • 183
4
votes
1 answer

How to clean Apache Ignite caches and sort of start over?

I have a 3 node ignite cluster and 1 client that creates cache. During the development and testing, I had to stop the cluster or interrupt the cache building several time and the entire system is broken now. Only one node starts and the other nodes…
Sam
  • 133
  • 3
  • 12
4
votes
1 answer

"Failed to deserialize object" Error occured while inserting object in ignite cache

The following error occurred while inserting a pojoClass object on a string key. I have included all event types in the Ignite configuration. I have tried setStoreKeepBinary(true) and also tried igniteConfiguration.setPeerClassLoadingEnabled(true)…
Rhishi
  • 275
  • 2
  • 14
4
votes
1 answer

Ignite Cache Reconnection Issue (Cache is stopped)

Currently we are using Ignite 2.1 and Spring Data Ignite Repository. I have a server node and a client node with one cache "TestCache". When client is connected to server, and server node is down, it will disconnect. When the server node is started…
Cheng
  • 171
  • 3
  • 14
4
votes
1 answer

Caching ignite client node

I'm writing a back-end application which is supposed to receive request from clients and perform some operations with ignite cache. The issue is I need low-latency response time and recreating Ignite client node to perform some operation with cache…
St.Antario
  • 26,175
  • 41
  • 130
  • 318