Questions tagged [near-real-time]

31 questions
1
vote
1 answer

How to enable realtime search in Solr 4.0

I’m trying to enable realtime search in Solr 4.0 (So I can see new documents without committing). I’ve added: true But documents aren’t seen before commit (or softCommit). Any help will be…
Avner Levy
  • 6,601
  • 9
  • 53
  • 92
1
vote
0 answers

how can i use spring framework with lucene

all. i am a newbie of lucene, and i'm using spring-mvc (3.2.5.RELEASE) and lucene(4.6.0). both are newest version currently. how can i use NEAR REAL TIME search? i write this code to get instance of IndexWriter (sington) package…
Zhuo YING
  • 972
  • 3
  • 11
  • 19
0
votes
0 answers

Load data from a near real time Bigquery table to another near real time table in GCP

I'm working with another team, who has already achieved near real time (NRT) load in their GCP bigquery project dataset. The objective on our side is to utilize their NRT datasets to create another/several NRT tables on our side. This could involve…
0
votes
1 answer

Real Time Cluster Log Delivery in a Databricks Cluster

I have some Python code that I am running on a Databricks Job Cluster. My Python code will be generating a whole bunch of logs and I want to be able to monitor these logs in real time (or near real time), say through something like a dashboard. What…
0
votes
1 answer

Near real time streaming data from 100s customer to Google Pub/Sub to GCS

I am getting near-real time data from 100s of customers. I need to store this data in Google Cloud Storage buckets created for each customer i.e. /gcs/customer_id/yy/mm/day/hhhh/ My data is in Avro. I guess I can use Pub/Sub to Avro Files on Cloud…
0
votes
2 answers

The best realtime search platform for realtime indexing of large db?

I am building a site atm which requires realtime indexing of results (not 10,000 docs per second, I mean millisecond updates). I went anout researching the different techs and originally came up with dozens of different platforms. I have been able…
Sammaye
  • 43,242
  • 7
  • 104
  • 146
0
votes
3 answers

how can I use Solr to do real-time search

now we use deltaImport to update data from db to index. but we have some information need a real-time search or near real-time search. what should I do if I use solr to solve this?
Illu
  • 65
  • 9
0
votes
2 answers

why is spark streaming called near real time?

I know that spark streaming uses micro batches to process the data, but the processing is done in less than a second in some cases. My question is "Can't it be called pure real time processing rather than near real time processing in that senario?"
dalonlobo
  • 484
  • 4
  • 18
0
votes
2 answers

Real Time Notification for Angular 2 web app with asp.net web API back end

I am working on a web application (Angular 2 and Asp.net web API) that expected to be notified the user when some task has been created by another user(An entry on the Tasks table in the Database). Notification can be something similar to Facebook…
chenk
  • 392
  • 7
  • 27
0
votes
0 answers

online recommendation using mahout

How do I implement online recommendation using Mahout. i want to get recommendation from the mahout recommendation engine on real time using some mechanism like REST API. please share me any implementation idea Regards.
0
votes
2 answers

Solr suggester not available in near real time

I am having some trouble in showing results in near real time through the SOLR suggester.Although , if I try to use the search handler it is working properly for near real time search. If I add a document , I am able to retrieve that document in…
Ayan Biswas
  • 1,641
  • 9
  • 39
  • 66
0
votes
1 answer

Solr vs Elasticsearch on near real time search

I am confused with the near-real-time search ability of Solr and Elasticsearch. The near-real-time search is argued to be one of the advantages Elasticsearch has over Solr. However, I have read some documents of Solr saying that near-real-time…
Kuang Lu
  • 51
  • 1
  • 5
0
votes
1 answer

Lucene Near Realtime Search

I would like to improve the speed of my search system, by using some features like the "Near realtime search", making faster the opening of an index. Who can tell me what are the differences and advantages of using one or the other of the following…
Luca Mastrostefano
  • 3,201
  • 2
  • 27
  • 34
0
votes
3 answers

How can I programmatically realistically modify a video clip while playing?

A while ago I came across an interesting array of video presentations on a German company's website. They deal with modifying a video stream while it's playing, and I remained pleasantly impressed by the accuracy and smoothness of this technique.…
luvieere
  • 37,065
  • 18
  • 127
  • 179
0
votes
1 answer

Real-time or Near real-time analytics application design considerations

I am working on the design & implementation of a (near) real-time web-analytics engine. This is similar to Google Analytics and ChartBeat. Nearly 150M requests/day are expected. We have an availability of 5 to 8 machines with 2.5GHz (8 core) CPU and…
dvl
  • 741
  • 2
  • 8
  • 19