Questions tagged [elasticsearch-hadoop]

Elasticsearch real-time search and analytics natively integrated with Hadoop. Supports Map/Reduce, Cascading, Apache Hive, Apache Pig, Apache Spark and Apache Storm.

Elasticsearch real-time search and analytics natively integrated with Hadoop.

Supports Map/Reduce, Cascading, Apache Hive, Apache Pig, Apache Spark and Apache Storm.

Requirements

Elasticsearch (0.9X series or 1.0.0 or higher (highly recommended)) cluster accessible through REST. That's it! Significant effort has been invested to create a small, dependency-free, self-contained jar that can be downloaded and put to use without any dependencies. Simply make it available to your job classpath and you're set. For a certain library, see the dedicated chapter.

Documentation

109 questions
0
votes
1 answer

Automated insertion from Hive to Elasticsearch

I currently try to find a way to automatically add data from Hadoop text files into elasticsearch. We are running HIVE v0.11, Hadoop v2.0.5, Elasticsearch 1.7.1 and elasticsearch-hadoop v2.1.0 The files are stored in different subfolders below the…
Seeron
  • 53
  • 8
0
votes
1 answer

elasticsearch-spark indexing error : Cannot handle type Map within Map using ScalaValueWriter

I'm trying to index data in elasticsearch using elasticsearch-spark-2.1.0 with spark-1.3.1, but I'm getting the following error: org.elasticsearch.hadoop.serialization.EsHadoopSerializationException: Cannot handle type [class…
kolam
  • 731
  • 4
  • 17
0
votes
1 answer

sparkR 1.4.0 : how to include jars

I'm trying to hook SparkR 1.4.0 up to Elasticsearch using the elasticsearch-hadoop-2.1.0.rc1.jar jar file (found here). It's requiring a bit of hacking together, calling the SparkR:::callJMethod function. I need to get a jobj R object for a couple…
-2
votes
1 answer

Do I have to install Hadoop in order to use Elasticsearch ES-Hadoop connector

I have Elasticsaerch cluster and want to use Apache Spark to run computations on it. The ES-Hadoop connector contains a Spark library that can run computations on Elasticsearch. Do I have to install Hadoop first or can I just put…
1 2 3 4 5 6 7
8