Stack Overflow
Stack Overflow

Questions tagged [azure-hdinsight]

Questions about Azure HDInsight, is a managed Apache Hadoop service that lets you run Apache Spark, Apache Hive, Apache Kafka, Apache HBase, and more in the Microsoft Azure cloud.

Azure-HDInsight is a managed Apache Hadoop service that lets you run Apache Spark, Apache Hive, Apache Kafka, Apache HBase, and more in the cloud.

934 questions
-1
votes
1 answer

HDInsight HBASE REST request fails (within Vnet)

I try to send a REST Request to my HDInsight HBase database from a node.js application within a VNET in azure. I'm able to ping the corresponding HDInsight HBase Server on its IP adress but its not possible to ping the headnode based on the DNS…
Andreas
  • 1
  • 2
-1
votes
2 answers

Tweets Streaming Service unable to write to HBase table on Azure HDInsight HBase cluster

I am following Microsoft's official Azure documentation: Analyze real-time Twitter sentiment with HBase in HDInsight tutorial to create a simple real-time tweets streaming service which will write tweets into a HBase table hosted on Azure HDInsight…
juvchan
  • 6,113
  • 2
  • 22
  • 35
-1
votes
1 answer

org.apache.hadoop.mapred.lip.input.invalidInputException

i run this code in power shell by following the steps and commands for pwer shell in this tutorial. i just change the name from WordCount to Matrix. all the steps work fine, But i get this error after run the Azure PowerShell script: exception…
juliana
  • 23
  • 5
-1
votes
2 answers

HDInsight - Azure blob storage

I have some basic clarifications about azure hdInsight. The following article gives some basic input on using hdinsight. https://azure.microsoft.com/en-in/documentation/articles/hdinsight-hadoop-emulator-get-started/. It says that HDinsight…
user1400915
  • 1,933
  • 6
  • 29
  • 55
-1
votes
1 answer

External Hive tables needing load step

I want to write directly to log files in blog storage from my app and then run hive queries over these log files. Am i correct in thinking i can create external hive tables which use these files directly. Do i still need to run a load step ie LOAD…
Jules
  • 1,071
  • 2
  • 18
  • 37
-1
votes
1 answer

WindowsAzure Assembly not found while downloading Hive output on HDInsight

The following script runs a hive job from my local machine running Windows 8.1 and copies the output to a local file. It has been working fine up to now, but after upgrading to Windows 10 it is erroring out when I call Get-AzureHDInsightJobOutput. I…
Mike Wise
  • 22,131
  • 8
  • 81
  • 104
-1
votes
1 answer

How to use Zookeeper with Azure HDInsight Linux cluster?

Obviously I need to start a zookeeper server on one of the cluster machines, then I need other client machines to connect to this server. The way I did it is that I used ssh to connect to the headnode, I found a zk server running on the port 2181.…
Moustafa Meshry
  • 60
  • 7
-1
votes
1 answer

Azure HDInsight Setup Fail

Basically following the tutorial here: http://azure.microsoft.com/en-us/documentation/articles/hdinsight-provision-clusters/ I stepped through creating a database in the south central us region, storage account, everything. After a while I get the…
Snowy
  • 5,942
  • 19
  • 65
  • 119
-1
votes
1 answer

Where is Interactive JavaScript console - HDInsight

I can't find in my cluster manager the option "Interactive JavaScript console". How can I get it?
Pai Mei
  • 1
-1
votes
2 answers

MapReduce to count occurrences of pairs

I am new to MapReduce and would like your opinion on the best MapReduce approach for the following task. I have a single large document in the format 1 2 3 2 2 3 4 5 Each line has a list of numbers. I want to list each possible (pair) combination…
user628904
  • 726
  • 1
  • 7
  • 20
-2
votes
1 answer

HDInsight How Many VM's required?

On this page, they mentioned what minimum server required. But didn't mention how many VM required. For example minimum how many head nodes required and how many worker nodes required for HBASE? Please advice
user1960808
  • 112
  • 4
-2
votes
2 answers

Error in creating HDInsight cluster through arm template

I am trying to create HDInsight cluster through arm template. I have uploaded 2 files in blob storage called template_customized.json & parameters.json. For passing password parameters, I have used key vault concept. If I manually hardcode the…
praj hegde
  • 15
  • 6
-2
votes
1 answer

Error reading csv file in Azure HDInsight Blob Store.

Jupyter note book gives the following error. u'Path does not exist: wasb://spk123-2018@dreamcatcher.blob.core.windows.net/data/raw-flight-data.csv; The csv file does exist in the blob store of Azure HDInsight
George Varghese
  • 1
-2
votes
1 answer

create HDInsight Hadoop Cluster with Data Lake Store

I am new user of azure,i want to connect a data lake with HDinsight, I followed the instructions on azure documentation, but when i try to chose to connect a created data lake with HDinsight, i have this error Invalid emplacement. Can you help me…
sam Black
  • 33
  • 2
  • 10
-2
votes
1 answer

How to get number of worker, cores, ram from HDI cluster

Here is my scenario. I am creating HDI cluster and installing my custom application using ARM template. I need following values to be configured for my application using Shell script. Installing my application using CustomScript option in ARM…
Galet
  • 5,853
  • 21
  • 82
  • 148
1 2 3
…
62
63