Stack Overflow
Stack Overflow

Questions tagged [spark-notebook]

The Spark Notebook is a web application enabling interactive and reproductible data analysis using Apache Spark from the browser

120 questions
1
vote
1 answer

How to load library/ maven dependency in AWS EMR notebook

I am using AWS notebook. I can run normal scala based spark jobs without third-party library dependency fine. But I want to load some common libraries like typesafe-config, mysql-connector etc. How can I add these library dependency in scala spark…
Jeevan
  • 8,532
  • 14
  • 49
  • 67
1
vote
1 answer

What's the default location for Zeppelin notebooks in the Windows file system?

On a fresh Win10 machine with fresh docker, the following command instantiates Zeppelin: docker run -p 8080:8080 --rm --name zeppelin apache/zeppelin:0.8.1 ... allowing me to create a new notebook using the GUI at http://localhost:8080/#/ ... but…
olisteadman
  • 442
  • 6
  • 12
1
vote
0 answers

Spark Scala - Connect to MySQL over SSH using Key Pair

I wanted to understand if there is a method one can connect to MySQL database over SSH using Private-Public Key pair using Spark notebook for scala? I have been trying to modify this code to no avail Connect to MySQL over SSH using Java
Leothorn
  • 1,345
  • 1
  • 23
  • 45
1
vote
1 answer

How to access ZeppelinContext in sql interpreter

I am writing a Zeppelin notebook that has two paragraphs. The first paragraph is a scala notebook that defines some default values to be used in later notebooks. For eg In the first paragraph if I define %scala var table_name = "my_table" …
Sreenath Kamath
  • 663
  • 1
  • 7
  • 17
1
vote
2 answers

How to import notebook from local machine to Azure Databricks portal?

How to import notebook from local in Azure Databricks? I have sample notebook in DBC format on my local machine and I need to import via Notebook Rest API. curl -n -H "Content-Type: application/json" -X POST -d @-…
dwayneJohn
  • 919
  • 1
  • 12
  • 30
1
vote
0 answers

Spark Notebook Oops, an error occured

I downloaded spark notebook from http://spark-notebook.io/. I have spark-notebook-0.7.0-scala-2.10.6-spark-2.0.1-hadoop-2.7.2. It works on my laptop where I have Ubuntu 14.04. But the same notebook doesn't run on my desktop where I also have Ubuntu…
Abu Shoeb
  • 4,747
  • 2
  • 40
  • 45
1
vote
1 answer

dynamic interactive dashboard with zeppelin notebook

I want to have a more interactive dashboard. like reading the data from database , giving it to select box, onchange of select box send the value and run the query. i want to achieve this using zeppelin bcz on selected value i have to display the…
Priyanka D L
  • 171
  • 1
  • 8
1
vote
1 answer

Spark exception after re-submitting stopped application

I'm running a Spark job (from a Spark notebook) using dynamic allocation with the options "spark.master": "yarn-client", "spark.shuffle.service.enabled": "true", "spark.dynamicAllocation.enabled":…
Raphael Roth
  • 26,751
  • 15
  • 88
  • 145
1
vote
0 answers

Disable rightclick on Zeppelin notebook

I am using Zeppelin 0.6.0 notebooks on my dashboard. I am embedding notebooks in an iframe, a simple HTML page. I want to disable the right click on my dashboard. I can disable right click outside the iframe area, but I cannot disable it inside…
Priyanka D L
  • 171
  • 1
  • 8
1
vote
0 answers

Freshly-installed spark-notebook is missing SQL widget

I just installed spark-notebook on some old PCs where a test Spark cluster is running. I created a notebook from the following template: { "Simple" : { "profile" : "standalone", "name" : "Simple Test Spark Cluster", "status" :…
rabejens
  • 7,594
  • 11
  • 56
  • 104
1
vote
0 answers

Instructions on installing Tachyon in DCOS (Mesosphere)?

I have spark-notebook setup in DCOS. Tachyon is part of the ecosystem. But I couldn't find any DCOS-way instructions on getting Tachyon installed. I could install it from scratch but there seems to be some DCOS-compliance way to get a service…
1001b
  • 265
  • 3
  • 13
1
vote
1 answer

How to make Bluemix Object Storage associated with my Spark service available to other users

I have Bluemix Spark notebooks that I want to share with others. I'd like them to be able to run the notebooks using data on the object storage associated with my Spark instance (so they don't need to load the data themselves). I'm using the…
Rich Tarro
  • 41
  • 2
1
vote
1 answer

Scheduler for jobs executing Apache Spark SQL on Bluemix

I am using Apache Spark in Bluemix. I want to implement scheduler for sparksql jobs. I saw this link to a blog that describes scheduling. But its not clear how do I update the manifest. Maybe there is some other way to schedule my jobs.
YAKOVM
  • 9,805
  • 31
  • 116
  • 217
1
vote
0 answers

java.lang.IllegalArgumentException when starting apache spark notebook

When attempt to run spark-notebook.bat I receive below exception : SLF4J: Actual binding is of type [ch.qos.logback.classic.util.ContextSelectorSta ticBinder] [warn] application - Start local micro tachyon Oops, cannot start the…
blue-sky
  • 51,962
  • 152
  • 427
  • 752
1
vote
2 answers

Evaluating Spark-Notebook

I am evaluating Spark Notebook and found three different products; 1. Hue 3.9 comes with Spark notebook (beta) 2. Apache zeppelin 3. andypetrella/spark-notebook. Can you please help me understand pros and cons of each product Thanks Pani
Pani Dhakshnamurthy
  • 233
  • 3
  • 8
1 2 3
4
5 6 7 8