Stack Overflow
Stack Overflow

Questions tagged [data-science-experience]

IBM Data Science Experience is an interactive, collaborative, cloud-based environment where data scientists can use multiple tools to activate their insights.

IBM Data Science Experience is an interactive, collaborative, cloud-based environment where data scientists can use multiple tools to activate their insights.

Source: http://datascience.ibm.com/blog/welcome-to-the-data-science-experience/

261 questions
1
vote
1 answer

how to access spark history server from DSX?

I need to access the Spark History Server so that I performance tune a slow spark job. I was looking for a link within DSX but could not find one, so I have opened up the spark service in the Bluemix console and have navigated to the spark history…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
1
vote
2 answers

lambda rdd.map gives: TypeError: unsupported operand type(s) for -: 'Row' and 'float'

rdd.map gives: TypeError: unsupported operand type(s) for -: 'Row' and 'float' I create an rdd from a dataframe using: temprdd = df.select('results').rdd Then I want to do a calculation on all the objects in it (basically in my 'results' column…
amadain
  • 2,724
  • 4
  • 37
  • 58
1
vote
1 answer

How to handle input file with non standard delimiters in dsx ml pipeline?

I'm trying to work with a data set that has no header and has :: for field delimiters: ! wget --quiet http://files.grouplens.org/datasets/movielens/ml-1m.zip ! unzip ml-1m.zip ! mv ml-1m/ratings.dat . ! head ratings.dat The…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
1
vote
1 answer

How to add spark packages to Spark R notebook on DSX?

The spark documentation shows how a spark package can be added: sparkR.session(sparkPackages = "com.databricks:spark-avro_2.11:3.0.0") I believe this can only be used when initialising the session. How can we add spark packages for SparkR using a…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
1
vote
1 answer

how to remove yourself from a Watson Studio (formerly DSX) project?

It is possible for users to add you to a Watson Studio project, however, after a while you can end up belonging to a lot of other projects. How can you remove yourself from another project? Is it possible to do this, or do you need to contact the…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
1
vote
2 answers

Converting sensor tag data in DSX

I'm working on converting the existing recipe for Data Science Experience (DSX) to use data from a connected Sensor Tag device. However the mobile applications for that device send the data as strings rather than numerics - this is causing the DSX…
Skilganon
  • 33
  • 4
1
vote
2 answers

Programmatically determine if running in DSX

How can I programmatically determine if the python code in my notebook is running under DSX? I'd like to be able to do different things under a local Jupyter notebook vs. DSX.
Kendrick Wong
  • 394
  • 1
  • 12
1
vote
1 answer

DSX notification if scheduled notebook does not run?

I'm trying to troubleshoot an hourly scheduled notebook as per this question: How to troubleshoot a DSX scheduled notebook? When listing the kernel logs I noticed at 3am the notebook was not…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
1
vote
3 answers

How to troubleshoot a DSX scheduled notebook?

I have a DSX notebook that I can run manually usng the DSX user interface and it populates some data in a Cloudant database. I have scheduled the notebook to run hourly. Overnight I would have expected the job to have run many times, but the…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
1
vote
2 answers

Spark-cloudant package 1.6.4 loaded by %AddJar does not get used by notebook

I'm trying to use the latest spark-cloudant package with a notebook: %AddJar -f https://github.com/cloudant-labs/spark-cloudant/releases/download/v1.6.4/cloudant-spark-v1.6.4-167.jar Which outputs: Starting download from…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
1
vote
1 answer

IBM Watson Studio Notebooks on Safari, sometimes shows `Connection Failed`or `Kernel Dead`

In IBM Watson Studio while using Notebooks (Python, R, Scala) on Safari browser, sometimes the notebook is not connected to the kernel and after several retries shows Connection Failedor Kernel Dead. Refreshing the browser window does not help. In…
Sumit Goyal
  • 575
  • 3
  • 16
1
vote
2 answers

How do I connect to DashDB from a Jupyter Notebook within Watson Studio?

I'm trying to pull some data in from a DashDB database and analyze it within a Jupyter Notebook, all within the Watson Studio. Ideally we would create a Pandas Dataframe for analysis.
Matt
  • 5,800
  • 1
  • 44
  • 40
1
vote
2 answers

unable to save changes in jupyter notebook on DSX

Occasionally, I'm unable to save changes to my notebook in DSX. I believe this is because my session has timed out. How can I prevent my changes from being lost?
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
1
vote
1 answer

matplotlib - ImportError: No module named _tkinter

I have a simple notebook with the following code: %matplotlib inline However, when running it I get the following error: ImportError: No module named _tkinter I have another notebook in the same project, and that one is able to run the statement…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
1
vote
1 answer

How to list the pre-installed Python packages on IBM's Spark service

Update August 2019: This question is no longer relevant. It refers to a retired Apache Spark as a Service offering. Current Spark backends in Watson Studio use a different technology. In a Python notebook, I can execute !pip freeze to get a list of…
Roland Weber
  • 1,865
  • 2
  • 17
  • 27
1 2 3
…
17 18