Questions tagged [google-cloud-datalab]

An online tool for data analysis provided by Google as part of its Cloud Platform.

An easy to use interactive tool for large-scale data exploration, analysis, and visualization.

See more at https://cloud.google.com/datalab.

468 questions
3
votes
1 answer

Running machine learning locally. Should I use local instance of Datalab, or Jupyter?

I'm doing some machine learning and data analysis on data from Google Analytics and other sources. I've managed to deploy Cloud Datalab locally and connect to my BigQuery, however I am not sure if this is the best way to do things. I can see that…
Tom
  • 113
  • 1
  • 5
3
votes
2 answers

Reading batches of data from BigQuery into Datalab

I have a big dataset in BigQuery table (~45M lines, 13Gb of data). I would like to process that data in my Google Datalab Notebook to do some basic statistics with pandas to visualise data later with matplotlib in Datalab cell. I think it is not a…
3
votes
2 answers

How can I get an interactive shell inside a Google datalab container?

I need to install additional software in a Google datalab container that runs with docker. It is possible to run bash commands with %%bash .... However, this does not allow interactivity. So, I need an interactive shell within the container.
Soerendip
  • 7,684
  • 15
  • 61
  • 128
3
votes
1 answer

Datalab cannot see symlink in tree view

I started a Datalab server on GCE using the quickstart guide. Then I created an additional disk, mounted it with these instructions and created a symlink in /root/datalab which points to a folder on that disk. However, I cannot access its…
Robert Lacok
  • 4,176
  • 2
  • 26
  • 38
3
votes
2 answers

How can I get the Cloud ML service account programmatically in Python?

The Cloud ML instructions show how to obtain the service account using shell commands. How can I do this programmatically in Python? e.g. in Datalab?
Jeremy Lewi
  • 6,386
  • 6
  • 22
  • 37
3
votes
2 answers

How to run Google Datalab locally?

How do I run Datalab locally when it requires Docker (and Docker Toolbox is not supported as documented here: https://cloud.google.com/datalab/docs/quickstarts/quickstart-local)? The Docker website says Docker requires Windows 10 Professional or…
3
votes
2 answers

Access to Google Cloud Datalab Fails with ssh Error

Trying to access Google Cloud Datalab server with: docker run -it -p "127.0.0.1:8081:8080" -v "${HOME}:/content" -e "GATEWAY_VM=mltensorflow-1470671201129/us-east1-b/vm-instance-name" gcr.io/cloud-datalab/datalab:local as per Run Cloud Datalab on…
3
votes
3 answers

Datalab: moving notebook to other folder

I made a copy of a notebook in datalab. But instead of having the copy in the same folder - it was created at the root folder. That is probably a bug that needs to get fixed. In the mean time I tried to move the file to the right folder but the…
MichałK
  • 33
  • 3
3
votes
1 answer

How to add 'private' python module to Google Datalab

I'm experimenting with the promising Google Cloud Datalab. In the past I've created some handy python classes and functions that I'd like to use in the GCD-notebooks but I don't know how to add my code. Anybody any suggestions?
bowlby
  • 649
  • 1
  • 8
  • 18
2
votes
0 answers

How to connect Google Sheets from Google Cloud Datalab using Python SDK and service account?

I'm trying to fetch data from a shared Google Sheet using Python SDK from Google Cloud Datalab. I did the following: Created a new Notebook on Google Cloud Datalab Obtained a service account which is used by the Notebook, as described on the Key…
2
votes
2 answers

Importing gcsfs in datalab is giving an error

When I import gcsfs in datalab, import gcsfs I've this invalid syntax error which is related to the package fsspec. Is it something to do with versions File "/usr/local/envs/py3env/lib/python3.5/site-packages/IPython/core/interactiveshell.py",…
Ybooks
  • 21
  • 3
2
votes
2 answers

Is there a way to load data from a csv file in google cloud storage into separate variables in datalab?

I used to access data from a CSV file in my local directory using Jupyter Notebook, however, now I want access a CSV file that is stored in google cloud storage via datalab. This is the part of the function as I used to run it: def…
Kiki
  • 21
  • 4
2
votes
1 answer

Integration with Dataproc + Datalab + Source Code repos

Can someone been able to integrate Dataproc,Datalab and Source code repo? As many of us have seen that when you call an init action to install datalab, it does not create the source code repo. I am trying to achieve a full end-to-end solution where…
2
votes
2 answers

Where is the /datalab/notebooks directory created on the Dataproc master?

I am spinning up short lived clusters and destroying them as soon as the purpose is served. However, I would like to persist my notebooks created in /datalab/notebooks directory and then copy them to the same directory when a new cluster is created,…
2
votes
0 answers

Cloud ML Notebooks vs Cloud Datalab

Can anyone please help me find the differences between these 2 google products? Cloud ML Notebooks Cloud Datalab In which cases should I use one or the other? Thanks!
Gabriel
  • 809
  • 1
  • 10
  • 21