Questions tagged [google-cloud-datalab]

An online tool for data analysis provided by Google as part of its Cloud Platform.

An easy to use interactive tool for large-scale data exploration, analysis, and visualization.

See more at https://cloud.google.com/datalab.

468 questions
2
votes
1 answer

How do I use cv2.imread on a file stored in Google Cloud Storage?

Say I have a picture titled sunset.jpg stored at the following URL on google cloud storage gs://example-bucket/testing_data so the full URL for the image is: gs://example-bucket/testing_data/sunset.jpg If I then do something like: image =…
2
votes
1 answer

New Notebook Not Loading on fresh datalab create ${MY_VM}

I attempted the upgrade to the Datalab 1.2.20170525 version today. I used the following: datalab delete ${MY_OLD_VM} datalab create ${MY_NEW_VM} After the instance comes up. I SSH into 8081 and get the GUI dir listing. Whether I click "Notebook"…
Brian F
  • 107
  • 1
  • 7
2
votes
1 answer

Datalab create a BigQuery UDF returning a STRUCT

When using Google Cloud DataLab, I am struggling to create a UDF that returns a STRUCT. As a minimal example, if I do this in a datalab notebook: %bq udf -n demo -l js // Some fn description // @param x FLOAT64 // @returns STRUCT var…
Stewart_R
  • 13,764
  • 11
  • 60
  • 106
2
votes
1 answer

How to query a BigQuery table from DataLab notebook using google.datalab.bigquery?

I have the following code in DataLab notebook: import google.datalab.bigquery as bq %bq query SELECT count(id) FROM 'rtda.tweets' It returns the error: invalidQuery: Syntax error: Unexpected string literal 'rtda.tweets' at [1:23] The BiqQuery…
2
votes
2 answers

Import OpenCV in Google Cloud Datalab

How to import OpenCV in GCP? I'm using Google Datalab here. It looks like I can install the package: !pip install opencv-python Collecting opencv-python Downloading opencv_python-3.2.0.7-cp27-cp27mu-manylinux1_x86_64.whl (6.7MB) 100%…
2
votes
1 answer

Feeding tf.contrib.learn inputs into DNNClassifier

I am new to tensor flow and stackoverflow, so apologies in advance for any silly errors. I've had good success in feeding the lower level interfaces. So I decided, to give the tf.contrib.learn higher level apis a try because it looked so easy. …
Brian F
  • 107
  • 1
  • 7
2
votes
2 answers

Is it possible to set a static external IP address in Cloud Shell?

I'm using Cloud Shell within Google Cloud Console to connect to my Google Cloud Datalab GCE VM using these instructions. I have a firewall on my Google Cloud Datalab GCE VM that restricts SSH access to certain IP addresses only. The problem I have…
Anthonios Partheniou
  • 1,699
  • 1
  • 15
  • 25
2
votes
3 answers

fail to create repository [datalab-notebooks] for Project

Try to create a datalab session following this page: https://cloud.google.com/datalab/docs/quickstarts $ datalab create junlab ERROR: (gcloud.alpha.source.repos.create) Failed to create repository [datalab-notebooks] for Project…
2
votes
2 answers

Datalab: How to export Big Query standard SQL query to dataframe?

Within a datalab notebook it's possible to export BiqQuery results directly into a dataframe. I have an example that works for legacy SQL and I need to adjust to make it work for standard SQL. I can't find a syntax that works for this. Here's what I…
goose
  • 2,502
  • 6
  • 42
  • 69
2
votes
2 answers

how to activate python3 in Google-cloud-data

I am using Python3 for my projects. However, the Google Cloud Datalab runs with Python2.7.x by default. How do I change to Python3?
2
votes
2 answers

Fastest way to read big amounts of data in Google Datalab?

I have ~40GB of data split in several json files and stored in Google Storage. I want to read all this data as a dataframe in Datalab to perform some analysis. So far, I read my data according to Datalab tutorials but it takes 1-2 hours. Any…
Ric cez
  • 31
  • 1
2
votes
1 answer

Google Cloud datalab error querying BIgQuery tables

I think I am missing something basic here, can't seem to figure out what it is.. Querying BigQuery date partitioned table from Google cloud datalab. Most of the other queries fetches data as expected, not sure why in this particular table, select…
Tim S
  • 185
  • 1
  • 13
2
votes
2 answers

Google cloud datalab setup guide is not working for me

seokwoong_chang@cellular-hold-144901:~$ gcloud compute ssh --quiet \ --project "cellular-hold-144901" \ --zone "asia-east1-a" \ --ssh-flag="-N" \ --ssh-flag="-L" \ --ssh-flag="localhost:8081:localhost:8080" \ …
2
votes
2 answers

gcp.bigquery reference page not available any more?

I have been using gcp.bigquery python module in datalab for a long time, and the reference page is very helpful. It contains all the attributes and methods for BigQuery jobs, datasets, tables, clients, and so…
2
votes
2 answers

time partitioned BigQuery tables

Does Google Datalab support time partitioned BigQuery table's specific partition as query result destination tables ? For example: from gcp import bigquery as bq queryString = 'SELECT "a1" AS col1' tabNam =…
shyam
  • 19
  • 3