Questions tagged [azure-dsvm]

Questions referring to the Azure Data Science Virtual Machine, which are Azure Virtual Machine images, pre-installed, configured and tested with several popular tools that are commonly used for data analytics, machine learning and AI training

Useful Links:

  1. Overview
  2. Samples & Walkthroughs
45 questions
1
vote
1 answer

Creating and using a custom Anaconda environment on Azure DSVM

I want to use a specific Python environment with specific libraries (Keras, TensorFlow) on an Azure Linux data science virtual machine (DSVM) to move some of my local work to the cloud. I created the environment in the terminal using Keras v2.1.6.…
Matt
  • 5,800
  • 1
  • 44
  • 40
1
vote
2 answers

Load data from Azure Data Lake to Jupyter notebook on DSVM

I am trying to load data from Azure Data Lake to a Jupyter notebook in my Data Science VM. Note that I am the owner of the data lake storage and have read, write, and execute permissions. The data science VM with Jupyter is running under the same…
1
vote
2 answers

Can't reach Jupyter Notebooks on Azure Deep Learning Virtual Machine

I followed the instructions here. I am on the Ubuntu VM via SSH. I tried to access IP:8000 but Chrome says the Site can't be reached. Port 8000 is indeed open by default as mentioned in the docs. Instructions don't mention if I have to start…
pradhyo
  • 157
  • 1
  • 2
  • 19
1
vote
0 answers

Is there a way to speed this up - moving csvs from Azure Blob storage to vm, appending to single csv, using python

My job collects multiple times a day from a streaming job and drops a csv into blob storage. After a few weeks of collecting data, I will run a python script to do some machine learning. To set up the training data, I am first moving all data within…
1
vote
1 answer

Azure importing data SQL

I've been trying to sort through Microsoft's extensive documentation, but, cannot find the answer I'm looking for, hence, posting it here for the experts! I have a table in a database in MS SQL Server 2016, that I read/write to using MS SSMMS. I…
1
vote
1 answer

caffe powered and GPU enabled Microsoft Azure VM

I'm trying to build a VM for model training in Azure. I found this Data Science Virtual Machine for Linux (Ubuntu) VM which seems to be a suitable candidate. Unfortunately, when I spun up the VM and installed the caffe prerequisites I wasn't able…
Mando
  • 11,414
  • 17
  • 86
  • 167
1
vote
1 answer

Difference between using RStudio on a virtual machine and Rstudio on RServer

I am new in R and I am working with a datasets that has more than 5 millions of observations. So I thought that it would be a good idea to use RStudio on a virtual machine instead of using it on my local machine. I am reading the documentation about…
Mary
  • 35
  • 1
  • 7
1
vote
2 answers

How do I create a Linux N6 (with GPU) VM on Azure for Deep Learning applications?

When I try to do new Ubuntu Compute VM in East US or South Central US (the two with advertised GPU support), there is no option to select N6. The only way to get N6 VM is to use the "Deep Learning toolkit for the DSVM" option, which is a Windows…
thang
  • 3,466
  • 1
  • 19
  • 31
1
vote
2 answers

Theano on Azure DSVM

I am trying to use Theano on the Azure DSVM which is a preconfigured VM for Data Science. Is anyone aware of such a VM and does it support Theano out of the box? WARNING (theano.configdefaults): g++ not detected ! Theano will be unable to execute…
Tronald Dump
  • 1,300
  • 3
  • 16
  • 27
0
votes
0 answers

Pandas diff-function: NotImplementedError

When I use the diff function in my snippet: for customer_id, cus in tqdm(df.groupby(['customer_ID'])): # Get differences diff_df1 = cus[num_features].diff(1, axis = 0).iloc[[-1]].values.astype(np.float32) I…
paka
  • 55
  • 7
0
votes
1 answer

CUDA not available on Azure Data Science virtual machine

I am running a fresh Windows Server 2019 Data Science virtual machine in Azure. I'm using the NC6_Promo size which has the Tesla K80 GPU. After the deployment is complete I tried to check if CUDA was working using the following python…
0
votes
0 answers

how to change default start-up folder jupyter hub on Azure DSVM virtual machine

Azure DSVM has jupyterlab enabled on port 8000. However, the startup folder in jupyterlab always starts at /home/*user-name/notbook. I want to change the jupyterlab start folder, but I don't know what to do. tried 1. I created a jupyterlab…
Soulduck
  • 569
  • 1
  • 6
  • 17
0
votes
3 answers

Azure DSVM: Cannot connect to the Docker daemon

We have been using Data Science Virtual Machine in combination with Virtual Machine scale set for our CI and then running custom Docker image in connected Azure…
Jirka
  • 1,126
  • 6
  • 25
0
votes
1 answer

DSVM can support SQL Server Developer Edition for Ubuntu

According to this https://learn.microsoft.com/en-us/azure/machine-learning/data-science-virtual-machine/tools-included#store-retrieve-and-manipulate-data, it appears that the SQL Server Developer Edition (Ubuntu) is being supported in DSVM but I…
0
votes
1 answer

How do I secure my Jupyter notebook with SSL from my Azure Data Science Virtual Machine?

What is an effective procedure I can follow to secure my Jupyter Notebook? I created an Azure Data Science machine as per the instructions here…