Stack Overflow
Stack Overflow

Questions tagged [azure-notebooks]

78 questions
1
vote
1 answer

AzureML list huge amount of files

I have directory in AzureML notebook in which I have 300k files and need to list their names. Approach below works but takes 1.5h to execute: from os import listdir from os.path import isfile, join mypath = "./temp/" docsOnDisk = [f for f in…
RunTheGauntlet
  • 392
  • 1
  • 4
  • 15
1
vote
0 answers

how to solve Azure synapse scala notebook error TaskCanceledException: A task was canceled?

I have below synpase pipeline which has 4 notebook activities. i am using large spark pool. second notebook throw error TaskCanceledException: A task was canceled. can anyone help me with this? Notebook Code :- val format = new…
Deepak Kumar
  • 17
  • 6
1
vote
3 answers

How to pass a dataframe as notebook parameter in databricks?

I have a requirement wherein I need to pass a pyspark dataframe as notebook parameter to a child notebook. Essentially, the child notebook has few functions with argument type as dataframe to perform certain tasks. Now the problem is I'm unable to…
user16714516
1
vote
0 answers

Get Azure Databricks lineage components

Usually In data bricks we will have workspace and then notebooks. Inside notebooks we will have commands. I will get these commands one by one and based on this each command I have to prepare lineage. For building lineage we need source and…
Anusha Reddy
  • 63
  • 7
1
vote
1 answer

Azure Databricks - Clone git repository from a notebook

I am trying to clone a git repository hosted on Azure DevOps from within a notebook, using GitPython library. I generated a Personal Access Token with read/write access on git repositories. The intent is to keep the git repository into the DBFS…
Jul_DW
  • 1,036
  • 6
  • 20
1
vote
1 answer

Is there any way to input microphone on Azure Notebooks/ Google Collab?

I've been trying to build a speech to text application using Python Notebooks on Google Collab and Azure Notebook. The problem I'm facing is that the cloud based VM does not have an audio port for using my microphone. Due to this, I'm even unable to…
DEVJYOT SIDHU
  • 23
  • 5
1
vote
0 answers

connecting Azure Notebook to azure VM

I am using Azure notebook. And I would like to connect a notebook to my private VM. I Added the 8000 port to my VM network: But when I try to connect my notebook to my VM (I am using the same account for both resources), I am getting this…
Kenny Smith
  • 729
  • 3
  • 9
  • 23
1
vote
0 answers

Jupyter Notebook does not run anymore once you hit `!python` command

Jupyter notebook does not work anymore after typing command !python on a cell. It accepts all other python codes, terminal and bash codes, codes like !pip list and !python -V but not !python. It acts same in Azure Notebooks also. What could be the…
Merin Nakarmi
  • 3,148
  • 3
  • 35
  • 42
1
vote
1 answer

Error with json in Azure Machine Learning Studio with R with H2O package

I am deploying a model using the H2O package with R on an Azure Machine Learning Studio notebook. I understand that when requesting my predict function the data goes in json format, and when the as.h2o () command inside the mypred function tries to…
Máiron Chaves
  • 45
  • 4
1
vote
3 answers

How do I maintain unique items in a list thereby solving this problem?

I require to create a program that provides the solution: 1 3 2 6 5 4 10 9 8 7 using python. I've been trying out different ideas for over three weeks, and I can't find a solution. All of the code functions/commands that I am permitted to use…
Scaly V
  • 13
  • 4
1
vote
1 answer

Scheduling on Azure Notebooks

Is it possible to schedule a Python script on Azure Notebooks? I've written a simple script saved as test.py: That runs absolutely fine when I run it in the terminal as python library/code/test.py I've got a cron that looks like this: But…
tktk234
  • 426
  • 3
  • 12
1
vote
0 answers

How can I read the file selected by the File Dialog box that opens in Azure Notebook using python?

After I select a (csv) file from the file dialog, how can I read such file? The interface shows that the file does not exist. With the code : input_form = """
Rocky_Mental
  • 148
  • 1
  • 2
  • 12
1
vote
1 answer

How can I implement a File Dialog box that opens in Azure Jupyter Notebook In Python?

My Code : %gui qt from PyQt5.QtWidgets import QFileDialog def gui_fname(dir=None): """Select a file via a dialog and return the file name.""" if dir is None: dir ='./' fname = QFileDialog.getOpenFileName(None, "Select data file...", …
Rocky_Mental
  • 148
  • 1
  • 2
  • 12
1
vote
2 answers

Data Explorer: ImportError No module named Kqlmagic

I'm following this tutorial: https://learn.microsoft.com/en-us/azure/data-explorer/kqlmagic I have a Databricks cluster so I decided to use the notebook that is available on there. When I get to step 2 and run: reload_ext Kqlmagic I get the error…
Reddspark
  • 6,934
  • 9
  • 47
  • 64
1
vote
1 answer

aznbsetup.sh startup file for Azure Notebooks is not run

I've create the Azure Notebooks library with 'aznbsetup.sh' startup file. File doesn't run then I open the library, and .aznbsetup.log is not created. File content is simple #!/bin/bash git pull So I don't know what's happening and how to debug it
Y.N
  • 4,989
  • 7
  • 34
  • 61
1
2
3 4 5 6