Stack Overflow
Stack Overflow

Questions tagged [azureml-python-sdk]

188 questions
1
vote
2 answers

filter TabularDataset in azure ML

My Dataset is huge. I am using Azure ML notebooks and using azureml.core to read dateset and convert to azureml.data.tabular_dataset.TabularDataset. Is there anyway i would filter the data in the tabularDataset with out converting to pandas data…
karas27
  • 335
  • 1
  • 5
  • 15
1
vote
1 answer

Pick up Results From ML Studio Pipeline in Data Factory Pipeline

We currently have a Data Factory pipeline that is able to call one of our ML Studio Pipelines successfully. After the ML Studio Pipeline completed, we wanted Azure Data Factory to pick up the results of the ML Studio Pipeline and store the results…
yeamusic21
  • 276
  • 3
  • 11
1
vote
1 answer

How to use Pipeline parameters on AzureML

I've built a pipeline on AzureML Designer and I'm trying to use pipeline parameters but I'm not able to get the values of those parameters on a python script…
Pere Rumbo
  • 95
  • 1
  • 8
1
vote
2 answers

how to use existing conda environment as a AzureML environment

I have created a Azure Compute target and using the notebooks from it. I want to create a conda environment using Notebook Terminal and install my own packages and use it in AzureML experiment environment.
Saurabh Kansal
  • 643
  • 5
  • 13
1
vote
0 answers

Azure ML - AKS Service deployment unable to handle concurrent requests despite auto scaling enabled

I have deployed around 23 models (amounting to 1.57 GB) in a Azure ML workspace using Azure Kubernetes Service. For the AKS cluster, I have used 3 D8sv3 nodes, and enabled cluster auto scaling for the cluster up to 6 nodes. The AksWebService is…
Nayak S
  • 428
  • 1
  • 5
  • 18
1
vote
1 answer

Unable to create pyspark DataFrame from Datastore in azureml-sdk (version 1.12.0)

I am trying to read contents from a CSV file into Spark DataFrame using azureml-sdk using following code but an exception is being thrown. Code throwing exception import pyspark.sql as spark from azureml.core import Dataset dataset =…
Aravind Yarram
  • 78,777
  • 46
  • 231
  • 327
0
votes
1 answer

How to load pdf files from Azure Blob Storage with LangChain PyPDFLoader

I currently trying to implement langchain functionality to talk with pdf documents. I have a bunch of pdf files stored in Azure Blob Storage. I am trying to use langchain PyPDFLoader to load the pdf files to the Azure ML notebook. However, I am not…
stackword_0
  • 185
  • 8
0
votes
0 answers

Azure ML Pipeline with dynamic input/output for Batch Endpoint

My goal is to make a pipeline in Azure ML Studio that handles: an input_folder with audio files an output_folder with the desired output some parameters. The input/output folders are Azureml connections to existing Azure storage containers. I have…
Ben Haanstra
  • 61
  • 7
0
votes
1 answer

AzureML SDK v2 list compute error AttributeError: 'Databricks' object has no attribute 'tags'

I am using AzureML SDK v2. I run the following code ml_ws_client = MLClient(credential=credential,subscription_id=subscription_id, resource_group_name=resource_group, workspace_name=ws_name) for comp in…
Matt Najarian
  • 151
  • 1
  • 8
0
votes
1 answer

HTTP Error 409 while accessing registered dataset as a URI file (Azure SDKv2)

In Azure ML I'm trying to read data from the blob storage, register it as a URI File. This is needed to keep data versioning and at the same time to keep data lineage (sort of) because components require to have either URI File or URI Folder. So,…
Egorsky
  • 179
  • 1
  • 11
0
votes
0 answers

How to modify azureml python sdk v2 to serve custom use cases?

I want to modify azureml.data.dataset_factory.register_pandas_dataframe() for my use case so it returns relative_path_with_guid in addition to the registered_dataset by default. The default azureml.data.dataset_factory.register_pandas_dataframe()…
MajorMajorMajorMajor
  • 3
  • 2
0
votes
1 answer

How to trigger an event-based based pipeline in AzureML?

I have a published pipeline in AzureML that preprocess the data and train a new model. I am trying an event-based schedule so that whenever a new dataset is registered in the workspace, it triggers the whole training pipeline. I am using the python…
ammar
  • 3
  • 2
0
votes
1 answer

Is there a way to create virtual env (and kernel) in Azure ML notebook from a custom registered environment?

I have registered a custom environment (through Environments tab) in Azure Machine Learning (providing Docker file and conda_dependencies.yaml) which I plan to use for training jobs. Now I would like to be able to use this environment also in…
Michal Nožička
  • 3
  • 1
0
votes
1 answer

How to convert TabularDataset or a pandas dataframe to a FileDataset using azure ml python sdk v2?

I've written a webscraping script to extract a web table in a dataframe format which I have converted into a TabularDataset using Dataset.Tabular.register_pandas_dataframe() to store in the default datastore. I want to pass this webscraped table as…
MajorMajorMajorMajor
  • 3
  • 2
0
votes
1 answer

Error on Azure ML - AutoMLPipelineBuilder

I want to build a Pipeline in Azure ML. The Training pipeline runs well. Training: training_pipeline_steps = AutoMLPipelineBuilder.get_many_models_train_steps( experiment=experiment, train_data=full_dataset, …
JMTaverne
  • 31
  • 5
1 2 3
…
12 13