Questions tagged [amazon-sagemaker]

Amazon SageMaker is a fully-managed AWS service that enables developers and data scientists to quickly and easily build, train, and deploy machine learning models at any scale.

Amazon SageMaker is Amazon's official system for developing machine learning systems in the cloud. It is based on Jupyter notebooks and has the ability to talk with other AWS services in order to explore data, automate processes and conduct various kinds of analysis.

It provides ready-to-use frameworks and algorithms to deal with different use cases and gives the ability to develop fully custom models.

One of the most important capabilities of SageMaker is the ability to deploy models in fully scalable and secure environments.

The only prerequisites for using Amazon SageMaker are an AWS account and an IAM (Identity and Access Management) admin user.


Tagging Recommendation:

Use the tag for all SageMaker-related questions. If it is a question about must also be redirected to this tag as a subset.

For all other SageMaker sub-services, if there is not yet a dedicated tag, it is good to redirect them to SageMaker only if they are closely related.


FAQ:

There are some recurring and important questions that one is faced with when starting to use SageMaker that should not be duplicated:


References


Free SageMaker Programming Books


SageMaker Online Courses


SageMaker Video Tutorials


Official Logo

SageMaker logo

2832 questions
13
votes
2 answers

AWS Sagemaker - Install External Library and Make it Persist

I have a sagemaker instance up and running and I have a few libraries that I frequently use with it but each time I restart the instance they get wiped and I have to reinstall them. Is it possible to install my libraries to one of the anaconda…
Adrix
  • 401
  • 1
  • 3
  • 11
13
votes
4 answers

How to Curl an Amazon Sagemaker Endpoint

What is a is the curl command to make a POST request to sage-maker and receive a ML inference?
tlanigan
  • 849
  • 1
  • 9
  • 20
12
votes
2 answers

Uploading a Dataframe to AWS S3 Bucket from SageMaker

I am new to AWS environment and trying to solve how the data flow works. After successfully uploading CSV files from S3 to SageMaker notebook instance, I am stuck on doing the reverse. I have a dataframe and want to upload that to S3 Bucket as CSV…
realkes
  • 833
  • 1
  • 12
  • 20
11
votes
6 answers

Loading custom conda envs not working in SageMaker

I have installed miniconda on my AWS SageMaker persistent EBS instance. Here is my starting script: #!/bin/bash set -e # OVERVIEW # This script installs a custom, persistent installation of conda on the Notebook Instance's EBS volume, and…
11
votes
3 answers

Sagemaker Studio errors a loading screen to clear workspace every-time when connected "open studio"

On resuming or restarting the sagemaker-studio I have the below message pop-up. Even after clearing the workspace, it won't open. After few such retries, the Jupiter notebook (sagemaker studio / IDE) opens. I get this message every time I reconnect…
Anna23
  • 680
  • 2
  • 8
  • 16
11
votes
2 answers

AWS SageMaker on GPU

I am trying to train a neural network (Tensorflow) on AWS. I have some AWS credits. From my understanding AWS SageMaker is the one best for the job. I managed to load the Jupyter Lab console on SageMaker and tried to find a GPU kernel since, I know…
11
votes
1 answer

Display tqdm in AWS Sagemaker's jupyterlab

Does anyone nows how can we have python tqdm progress bar working on a Sagemaker Jupyterlab Noteook ? The tqdm progress bar is never displayed, components are displayed as their code. Example : HBox(children=(FloatProgress(value=0.0, max=5234.0),…
jugo
  • 161
  • 2
  • 10
11
votes
2 answers

Using the same preprocessing code for both training and inference in sagemaker

I am working on building a machine learning pipeline for time series data where the goal is to retrain and update the model frequently to make predictions. I have written a preprocessing code that handles the time series variables and transforms…
11
votes
2 answers

AWS Glue Spark Sagemaker Notebook is failing

Unable to run the AWS Glue Sagemaker Notebook, it's throwing up an error on the start up. Could anyone please let me know if I miss anything here? PS: As recommended in the error logs, I've restarted the kernel a couple of times but it did not…
Naga Budigam
  • 689
  • 1
  • 10
  • 26
11
votes
2 answers

Difference in usecases for AWS Sagemaker vs Databricks?

I was looking at Databricks because it integrates with AWS services like Kinesis, but it looks to me like SageMaker is a direct competitor to Databricks? We are heavily using AWS, is there any reason to add DataBricks into the stack or odes…
L Xandor
  • 1,659
  • 4
  • 24
  • 48
11
votes
6 answers

How do you install modules within sagemaker training jobs?

I don't think I'm asking this question right but I have jupyter notebook that launches a Tensorflow training job with a python training script I wrote. That training script requires certain modules. Seems my sagemaker training job is failing because…
kane
  • 5,465
  • 6
  • 44
  • 72
11
votes
4 answers

What is the SageMaker url for Tensorboard?

I'm trying to access the Tensorboard for the tensorflow_resnet_cifar10_with_tensorboard example, but not sure what the url should be, the help text gives 2 options: You can access TensorBoard locally at http://localhost:6006 or using your…
WBC
  • 1,854
  • 4
  • 21
  • 34
10
votes
1 answer

Worker died/Worker disconnected Sagemaker

I am trying to set up a multi-model endpoint (or more accurately re-set it up as I am pretty sure it was working a while ago, on an earlier version of sagemaker) to do language translation. But am constantly met with the same issue. This is what I…
Oisín Moran
  • 211
  • 2
  • 6
10
votes
2 answers

How to increase AWS Sagemaker invocation time out while waiting for a response

I deployed a large 3D model to aws sagemaker. Inference will take 2 minutes or more. I get the following error while calling the predictor from Python: An error occurred (ModelError) when calling the InvokeEndpoint operation: Received server error…
Stiefel
  • 2,677
  • 3
  • 31
  • 42
10
votes
3 answers

Plotly shows blank graphs in AWS Sagemaker JupyterLab

Background: I am new to the Python world and am using Plotly for creating basic graphs in Python. I am using AWS Sagemaker's JupyterLab for creating the python scripts. Issue: I have been trying to run the basic codes mentioned on Plotly's website…