Questions tagged [amazon-sagemaker]

Amazon SageMaker is a fully-managed AWS service that enables developers and data scientists to quickly and easily build, train, and deploy machine learning models at any scale.

Amazon SageMaker is Amazon's official system for developing machine learning systems in the cloud. It is based on Jupyter notebooks and has the ability to talk with other AWS services in order to explore data, automate processes and conduct various kinds of analysis.

It provides ready-to-use frameworks and algorithms to deal with different use cases and gives the ability to develop fully custom models.

One of the most important capabilities of SageMaker is the ability to deploy models in fully scalable and secure environments.

The only prerequisites for using Amazon SageMaker are an AWS account and an IAM (Identity and Access Management) admin user.


Tagging Recommendation:

Use the tag for all SageMaker-related questions. If it is a question about must also be redirected to this tag as a subset.

For all other SageMaker sub-services, if there is not yet a dedicated tag, it is good to redirect them to SageMaker only if they are closely related.


FAQ:

There are some recurring and important questions that one is faced with when starting to use SageMaker that should not be duplicated:


References


Free SageMaker Programming Books


SageMaker Online Courses


SageMaker Video Tutorials


Official Logo

SageMaker logo

2832 questions
0
votes
1 answer

Sagemaker endpoint returns error 500 when using custom docker

i'm trying to deploy a model in a sagemaker endpoint using a custom docker file: ARG REGION=us-east-1 FROM 763104351884.dkr.ecr.$REGION.amazonaws.com/pytorch-inference:2.0.1-gpu-py310-cu118-ubuntu20.04-sagemaker RUN pip install poetry RUN poetry…
Djellal Mohamed Aniss
  • 1,723
  • 11
  • 24
0
votes
1 answer

Issue when trying to run the Sagemaker abalone pipeline example

When I try and run this line: from sagemaker.workflow.steps import ProcessingStep I get an error: ImportError: cannot import name 'trim_request_dict' from 'sagemaker.workflow.utilities'…
0
votes
1 answer

How to automate aws sagemaker studio notebook

I am quite new to AWS and trying to run AWS Sagemaker Studio Notebook when file is uploaded to S3. I came to know that there is a difference between AWS Sagemaker Notebook Instance and AWS Sagemaker Studio Notebook. Got approaches to run AWS…
Logan27
  • 25
  • 4
0
votes
1 answer

How to Efficiently Parse Video Files Stored in S3 for SageMaker Endpoints with Custom Inference Code and Containers?

I am currently working on deploying a SageMaker endpoint with custom inference code and a custom container for object detection and tracking. My goal is to perform real-time video analysis on videos stored in Amazon S3. However, I'm facing…
0
votes
1 answer

Error in deploy LLM model in sagemaker endpoint. pls provide the solution any one known

#033[2m2023-07-31T06:58:11.298494Z#033[0m #033[31mERROR#033[0m #033[2mtext_generation_launcher#033[0m#033[2m:#033[0m Download encountered an error: Traceback (most recent call last): File "/opt/conda/bin/text-generation-server", line 8, in…
0
votes
0 answers

Sagemaker Model Monitoring: Model Quality Monitoring baseline job too much data for max payload size

I'm currently using Sagemaker Model Monitoring modules in order to check model and data quality. I create the data and model baselines with the sagemaker python API. While running the Batch Transform Job launched by the suggest_baseline() function…
mxmrpn
  • 63
  • 8
0
votes
0 answers

Getting back to default SageMaker Studio Lab project

I wanted to start fresh and delete the things I had added to my project, and I think I may have messed up and deleted like all the important files my one and only studiolab project needs. For example, I got the error bash: sudo: command not found…
0
votes
1 answer

Sagemaker Jupyter Notebook Cannot Access Local Files

I am running notebooks in Sagemaker Studio When I create a notebook and run it from stage studio, I execute from a directory which corresponds to what I see on the left sidebar import os print("getcwd", os.getcwd()) getcwd…
0
votes
1 answer

Converting triton container to work with sagemaker MME

I have a custom triton docker container that use a python backend. This container works perfectly on local. Here is the container dockerfile (I have ommitted irrelevant parts). ARG TRITON_RELEASE_VERSION=22.12 FROM…
toing_toing
  • 2,334
  • 1
  • 37
  • 79
0
votes
0 answers

Error while deploying this repo in AWS(timdettmers/guanaco-33b-merged LLM)

so I'm using AWS Sagemaker to host this model (timdettmers/guanaco-33b-merged ), and then using AWS lambda to host this model in a serverless architecture and API gateway, which acts as a trigger to the lambda function. After hosting the model in…
0
votes
0 answers

End-to-End architecture to connect all the tools together

I am very new to Data Architecture and here I want to build an end-to-end architecture: Source: Snowflake Tables Target: Snowflake Tables In between we have to do some processing, here is the flow: We are exporting data from snowflake tables…
0
votes
0 answers

AWS Sagemaker, InvokeEndpoint operation, Model error: pass an offload_folder for model submodules?

So, I deployed 2 sagemaker endpoints (of Large Language Models) following their AWS official tutorial notebook here:…
0
votes
1 answer

Sagemaker: CUDA out of memory - Starcoder

Running into issues in getting Starcoder to deploy on Sagemaker. I'm getting the following errors in CloudWatch and even with the instance type: ml.g5.8xlarge Error 1: Error: ShardCannotStart File…
texnoob
  • 173
  • 8
0
votes
0 answers

Importing custom modules in schedulling AWS Sagemaker Pipelines

I understand that AWS Sagemaker Pipelines can be run on a scheduler using EventBridge. However, I will like to check if AWS Sagemaker Pipelines allows the user to import custom modules inside the code? All the examples that I had found online all…
0
votes
0 answers

How to set up configuration file for sagemaker triton inference?

I have been looking examples and ran into this from aws, https://github.com/aws/amazon-sagemaker-examples/blob/main/sagemaker-triton/ensemble/sentence-transformer-trt/examples/ensemble_hf/bert-trt/config.pbtxt. based on this example , we need to…
suwa
  • 23
  • 4
1 2 3
99
100