github-featured/aws--amazon-sagemaker-examples
2
0
Fork 0
Code Issues Pull Requests Deployments Models Agent Notes Packages Projects Releases Wiki Activity
3,137 Commits 193 Branches 1 Tag
main
Commit Graph

332 Commits

Author SHA1 Message Date
Marco Friaz 4534bff4b5 Append the default_bucket_prefix to s3 paths if one exists to inference sample notebooks (#4808) 
**Description**

This change checks the sagemaker session if there is a default_bucket_prefix set. If a default bucket prefix is specified, it is append it to the s3 path. This was done for inference sample notebooks. This ensures sample notebooks that utilize s3, works in SageMaker Unified Studio.

Co-authored-by: Marco Friaz <marfriaz@amazon.com>
Co-authored-by: Erick Benitez-Ramos <141277478+benieric@users.noreply.github.com>
 2025-01-21 09:42:36 -08:00
Zhaoqi 4f6b1f6b52 Revert "New folder structure (#4694)" (#4701) 
This reverts commit 970d88ee18 due to broken blog links
 2024-07-09 12:54:45 -04:00
Zhaoqi 970d88ee18 New folder structure (#4694) 
* Deleted 17 duplicate notebooks (#4685)

* Updated README, removed broken links and fixed markdown (#4687)

* New Folder Structure Implementation - Archived remaining geospatial example notebooks (#4691)

* Archived remaining geospatial example notebooks

* Removed geospatial from README.md

* Archived remaining workshop notebooks (#4692)

* Archived outdated example notebooks between 1-90 views (#4693)

---------

Co-authored-by: jsmul <jsmul@amazon.com>
 2024-07-09 11:48:53 -04:00
Sam Sanders a3137b1eaf Updating packages for import, updating S3 prefix 2023-12-20 00:31:30 -08:00
Sam Sanders afe5fa8b48 Avoiding timeouts and updating READMEs to sentiment_parallel_batch advanced functionality example (#4480) 
* Updated the readme files, and made the necessary changes to the Sentiment Parallel Batch notebook to avoid the timeouts. Also created a readme for this example.

* Increased disk space on training instances
 2023-12-11 09:01:24 -08:00
atqy 12085f3bea change badging domain url (#4459) 2023-10-23 08:30:00 -07:00
Sam Sanders 65b6624e98 Creation of Sentiment Analysis Notebook with distributed training and inference, debugger, and batch transform (#4455) 
* Sentiment analysis distributed debugger notebook

Created a new notebook, adapted and referencing two Hugging Face examples, that extends a sentiment classifier whilst using Amazon SageMaker Distributed Training, and SageMaker Debugger.

* Update index.rst

With Distributed Sentiment Classification with Debugging

* Grammar and formatting updates

* Grammar improvement

* Update huggingface_sentiment_parallel_batch.ipynb

Updated S3 prefix

* Cleared outputs
 2023-10-16 11:25:16 -07:00
ajayvohra2005 31a7924eca Maskrcnn tensorflow 2.12 (#4437) 
* update maskrcnn to tensorflow 2.12

* update stack script

* update cloudformation template

* update notebooks

* update notebook

* update README

* fix CI build errors

* fix spelling and grammar

* update cloudformation template
 2023-09-20 11:36:11 -07:00
Ryan Dana 116129e6cb prune advanced_functionality (#4301) 2023-07-17 11:51:31 -07:00
LeventKent 7367e61ea1 Huggingface deploy instructpix2pix (#4317) 
* Deploying pretrained HuggingFace model, supporting multi-gpu, using inf-recommender for load tests

* formatted via black-nb

* Host Multimodal HuggingFace Model added.

* account number cleaned from outputs, inf-recommender, load tests supported also via UI

* formatting

* using plain text for inference response

* handling JSON and String response types

* formatting

* Update deploy-instructpix2pix-to-sagemaker-ir.ipynb

cleaned the output

* rerun to generate output

* badge added

* badges fixed

* misleading comments removed.

* change download folder

* clear outputs

* change kernel

---------

Co-authored-by: atqy <95724753+atqy@users.noreply.github.com>
Co-authored-by: atqy <atqy@amazon.com>
 2023-07-06 12:50:50 -07:00
Ryan Dana 2819d88326 remediate final notebooks 3.8+ (#4291) 
* remediate final notebooks 3.8+

* remediate final notebooks 3.8+ additional

* remediate final notebooks 3.8+ additional

* remediate final notebooks 3.8+ additional
 2023-06-26 14:10:02 -07:00
LeventKent d80ca2eb63 Huggingface deploy instructpix2pix (#3954) 
* Deploying pretrained HuggingFace model, supporting multi-gpu, using inf-recommender for load tests

* formatted via black-nb

* Host Multimodal HuggingFace Model added.

* account number cleaned from outputs, inf-recommender, load tests supported also via UI

* formatting

* using plain text for inference response

* handling JSON and String response types

* formatting

* Update deploy-instructpix2pix-to-sagemaker-ir.ipynb

cleaned the output

* rerun to generate output

* badge added

---------

Co-authored-by: atqy <95724753+atqy@users.noreply.github.com>
 2023-06-05 10:01:23 -07:00
atqy 76fbac47f7 migrate multi-container-direct-invocation.ipynb to regional bucket (#4164) 2023-06-02 20:11:58 -07:00
atqy f81900d6ab migrate notebooks to regional buckets (#4142) 
* migrate notebooks to regional buckets

* revert
 2023-06-01 16:57:03 -07:00
atqy 8afa91bd37 remediate handling_kms_encrypted_data.ipynb to py38+ (#4140) 
* remediate handling_kms_encrypted_data.ipynb to py38+

* remediate handling_kms_encrypted_data.ipynb to py38+

* remediate handling_kms_encrypted_data.ipynb to py38+

* debug
 2023-06-01 15:55:38 -07:00
atqy 0c4690f311 remediate huggingface-custom-text-summarizer.ipynb to py38+ (#4138) 
* remediate huggingface-custom-text-summarizer.ipynb to py38+

* remediate huggingface-custom-text-summarizer.ipynb to py38+

* remediate huggingface-custom-text-summarizer.ipynb to py38+
 2023-06-01 08:19:36 -07:00
atqy 2e60fb1522 remediate build_gan_with_pytorch.ipynb to py38+ (#4124) 2023-05-29 11:41:27 -07:00
atqy 9223dd7194 remediate linear_learner_multi_model_endpoint_inf_pipeline.ipynb to py38+ (#4110) 2023-05-25 19:01:50 -07:00
atqy c7d65712c3 remediate notebooks to py38+ (#4071) 2023-05-23 18:30:14 -07:00
atqy 41fbaa4b1e remediate pytorch_extending_our_containers.ipynb (#4051) 2023-05-22 20:06:29 -07:00
atqy e3f008fdc1 remediate notebooks to py38+ (#4019) 
* remediate notebooks to py38+

* revert

* revert
 2023-05-22 15:55:56 -07:00
atqy 8112fcc638 remediate notebook to py38+ (#4044) 2023-05-22 14:37:46 -07:00
atqy b23fc920e0 remediate and fix multi_model_endpoint_bring_your_own.ipynb (#4043) 2023-05-22 14:29:04 -07:00
atqy ffd04c936c remdiate notebook to py38+ (#4040) 
Co-authored-by: EC2 Default User <ec2-user@ip-172-16-90-103.us-west-2.compute.internal>
 2023-05-22 12:20:02 -07:00
atqy 4f21d4767d revert (#4029) 2023-05-20 23:25:40 -07:00
atqy 51dc0528ac remediate notebooks to py38+ (#4028) 2023-05-20 19:57:22 -07:00
atqy 0c36d53493 remediate notebooks to py38+ (#4026) 
* remediate notebooks to py38+

* revert
 2023-05-20 18:59:10 -07:00
atqy cdd6117ace remediate notebooks to py38+ (#4023) 
* remediate notebooks to py38+

* fix

* revert

* revert
 2023-05-20 16:44:17 -07:00
atqy 48371b2c20 remediate notebooks to py38+ (#4021) 2023-05-20 11:40:17 -07:00
atqy b3913822fc remediate notebooks to py38+ (#4011) 2023-05-19 11:00:44 -07:00
atqy 31f3d77a69 remediate notebooks to py38+ (#4010) 
* remediate notebooks to py38+

* revert
 2023-05-19 11:00:18 -07:00
atqy 3edb5c0782 Fix and update broken notebooks to Python 3.8 (#4006) 
* fix xgboost-census-debugger-rules.ipynb

* fix inf1_bert_compile_and_deploy.ipynb

* fix huggingface_sentiment.ipynb

* fix credit_risk_explainability_inference_pipelines.ipynb

* fix djl_deepspeed_deploy_opt30b_no_custom_inference_code.ipynb

* fix 01_data_exploration.ipynb

* fix parquet_to_recordio_protobuf.ipynb

* revert
 2023-05-18 18:52:47 -07:00
atqy 0293d90e5f remediate notebooks to py38+ (#4007) 2023-05-18 17:51:03 -07:00
atqy 7e07bb432a remediate to py38 (#4005) 2023-05-18 16:22:02 -07:00
atqy 3d28f1d8de Fix badges (#3977) 
* edit CONTRIBUTING to include badges fix

* fix badges for read the docs
 2023-05-03 17:27:57 -07:00
atqy 22b8203af3 Add badges (#3957) 
* prep notebooks for badging propagation

* prep

* add badges to notebooks
 2023-04-26 11:41:27 -07:00
Malav Shastri b81b8f5077 upgrade SKlearn version to 1.2-1 (#3872) 
* upgrade SKlearn version to 1.2-1

* Update sagemaker version

* Fix processing job failures

* resolve errors related to 1.2-1 upgrade

* Upgrade Sagemaker version to address errors

* Resolve 1.2-1 upgrade errors

---------

Co-authored-by: Malav Shastri <malavhs@amazon.com>
 2023-03-30 13:14:14 -07:00
perrozzi 0b5468099f Train and deploy BERTopic by extending pytorch containers or adding requirements.txt (#3819) 
* add notebook and apply comments

* use AWS source for data
 2023-03-27 11:15:47 -07:00
Frank Liu 4a42319b7a Fixes broken GPT-J-6B-model-parallel-inference-DJ example (#3851) 
Also adds new example for deploying GPT-J-6B model with PySDK
 2023-03-22 07:54:42 -07:00
Anastasia P. Tsitiridou b182069f4b load model weights in model_fn(..) (#3800) 
* add line to load model weights

* code linting
 2023-02-23 07:49:48 -08:00
atqy e63a03fbaf Update mead kernels (#3738) 
* change kernel

* change kernel

* change kernel

* change kernal

* change kernal

* change kernal

Co-authored-by: EC2 Default User <ec2-user@ip-172-16-73-51.us-west-2.compute.internal>
 2023-01-13 10:08:34 -08:00
Sean Morgan df6c76360e Fix JAX example to use BYOS (#3723) 
* Fix JAX example to use BYOS

* Spelling mistakes

Co-authored-by: atqy <95724753+atqy@users.noreply.github.com>
 2022-12-28 13:40:21 -08:00
Alexander Shirkov 6a1863372e AutoGluon deep learning containers - updated to 0.6.1 release (#3717) 
* AutoGluon deep learning containers - updated to 0.4 release

* Update AutoGluon_Tabular_SageMaker_Containers.ipynb

* Udated s3 resources loading

* formatting

* fixes

* fixes
 2022-12-28 12:25:22 -08:00
atqy 4ad2afe52c fix tensorflow_bring_your_own.ipynb (#3672) 
* fix tensorflow_bring_your_own.ipynb

* delete hosting, etc references

* edits

* edits

* edits

* upgrade to ALv2 kernel

* reformat code

Co-authored-by: EC2 Default User <ec2-user@ip-172-16-44-140.ec2.internal>
Co-authored-by: Aaron Markham <markhama@amazon.com>
Co-authored-by: EC2 Default User <ec2-user@ip-172-16-11-6.us-west-2.compute.internal>
 2022-12-06 10:09:07 -08:00
Rahul Shringarpure ac311608bc YOLOv5 transfer learning and hyperparameter optimisation using Amazon SageMaker (#3601) 
* using new dataset for yolov5 notebook.

* added code for downloading dataset.

* edits to introductory instructions.

* reformatted notebook.

* fixes

* fixes

* fixed language issues

* fixed more language issues

* fixed a few spelling mistakes

* broke up a few sentences, for easier read.

* punctuation correction

Co-authored-by: Shringarpure, Rahul <shringar@amazon.com>
Co-authored-by: EC2 Default User <ec2-user@ip-172-16-10-116.us-west-2.compute.internal>
Co-authored-by: atqy <atqy@amazon.com>
Co-authored-by: atqy <95724753+atqy@users.noreply.github.com>
 2022-12-05 11:39:47 -08:00
atqy f5257429dd Reinvent sdk test fix (#3664) 
* fix tensorflow_script_mode_pipe_mode.ipynb

* fix advanced_functionality/kmeans_bring_your_own_model/kmeans_bring_your_own_model.ipynb

* fix sagemaker-python-sdk/mxnet_onnx_export/mxnet_onnx_export.ipynb

* fix sagemaker-python-sdk/tensorflow_serving_using_elastic_inference_with_your_own_model/tensorflow_serving_pretrained_model_elastic_inference.ipynb

* fix sagemaker-python-sdk/mxnet_gluon_sentiment/mxnet_sentiment_analysis_with_gluon.ipynb

* fix advanced_functionality/tensorflow_iris_byom/tensorflow_BYOM_iris.ipynb

* fix sagemaker-python-sdk/managed_spot_training_tensorflow_estimator/managed_spot_training_tensorflow_estimator.ipynb

* fix sagemaker-python-sdk/tensorflow_moving_from_framework_mode_to_script_mode/tensorflow_moving_from_framework_mode_to_script_mode.ipynb

* reformat notebooks

* cleanup

* cleanup

Co-authored-by: EC2 Default User <ec2-user@ip-172-16-61-50.us-east-2.compute.internal>
Co-authored-by: EC2 Default User <ec2-user@ip-172-16-59-62.ec2.internal>
 2022-11-11 11:01:05 -08:00
robdusen 4d3aa3961b Update container and engine for latest version of DJLServing (#3652) 2022-11-02 12:48:15 -07:00
AnushaVelumani f1fe550777 updating rst files (#3619) 2022-10-07 10:20:27 -07:00
Qingwei Li 7af5f4ebba "docker tag" call improvement (#3604) 
* CLI upgrade

* reformat

* grammatical changes

* boto3 version

* boto3 version-with minor change

* serving.perperties remove empty line

* set env variable for tensor_parallel_degree

* grammatic fix

* black-nb

* grammatical change

* endpoint_name fix

* "By" cap

* minor change

* docker tag call improvement

Co-authored-by: Qingwei Li <qqnl@amazon.com>
Co-authored-by: atqy <atqy@amazon.com>
Co-authored-by: atqy <95724753+atqy@users.noreply.github.com>
Co-authored-by: Aaron Markham <markhama@amazon.com>
 2022-09-21 16:01:28 -07:00
Qingwei Li 261f914b29 Boto3 version notebook (#3597) 
* CLI upgrade

* reformat

* grammatical changes

* boto3 version

* boto3 version-with minor change

* serving.perperties remove empty line

* set env variable for tensor_parallel_degree

* grammatic fix

* black-nb

* grammatical change

* endpoint_name fix

* "By" cap

* minor change

Co-authored-by: Qingwei Li <qqnl@amazon.com>
Co-authored-by: atqy <atqy@amazon.com>
Co-authored-by: atqy <95724753+atqy@users.noreply.github.com>
 2022-09-12 11:21:01 -07:00