447 Commits

Author SHA1 Message Date
Marco Friaz 4534bff4b5 Append the default_bucket_prefix to s3 paths if one exists to inference sample notebooks (#4808)
**Description**

This change checks the sagemaker session if there is a default_bucket_prefix set. If a default bucket prefix is specified, it is append it to the s3 path. This was done for inference sample notebooks. This ensures sample notebooks that utilize s3, works in SageMaker Unified Studio.

Co-authored-by: Marco Friaz <marfriaz@amazon.com>
Co-authored-by: Erick Benitez-Ramos <141277478+benieric@users.noreply.github.com>
2025-01-21 09:42:36 -08:00
Zhaoqi 4f6b1f6b52 Revert "New folder structure (#4694)" (#4701)
This reverts commit 970d88ee18 due to broken blog links
2024-07-09 12:54:45 -04:00
Zhaoqi 970d88ee18 New folder structure (#4694)
* Deleted 17 duplicate notebooks (#4685)

* Updated README, removed broken links and fixed markdown (#4687)

* New Folder Structure Implementation - Archived remaining geospatial example notebooks (#4691)

* Archived remaining geospatial example notebooks

* Removed geospatial from README.md

* Archived remaining workshop notebooks (#4692)

* Archived outdated example notebooks between 1-90 views (#4693)

---------

Co-authored-by: jsmul <jsmul@amazon.com>
2024-07-09 11:48:53 -04:00
Zhaoqi c3ce68a9ef Fix bugs in most viewed examples (#4663)
* update python version

Change python version to be "mambaforge-22.9"

* Update transformers package version in example notebook

update deploy_bert_outputs notebook

* Update scikit_learn_data_processing_and_model_evaluation.ipynb

* Fix llama-2-text-completion notebook

* Update llama-2-chat-completion.ipynb

* Update pytorch_mnist.ipynb

* Update DeepAR-Electricity.ipynb

* Fix code format in llama-2-text-completion

* Update CONTRIBUTING.md
2024-05-24 17:24:29 -04:00
atqy 12085f3bea change badging domain url (#4459) 2023-10-23 08:30:00 -07:00
Ryan Dana 5dfbf0da48 Revert "prune horovod and some repetitive notebooks (#4307)" (#4350)
This reverts commit 25a488e173.
2023-07-31 17:36:31 -07:00
Ryan Dana 25a488e173 prune horovod and some repetitive notebooks (#4307)
* prune horovod and some repetitive notebooks

* prune more notebooks

* prune more duplicate

* prune additional repeats
2023-07-17 11:58:46 -07:00
Ryan Dana f66773dcef Prune: sagemaker-python-sdk (#4257) 2023-07-17 10:33:08 -07:00
atqy 828fe87c12 migrate sparkml_serving_emr_mleap_abalone.ipynb to regional bucket (#4202) 2023-06-06 18:05:59 -07:00
atqy 7b789e1f18 remediate pytorch_local_mode_cifar10.ipynb to py38+ (#4074)
Co-authored-by: EC2 Default User <ec2-user@ip-172-16-66-230.us-west-2.compute.internal>
2023-05-24 12:55:57 -07:00
atqy ba356b063b remediate notebooks to py38+ (#4037)
* remediate notebooks to py38+

* fix

* revert
2023-05-22 12:17:04 -07:00
TAE YOUNGDON 9fb2a9e837 Modify the framework version and Python version to match the appropriate DLC version. (#3985)
* Update sagemaker_batch_inference_torchserve.ipynb

* upgrade sagemaker

* upgrade kernel

---------

Co-authored-by: atqy <atqy@amazon.com>
Co-authored-by: atqy <95724753+atqy@users.noreply.github.com>
2023-05-22 11:47:39 -07:00
atqy a5207d2406 remediate notebooks to py38+ (#4036) 2023-05-22 09:48:00 -07:00
atqy e012d8dc85 remediate notebooks to py38+ (#4035) 2023-05-22 09:47:40 -07:00
atqy c6f8241f40 remediate notebooks to py38+ (#4034) 2023-05-21 10:22:59 -07:00
atqy 1dda9cbaec remediate notebook to py38+ (#4032)
* remediate notebook to py38+

* revert
2023-05-21 10:22:41 -07:00
atqy ad81f9d60e remediate notebooks to py38+ (#4033)
* remediate notebooks to py38+

* fix
2023-05-21 08:41:49 -07:00
atqy 4f59c4e1b5 remediate notebooks to py38+ (#4031) 2023-05-20 23:26:04 -07:00
atqy de2f41e1ac remediate notebooks to py38+ (#4030) 2023-05-20 21:23:49 -07:00
atqy 0c36d53493 remediate notebooks to py38+ (#4026)
* remediate notebooks to py38+

* revert
2023-05-20 18:59:10 -07:00
atqy 0c1e112b3a remediate notebooks to py38+ (#4022)
* remediate notebooks to py38+

* revert
2023-05-20 13:47:53 -07:00
atqy 158121d39d remediate notebooks to py38+ (#4015)
* remediate notebooks to py38+

* revert
2023-05-19 20:19:47 -07:00
atqy 5a369b403e remediate notebooks to py38+ (#4016)
* remediate notebooks to py38+

* revert
2023-05-19 16:51:22 -07:00
atqy b7bfbca79f remediate notebooks to py38+ (#4012)
* remediate notebooks to py38+

* revert
2023-05-19 14:02:45 -07:00
atqy 18fc469ba7 remediate notebooks to py38+ (#4013) 2023-05-19 13:10:05 -07:00
atqy b3913822fc remediate notebooks to py38+ (#4011) 2023-05-19 11:00:44 -07:00
atqy f3d934161e remediate notebooks to py38+ (#4008)
* remediate notebooks to py38+

* fix

* fix
2023-05-19 09:10:40 -07:00
atqy 7e07bb432a remediate to py38 (#4005) 2023-05-18 16:22:02 -07:00
atqy ce8bcdceef remediate to py38 (#4004) 2023-05-18 15:17:47 -07:00
atqy 3813335a6b Fix remediation py38 (#4003)
* fix Amazon_JumpStart_Text_To_Image.ipynb

* fix Amazon_JumpStart_Named_Entity_Recognition.ipynb

* fix object_detection_birds.ipynb

* delete instance_type

* fix tensorboard_keras.ipynb

* fix huggingface-text-classification-serverless-inference.ipynb

* fix credit_card_fraud_detector.ipynb

* format

* fix pytorch_smdataparallel_mnist_demo.ipynb

* revert
2023-05-18 12:19:41 -07:00
atqy dfc5bc47aa remediate to py38 (#4002)
* remediate to py38

* format

* revert
2023-05-18 11:14:28 -07:00
atqy a7228a6477 remediate to py38 (#3999)
* remediate to py38

* change to regional buckets

* revert lambda

* format

* fix

* fix
2023-05-17 22:00:41 -07:00
atqy 3d28f1d8de Fix badges (#3977)
* edit CONTRIBUTING to include badges fix

* fix badges for read the docs
2023-05-03 17:27:57 -07:00
atqy 22b8203af3 Add badges (#3957)
* prep notebooks for badging propagation

* prep

* add badges to notebooks
2023-04-26 11:41:27 -07:00
Malav Shastri b81b8f5077 upgrade SKlearn version to 1.2-1 (#3872)
* upgrade SKlearn version to 1.2-1

* Update sagemaker version

* Fix processing job failures

* resolve errors related to 1.2-1 upgrade

* Upgrade Sagemaker version to address errors

* Resolve 1.2-1 upgrade errors

---------

Co-authored-by: Malav Shastri <malavhs@amazon.com>
2023-03-30 13:14:14 -07:00
Sean Morgan d4c6f909aa Refresh SparkML serving (#3787)
* Refresh SparkML serving

* Format

* grammar

---------

Co-authored-by: atqy <95724753+atqy@users.noreply.github.com>
2023-03-08 17:25:47 -08:00
atqy e63a03fbaf Update mead kernels (#3738)
* change kernel

* change kernel

* change kernel

* change kernal

* change kernal

* change kernal

Co-authored-by: EC2 Default User <ec2-user@ip-172-16-73-51.us-west-2.compute.internal>
2023-01-13 10:08:34 -08:00
atqy 7a306547b7 Fix mead tests (#3681)
* fix sagemaker-python-sdk/mxnet_onnx_superresolution/mxnet_onnx.ipynb

* fix sagemaker-python-sdk/tensorflow_script_mode_quickstart/tensorflow_script_mode_quickstart.ipynb
2022-12-05 14:55:26 -08:00
atqy f5257429dd Reinvent sdk test fix (#3664)
* fix tensorflow_script_mode_pipe_mode.ipynb

* fix advanced_functionality/kmeans_bring_your_own_model/kmeans_bring_your_own_model.ipynb

* fix sagemaker-python-sdk/mxnet_onnx_export/mxnet_onnx_export.ipynb

* fix sagemaker-python-sdk/tensorflow_serving_using_elastic_inference_with_your_own_model/tensorflow_serving_pretrained_model_elastic_inference.ipynb

* fix sagemaker-python-sdk/mxnet_gluon_sentiment/mxnet_sentiment_analysis_with_gluon.ipynb

* fix advanced_functionality/tensorflow_iris_byom/tensorflow_BYOM_iris.ipynb

* fix sagemaker-python-sdk/managed_spot_training_tensorflow_estimator/managed_spot_training_tensorflow_estimator.ipynb

* fix sagemaker-python-sdk/tensorflow_moving_from_framework_mode_to_script_mode/tensorflow_moving_from_framework_mode_to_script_mode.ipynb

* reformat notebooks

* cleanup

* cleanup

Co-authored-by: EC2 Default User <ec2-user@ip-172-16-61-50.us-east-2.compute.internal>
Co-authored-by: EC2 Default User <ec2-user@ip-172-16-59-62.ec2.internal>
2022-11-11 11:01:05 -08:00
Suraj Kota 2db714cce4 update pytorch DLC version to 1.11 in pytorch mnist sample (#3574)
* update pytorch DLC version to 1.11

The notebook fails with current 1.8 pytorch. I think its a problem with the torchvision installed in the container.

```
AlgorithmError: ExecuteUserScriptError: Command "/opt/conda/bin/python3.6 mnist.py --backend gloo --epochs 1" INFO:__main__:Initialized the distributed environment: 'gloo' backend on 2 nodes. Current host rank is 0. Number of gpus: 0 INFO:__main__:Get train data loader Traceback (most recent call last): File "mnist.py", line 257, in <module> train(parser.parse_args()) File "mnist.py", line 114, in train train_loader = _get_train_data_loader(args.batch_size, args.data_dir, is_distributed, **kwargs) File "mnist.py", line 48, in _get_train_data_loader [transforms.ToTensor(), transforms.Normalize((0.1307,), (0.3081,))] File "/opt/conda/lib/python3.6/site-packages/torchvision/datasets/mnist.py", line 83, in __init__ ' You can use download=True to download it') RuntimeError: Dataset not found. You can use download=True to download it, exit code: 1
```

* formatting

* l = 100
2022-08-18 18:57:29 -07:00
atqy d027120df4 delete paddlepaddle_sentiment_analysis_byo_mms (#3565) 2022-08-18 12:29:53 -05:00
Shreya Pandit 9d1124e40f Update wait=True to ensure training job completes before tuning job is launched (#3538) 2022-08-12 09:33:26 -05:00
vishalseshagiri f0cda958e2 Fixes a typo (#3454) 2022-06-15 12:21:49 -05:00
Nikhil Raverkar 723b612a69 upgrading SKlearn version to 1.0-1 (#3414)
* upgrading SKlearn version to 1.0-1

* resolve errors related to 1.0-1 upgrade

* resolve errors related to 1.0-1 upgrade

* fix: Update Pipeline notebooks with latest sagemaker changes (#3424)

Co-authored-by: Dewen Qi <qidewen@amazon.com>

* fix: Fix format of Pipeline related notebooks (#3427)

Co-authored-by: Dewen Qi <qidewen@amazon.com>

* resolve errors related to 1.0-1 upgrade

* resolve errors related to 1.0-1 upgrade

* resolve errors related to 1.0-1 upgrade

* resolve errors related to 1.0-1 upgrade

* resolve errors related to 1.0-1 upgrade

* resolve errors related to 1.0-1 upgrade

* Update pipelines_product_ratings.ipynb

reverting changes

* Update sagemaker-pipelines-tuning-step.ipynb

reverting changes

* Update train register and deploy a pipeline model.ipynb

reverting changes

* Update sagemaker-pipelines-preprocess-train-evaluate-batch-transform.ipynb

reverting changes

Co-authored-by: Nikhil Raverkar <nraverka@amazon.com>
Co-authored-by: Julia Kroll <75504951+jkroll-aws@users.noreply.github.com>
Co-authored-by: qidewenwhen <32910701+qidewenwhen@users.noreply.github.com>
Co-authored-by: Dewen Qi <qidewen@amazon.com>
2022-06-02 13:04:57 -05:00
atqy 4901e8d6b3 Change HyperparameterTuner Name in mxnet_gcmc_hypertune.ipynb (#3353)
* set hypertuner name

* reformat

Co-authored-by: EC2 Default User <ec2-user@ip-172-16-41-188.us-west-2.compute.internal>
2022-04-27 16:41:52 -07:00
atqy 0cac2253e8 Fix mxnet_embedding_server.ipynb (#3345)
* fix sagemaker-python-sdk/mxnet_gluon_embedding_server/mxnet_embedding_server.ipynb

* reformat

* remove wikimedia pictures
2022-04-27 10:28:58 -07:00
Shreya Pandit a3a4b6e40e Add S3 Data Config Access for Notebooks (#3349)
Co-authored-by: Shreya Pandit <shreya@shreyapandit.com>
2022-04-25 08:41:54 -07:00
Julia Kroll f48067da50 Add notebook outputs and website links (#3342)
* Add notebook outputs, link to them from homepage

* Remove extraneous notebook file

* Tweak RST homepage headings, remove broken/misaligned outputs

* Move intro text below non-notebook Intro section
2022-04-22 17:23:50 -05:00
Shreya Pandit 150aade7f5 Update notebooks to use SDK Data Config (#3338)
* Update TF Iris Notebook to use SDK Data Config

* Update MNIST Low Level Notebook to use SDK Data Config

* Updated minor formatting

* formatting using black

* Update description of data config

* code formatting changes

Co-authored-by: Shreya Pandit <shreya@shreyapandit.com>
2022-04-22 12:16:31 -07:00
Julia Kroll 75944bad8b Revise Scikit Iris Batch Transform (#3328) 2022-04-13 17:02:06 -05:00