github-featured/aws--amazon-sagemaker-examples
2
0
Fork 0
Code Issues Pull Requests Deployments Models Agent Notes Packages Projects Releases Wiki Activity
3,137 Commits 193 Branches 1 Tag
main
Commit Graph

106 Commits

Author SHA1 Message Date
Marco Friaz 1c0826e55b Append the default_bucket_prefix to s3 paths if one exists to hyperparameter_tuning, introduction_to_amazon_algorithms and sagemaker-pipelines sample notebooks (#4807) 
**Description**
This change checks the sagemaker session if there is a default_bucket_prefix set. If a default bucket prefix is specified, it is append it to the s3 path. This was done for hyperparameter_tuning, introduction_to_amazon_algorithms and sagemaker-pipelines sample notebooks. This ensures sample notebooks that utilize s3, works in SageMaker Unified Studio.

Co-authored-by: Marco Friaz <marfriaz@amazon.com>
 2025-01-21 09:39:05 -08:00
Zhaoqi 4f6b1f6b52 Revert "New folder structure (#4694)" (#4701) 
This reverts commit 970d88ee18 due to broken blog links
 2024-07-09 12:54:45 -04:00
Zhaoqi 970d88ee18 New folder structure (#4694) 
* Deleted 17 duplicate notebooks (#4685)

* Updated README, removed broken links and fixed markdown (#4687)

* New Folder Structure Implementation - Archived remaining geospatial example notebooks (#4691)

* Archived remaining geospatial example notebooks

* Removed geospatial from README.md

* Archived remaining workshop notebooks (#4692)

* Archived outdated example notebooks between 1-90 views (#4693)

---------

Co-authored-by: jsmul <jsmul@amazon.com>
 2024-07-09 11:48:53 -04:00
atqy 12085f3bea change badging domain url (#4459) 2023-10-23 08:30:00 -07:00
Aaron Klein 7dc6a59daa Add badges to NAS notebook (#4377) 
* badges

* format

* fix
 2023-08-11 10:36:20 -07:00
Aaron Klein 0c5b65aa06 Neural Architecture Search with SageMaker AMT (#4355) 
* add notebook

* add

* old imports

* old import

* import

* remove dep

* clean up

* add performance of unpruned net

* format

* output

* add notebook

* add

* old imports

* old import

* import

* remove dep

* clean up

* add performance of unpruned net

* format

* output

* move

* rename

* link to nb

* remove

* header

* remove print

* clean up

* small fix

* comments

* typo

* comment

* clean up

* import

* exception

* typos

* add asserts

* add torch

* formatting

* format

* minor fix

* run in sm job

* output log

* format

* pytorch version

* add endpoint

* compress model

* fix deployment

* clean up

* format

* grammar

* framework version

* download tarball

* format metrics properly

* small fix

* correct metric

* max jobs

* add results unpruned

* format

* output

* add badges

---------

Co-authored-by: atqy <95724753+atqy@users.noreply.github.com>
 2023-08-10 15:16:09 -07:00
Ryan Dana c79ad65de8 prune hyperparameter_tuning (#4296) 2023-07-17 11:26:05 -07:00
atqy f81900d6ab migrate notebooks to regional buckets (#4142) 
* migrate notebooks to regional buckets

* revert
 2023-06-01 16:57:03 -07:00
atqy b37071b5fa remediate hyperparameter_tuning_for_distributed_training.ipynb to py38+ (#4093) 2023-05-25 11:16:55 -07:00
atqy 46c77fb0bb remediate HPO_Analyze_TuningJob_Results.ipynb to py38+ (#4073) 2023-05-24 11:58:35 -07:00
atqy 1dda9cbaec remediate notebook to py38+ (#4032) 
* remediate notebook to py38+

* revert
 2023-05-21 10:22:41 -07:00
atqy 0c36d53493 remediate notebooks to py38+ (#4026) 
* remediate notebooks to py38+

* revert
 2023-05-20 18:59:10 -07:00
atqy 9188a83d66 Fix and remediate broken notebooks to py38+ (#4025) 
* fix hpo_blazingtext_text_classification_20_newsgroups.ipynb

* fix hyperparameter_tuning_mxnet_gluon_cifar10_random_search.ipynb

* fix mxnet-spot-training-with-sagemakerdebugger.ipynb

* fix xgboost_parquet_input_training.ipynb

* fix hetero-tensorflow-restnet50.ipynb

* remove instance_type

* fix document_relationship_extraction.ipynb

* revert
 2023-05-20 18:58:46 -07:00
atqy 12e3b19ca8 remediate notebooks to py38+ (#4024) 2023-05-20 15:13:55 -07:00
atqy 0d3491261c Fix and remediate broken notebooks to py38+ (#4018) 
* fix notebooks

* delete instance type

* fix hpo_huggingface_text_classification_20_newsgroups.ipynb

* fix 2_cust_churn_train_deploy_infer.ipynb

* fix retail_recommend.ipynb

* fix gpt-2.ipynb

* fix explore_data.ipynb

* fix albert-base-v2.ipynb

* fix preprocessing_text_data.ipynb

* delete instance_type

* fix mxnet-realtime-analysis.ipynb

* fix helloworld-example.ipynb

* fix 2_cust_churn_train_deploy_infer.ipynb + revert

* fix 2_cust_churn_train_deploy_infer.ipynb + revert

* revert
 2023-05-20 10:15:48 -07:00
atqy 158121d39d remediate notebooks to py38+ (#4015) 
* remediate notebooks to py38+

* revert
 2023-05-19 20:19:47 -07:00
atqy 18fc469ba7 remediate notebooks to py38+ (#4013) 2023-05-19 13:10:05 -07:00
atqy b3913822fc remediate notebooks to py38+ (#4011) 2023-05-19 11:00:44 -07:00
atqy aca9deb363 remediate notebooks to py38+ (#4009) 2023-05-18 23:12:15 -07:00
atqy b96e4a75c0 remediate to py38 (#4001) 2023-05-18 08:05:29 -07:00
atqy 3d28f1d8de Fix badges (#3977) 
* edit CONTRIBUTING to include badges fix

* fix badges for read the docs
 2023-05-03 17:27:57 -07:00
Uri Rosenberg b6b5f5d1b2 Fixed auto model tuning example for distributed training (#3968) 
* Added new AMT example for dist training

* Added reference to new AMT example

* Fixed s3 link, formating and instance type

Checked download link to use s3 and sagemaker s3 utils, fixed formating using black-nb and set instance type to use ml.m5.xlarge

* Fixed typos

* Added instance and kernel specs

* Changed jobs to synchronous

* updated SM sdk to use new StrategyConfig

* fixed sdk upgrade, restart kernel and imports

* black-nb reformat

* removed kernel restart

* fixed validation data generation error and added HP for demo

* Changed to synchronous run, and updated kernelspec

---------

Co-authored-by: atqy <95724753+atqy@users.noreply.github.com>
Co-authored-by: urirosenberg <urrosenb@amazon.com>
 2023-05-01 11:55:43 -07:00
atqy 22b8203af3 Add badges (#3957) 
* prep notebooks for badging propagation

* prep

* add badges to notebooks
 2023-04-26 11:41:27 -07:00
Uri Rosenberg 5fa40040f4 New auto model tuning example for distributed training (#3854) 
* Added new AMT example for dist training

* Added reference to new AMT example

* Fixed s3 link, formating and instance type

Checked download link to use s3 and sagemaker s3 utils, fixed formating using black-nb and set instance type to use ml.m5.xlarge

* Fixed typos

* Added instance and kernel specs

* Changed jobs to synchronous

* updated SM sdk to use new StrategyConfig

* fixed sdk upgrade, restart kernel and imports

* black-nb reformat

* removed kernel restart

---------

Co-authored-by: atqy <95724753+atqy@users.noreply.github.com>
 2023-03-29 10:34:56 -07:00
Nikhil Raverkar e16f29886d adding XGB 1.7 version (#3829) 
Co-authored-by: Nikhil Raverkar <nraverka@amazon.com>
 2023-03-22 07:55:15 -07:00
atqy 92ce0e3eff fix rapids_sagemaker_hpo.ipynb (#3545) 2022-08-19 12:15:40 -05:00
atqy 76bce507c7 fix tune_r_bring_your_own.ipynb (#3562) 2022-08-18 11:55:24 -05:00
atqy bba768b9dd fix links and incorrectly used code blocks (#3528) 2022-08-05 13:04:08 -07:00
Haixin Wang 93163a8a75 update xgboost version to 1.5-1 in notebooks (#3439) 
* update xgboost to 1.5-1

* add time stamp to endpoint configuration

* fix typo

* code formatting change
 2022-06-16 10:01:30 -05:00
atqy f084267919 Reduce max_jobs in hyperparameter_tuning_mxnet_gluon_cifar10_random_search.ipynb (#3400) 
* reduce max_jobs

* change second max_jobs

* markdown edit
 2022-05-17 09:45:05 -07:00
Julia Kroll 369e3d6ff8 Fix Caltech-256 links, part 2 (#3385) 
* Fix more Caltech-256 links

* Reduce max jobs from 20 to 10; fix SDK v1, typos

* Black-nb formatting
 2022-05-12 11:31:52 -05:00
Julia Kroll f48067da50 Add notebook outputs and website links (#3342) 
* Add notebook outputs, link to them from homepage

* Remove extraneous notebook file

* Tweak RST homepage headings, remove broken/misaligned outputs

* Move intro text below non-notebook Intro section
 2022-04-22 17:23:50 -05:00
atqy dbf4cf41fe delete reinstall of PyTorch (#3341) 
* delete reinstall of PyTorch

* reformat file
 2022-04-20 13:34:45 -07:00
Julia Kroll 1514b4bce0 Revise markdown in TensorFlow MNIST HPO (#3331) 
* Revise TensorFlow MNIST HPO

* Run three jobs in parallel
 2022-04-15 16:07:32 -05:00
atqy 8279abfcc7 Clean up RTD Website #2 (#3318) 
Ignoring CI as the changes are all comestic and we need to meet a deadline

* edit advanced_functionality/multi_model_sklearn_home_value/sklearn_multi_model_endpoint_home_value.ipynb

* edit sagemaker_processing/scikit_learn_data_processing_and_model_evaluation/scikit_learn_data_processing_and_model_evaluation.ipynb

* edit sagemaker-python-sdk/managed_spot_training_tensorflow_estimator/managed_spot_training_tensorflow_estimator.ipynb

* edit sagemaker-python-sdk/managed_spot_training_mxnet/managed_spot_training_mxnet.ipynb

* edit sagemaker_batch_transform/tensorflow_cifar-10_with_inference_script/tensorflow-serving-cifar10-python-sdk.ipynb

* edit sagemaker-python-sdk/dgl_gcn/mxnet_gcn.ipynb

* edit sagemaker-python-sdk/dgl_gcn/pytorch_gcn.ipynb

* edit sagemaker-python-sdk/scikit_learn_randomforest/Sklearn_on_SageMaker_end2end.ipynb

* edit scikit_learn_model_registry_batch_transform.ipynb

* edit sagemaker-python-sdk/tensorflow_moving_from_framework_mode_to_script_mode/tensorflow_moving_from_framework_mode_to_script_mode.ipynb

* edit sagemaker-python-sdk/tensorflow_script_mode_pipe_mode/tensorflow_script_mode_pipe_mode.ipynb

* edit sagemaker-python-sdk/tensorflow_script_mode_quickstart/tensorflow_script_mode_quickstart.ipynb

* edit sagemaker-python-sdk/tensorflow_script_mode_using_shell_commands/tensorflow_script_mode_using_shell_commands.ipynb

* edit sagemaker-python-sdk/tensorflow-eager-script-mode/tf-eager-sm-scriptmode.ipynb

* edit sagemaker-python-sdk/tensorflow_script_mode_training_and_serving/tensorflow_script_mode_training_and_serving.ipynb

* edit sagemaker-python-sdk/tensorboard_keras/tensorboard_keras.ipynb

* edit reinforcement_learning/rl_cartpole_ray/rl_cartpole_ray_gymEnv.ipynb

* edit reinforcement_learning/rl_roboschool_ray/rl_roboschool_ray.ipynb

* edit reinforcement_learning/rl_cartpole_coach/rl_cartpole_coach_gymEnv.ipynb

* edit reinforcement_learning/rl_managed_spot_cartpole_coach/rl_managed_spot_cartpole_coach_gymEnv.ipynb

* edit reinforcement_learning/rl_roboschool_ray/rl_roboschool_ray_automatic_model_tuning.ipynb

* edit reinforcement_learning/rl_hvac_coach_energyplus/rl_hvac_coach_energyplus.ipynb

* edit reinforcement_learning/rl_unity_ray/rl_unity_ray.ipynb

* edit reinforcement_learning/rl_game_server_autopilot/sagemaker/rl_gamerserver_ray.ipynb

* edit reinforcement_learning/rl_network_compression_ray_custom/rl_network_compression_ray_custom.ipynb

* edit reinforcement_learning/rl_traveling_salesman_vehicle_routing_coach/rl_traveling_salesman_vehicle_routing_coach.ipynb

* edit hyperparameter_tuning/xgboost_direct_marketing/hpo_xgboost_direct_marketing_sagemaker_APIs.ipynb

* edit hyperparameter_tuning/xgboost_direct_marketing/hpo_xgboost_direct_marketing_sagemaker_python_sdk.ipynb

* edit hyperparameter_tuning/xgboost_random_log/hpo_xgboost_random_log.ipynb

* edit training/distributed_training/tensorflow/data_parallel/maskrcnn/tensorflow2_smdataparallel_maskrcnn_demo.ipynb

* edit training/distributed_training/tensorflow/data_parallel/mnist/tensorflow2_smdataparallel_mnist_demo.ipynb

* edit sagemaker-python-sdk/mxnet_mnist/mxnet_mnist.ipynb

* edit sagemaker-python-sdk/mxnet_horovod_fasterrcnn/horovod_deployment_notebook.ipynb

* edit sagemaker-python-sdk/mxnet_horovod_maskrcnn/horovod_deployment_notebook.ipynb

* edit introduction_to_amazon_algorithms/imageclassification_caltech/Image-classification-fulltraining-elastic-inference.ipynb

* edit introduction_to_amazon_algorithms/imageclassification_caltech/Image-classification-incremental-training-highlevel.ipynb

* edit introduction_to_amazon_algorithms/imageclassification_caltech/Image-classification-lst-format-highlevel.ipynb

* edit introduction_to_amazon_algorithms/imageclassification_caltech/Image-classification-transfer-learning.ipynb

* edit introduction_to_amazon_algorithms/imageclassification_caltech/Image-classification-transfer-learning-highlevel.ipynb

* edit introduction_to_amazon_algorithms/imageclassification_caltech/Image-classification-fulltraining.ipynb

* edit introduction_to_amazon_algorithms/imageclassification_caltech/Image-classification-fulltraining-highlevel.ipynb

* edit introduction_to_amazon_algorithms/imageclassification_caltech/Image-classification-fulltraining-highlevel.ipynb

* edit introduction_to_amazon_algorithms/imageclassification_mscoco_multi_label/Image-classification-multilabel-lst.ipynb

* edit introduction_to_amazon_algorithms/object_detection_birds/object_detection_birds.ipynb

* edit introduction_to_amazon_algorithms/blazingtext_text_classification_dbpedia/blazingtext_text_classification_dbpedia.ipynb

* edit introduction_to_amazon_algorithms/blazingtext_word2vec_subwords_text8/blazingtext_word2vec_subwords_text8.ipynb

* edit introduction_to_amazon_algorithms/blazingtext_word2vec_subwords_text8/blazingtext_word2vec_subwords_text8.ipynb

* edit introduction_to_amazon_algorithms/blazingtext_word2vec_text8/blazingtext_word2vec_text8.ipynb

* edit introduction_to_amazon_algorithms/lda_topic_modeling/LDA-Introduction.ipynb

* edit scientific_details_of_algorithms/ntm_topic_modeling/ntm_wikitext.ipynb

* edit introduction_to_amazon_algorithms/ntm_synthetic/ntm_synthetic.ipynb

* edit introduction_to_applying_machine_learning/ntm_20newsgroups_topic_modeling/ntm_20newsgroups_topic_model.ipynb

* edit introduction_to_amazon_algorithms/seq2seq_translation_en-de/SageMaker-Seq2Seq-Translation-English-German.ipynb

* edit introduction_to_amazon_algorithms/deepar_electricity/DeepAR-Electricity.ipynb

* edit introduction_to_amazon_algorithms/k_nearest_neighbors_covtype/k_nearest_neighbors_covtype.ipynb

* edit introduction_to_amazon_algorithms/xgboost_abalone/xgboost_abalone.ipynb

* edit introduction_to_amazon_algorithms/xgboost_abalone/xgboost_abalone_dist_script_mode.ipynb

* edit sagemaker-python-sdk/1P_kmeans_highlevel/kmeans_mnist.ipynb

* edit sagemaker-python-sdk/1P_kmeans_lowlevel/kmeans_mnist_lowlevel.ipynb

* edit introduction_to_amazon_algorithms/random_cut_forest/random_cut_forest.ipynb

* edit introduction_to_amazon_algorithms/object2vec_sentence_similarity/object2vec_sentence_similarity.ipynb

* edit introduction_to_amazon_algorithms/object2vec_movie_recommendation/object2vec_movie_recommendation.ipynb

* edit sagemaker_neo_compilation_jobs/tensorflow_distributed_mnist/tensorflow_distributed_mnist_neo.ipynb

* edit advanced_functionality/multi_model_xgboost_home_value/xgboost_multi_model_endpoint_home_value.ipynb

* edit sagemaker_model_monitor/tensorflow/SageMaker-Model-Monitor-tensorflow.ipynb

* edit sagemaker_model_monitor/fairness_and_explainability/SageMaker-Model-Monitor-Fairness-and-Explainability.ipynb

* edit scientific_details_of_algorithms/lda_topic_modeling/LDA-Science.ipynb

* edit sagemaker-debugger/tensorflow_profiling/tf-resnet-profiling-multi-gpu-multi-node-boto3.ipynb

* edit sagemaker-debugger/tensorflow_profiling/tf-resnet-profiling-multi-gpu-multi-node.ipynb

* edit aws_marketplace/using_model_packages/auto_insurance/automating_auto_insurance_claim_processing.ipynb

* add links to inference/data_types/.html

* edit data_types/hteml
 2022-04-12 11:05:27 -07:00
atqy 9acccc8df9 Make Training Job Name Unique in hpo_xgboost_random_log.ipynb (#3201) 
* make training job name more unique

* reformat code
 2022-03-03 15:50:03 -08:00
atqy 07b593e29f increase volume size for hyperparameter_tuning/tensorflow2_mnist/hpo_tensorflow2_mnist.ipynb (#3183) 
Co-authored-by: EC2 Default User <ec2-user@ip-172-16-159-201.ec2.internal>
 2022-02-21 18:45:42 -06:00
Julia Kroll 6e42d82762 Fix HPO analysis (#2998) 2021-10-29 15:29:13 -05:00
Eitan Sela b8b93b77d1 Text Classification with Amazon SageMaker HuggingFace and Hyperparameter Tuning Tuning (#2931) 2021-09-16 17:04:02 -07:00
Eitan Sela b0110c4aad Text Classification with Amazon SageMaker BlazingText and Hyperparameter Tuning (#2918) 
* Create hpo_blazingtext_text_classification_20_newsgroups.ipynb

* Update hpo_blazingtext_text_classification_20_newsgroups.ipynb

* Update hpo_blazingtext_text_classification_20_newsgroups.ipynb

* Update hpo_blazingtext_text_classification_20_newsgroups.ipynb
 2021-09-09 11:01:26 -05:00
Sarah Yurick 088a8cf4f5 Update RAPIDS HPO with most recent RAPIDS version (#2821) 
* update HPO notebook

* minor workflow updates

* minor API updates

* reset default Dockerfile params

* minor notebook reformatting

* remove unnecessary comment

* remove comment
 2021-08-04 12:28:26 -04:00
Hongshan Li 8af65dcfb7 fix hpo_xgboost_random_log.ipynb (#2701) 2021-06-14 12:56:38 -05:00
Hongshan Li aa9d78a6cf Fix hpo_pytorch_mnist.ipynb (#2677) 
* fix hpo_pytorch_mnist.ipynb

* update entry point
 2021-06-09 16:24:18 -05:00
Ajay Karpur d16688d83c infra: format .py and .ipynb files with black (#2598) 2021-05-24 17:15:44 -07:00
Hongshan Li b8b1755d44 Add missing modules to hpo_tensorflow_mnist.ipynb (#2569) 
* add missing modules to hpo_tensorflow_mnist.ipynb

* change kernel
 2021-05-21 18:35:20 -05:00
Hongshan Li 20b9c951cb reset kernel of hpo_tensorflow_mnist.ipynb (#2549) 
* reset kernel to conda_tensorflow2_p36

* reset to tf1
 2021-05-20 12:40:48 -05:00
Hongshan Li 7e03a8420a Del files (#2551) 
* remove unused files

* delete files

* remove chainer files
 2021-05-18 18:32:16 -07:00
Hongshan Li a4c5d52642 delete chainer_single_machine_cifar10.ipynb (#2230) 2021-05-13 07:57:38 -07:00
Ajay Karpur 187e52fc3d infra: sort imports in all .py files with isort (#2225) 2021-05-11 16:00:33 -07:00
Ajay Karpur af6667bd0b infra: format all .ipynb files with black-nb (#2224) 2021-05-11 15:43:29 -07:00