main
13 Commits
| Author | SHA1 | Message | Date | |
|---|---|---|---|---|
 Zhaoqi
|
c3ce68a9ef |
Fix bugs in most viewed examples (#4663)
* update python version Change python version to be "mambaforge-22.9" * Update transformers package version in example notebook update deploy_bert_outputs notebook * Update scikit_learn_data_processing_and_model_evaluation.ipynb * Fix llama-2-text-completion notebook * Update llama-2-chat-completion.ipynb * Update pytorch_mnist.ipynb * Update DeepAR-Electricity.ipynb * Fix code format in llama-2-text-completion * Update CONTRIBUTING.md |
||
|
atqy
|
12085f3bea | change badging domain url (#4459) | ||
|
atqy
|
3d28f1d8de |
Fix badges (#3977)
* edit CONTRIBUTING to include badges fix * fix badges for read the docs |
||
|
atqy
|
22b8203af3 |
Add badges (#3957)
* prep notebooks for badging propagation * prep * add badges to notebooks |
||
|
atqy
|
9ce4ec2336 |
Fix scikit_learn_data_processing_and_model_evaluation.ipynb (#3539)
* enable optional steps to avoid error being raised in scikit_learn_data_processing_and_model_evaluation.ipynb * edit markdown * reformat |
||
|
atqy
|
8279abfcc7 |
Clean up RTD Website #2 (#3318)
Ignoring CI as the changes are all comestic and we need to meet a deadline * edit advanced_functionality/multi_model_sklearn_home_value/sklearn_multi_model_endpoint_home_value.ipynb * edit sagemaker_processing/scikit_learn_data_processing_and_model_evaluation/scikit_learn_data_processing_and_model_evaluation.ipynb * edit sagemaker-python-sdk/managed_spot_training_tensorflow_estimator/managed_spot_training_tensorflow_estimator.ipynb * edit sagemaker-python-sdk/managed_spot_training_mxnet/managed_spot_training_mxnet.ipynb * edit sagemaker_batch_transform/tensorflow_cifar-10_with_inference_script/tensorflow-serving-cifar10-python-sdk.ipynb * edit sagemaker-python-sdk/dgl_gcn/mxnet_gcn.ipynb * edit sagemaker-python-sdk/dgl_gcn/pytorch_gcn.ipynb * edit sagemaker-python-sdk/scikit_learn_randomforest/Sklearn_on_SageMaker_end2end.ipynb * edit scikit_learn_model_registry_batch_transform.ipynb * edit sagemaker-python-sdk/tensorflow_moving_from_framework_mode_to_script_mode/tensorflow_moving_from_framework_mode_to_script_mode.ipynb * edit sagemaker-python-sdk/tensorflow_script_mode_pipe_mode/tensorflow_script_mode_pipe_mode.ipynb * edit sagemaker-python-sdk/tensorflow_script_mode_quickstart/tensorflow_script_mode_quickstart.ipynb * edit sagemaker-python-sdk/tensorflow_script_mode_using_shell_commands/tensorflow_script_mode_using_shell_commands.ipynb * edit sagemaker-python-sdk/tensorflow-eager-script-mode/tf-eager-sm-scriptmode.ipynb * edit sagemaker-python-sdk/tensorflow_script_mode_training_and_serving/tensorflow_script_mode_training_and_serving.ipynb * edit sagemaker-python-sdk/tensorboard_keras/tensorboard_keras.ipynb * edit reinforcement_learning/rl_cartpole_ray/rl_cartpole_ray_gymEnv.ipynb * edit reinforcement_learning/rl_roboschool_ray/rl_roboschool_ray.ipynb * edit reinforcement_learning/rl_cartpole_coach/rl_cartpole_coach_gymEnv.ipynb * edit reinforcement_learning/rl_managed_spot_cartpole_coach/rl_managed_spot_cartpole_coach_gymEnv.ipynb * edit reinforcement_learning/rl_roboschool_ray/rl_roboschool_ray_automatic_model_tuning.ipynb * edit reinforcement_learning/rl_hvac_coach_energyplus/rl_hvac_coach_energyplus.ipynb * edit reinforcement_learning/rl_unity_ray/rl_unity_ray.ipynb * edit reinforcement_learning/rl_game_server_autopilot/sagemaker/rl_gamerserver_ray.ipynb * edit reinforcement_learning/rl_network_compression_ray_custom/rl_network_compression_ray_custom.ipynb * edit reinforcement_learning/rl_traveling_salesman_vehicle_routing_coach/rl_traveling_salesman_vehicle_routing_coach.ipynb * edit hyperparameter_tuning/xgboost_direct_marketing/hpo_xgboost_direct_marketing_sagemaker_APIs.ipynb * edit hyperparameter_tuning/xgboost_direct_marketing/hpo_xgboost_direct_marketing_sagemaker_python_sdk.ipynb * edit hyperparameter_tuning/xgboost_random_log/hpo_xgboost_random_log.ipynb * edit training/distributed_training/tensorflow/data_parallel/maskrcnn/tensorflow2_smdataparallel_maskrcnn_demo.ipynb * edit training/distributed_training/tensorflow/data_parallel/mnist/tensorflow2_smdataparallel_mnist_demo.ipynb * edit sagemaker-python-sdk/mxnet_mnist/mxnet_mnist.ipynb * edit sagemaker-python-sdk/mxnet_horovod_fasterrcnn/horovod_deployment_notebook.ipynb * edit sagemaker-python-sdk/mxnet_horovod_maskrcnn/horovod_deployment_notebook.ipynb * edit introduction_to_amazon_algorithms/imageclassification_caltech/Image-classification-fulltraining-elastic-inference.ipynb * edit introduction_to_amazon_algorithms/imageclassification_caltech/Image-classification-incremental-training-highlevel.ipynb * edit introduction_to_amazon_algorithms/imageclassification_caltech/Image-classification-lst-format-highlevel.ipynb * edit introduction_to_amazon_algorithms/imageclassification_caltech/Image-classification-transfer-learning.ipynb * edit introduction_to_amazon_algorithms/imageclassification_caltech/Image-classification-transfer-learning-highlevel.ipynb * edit introduction_to_amazon_algorithms/imageclassification_caltech/Image-classification-fulltraining.ipynb * edit introduction_to_amazon_algorithms/imageclassification_caltech/Image-classification-fulltraining-highlevel.ipynb * edit introduction_to_amazon_algorithms/imageclassification_caltech/Image-classification-fulltraining-highlevel.ipynb * edit introduction_to_amazon_algorithms/imageclassification_mscoco_multi_label/Image-classification-multilabel-lst.ipynb * edit introduction_to_amazon_algorithms/object_detection_birds/object_detection_birds.ipynb * edit introduction_to_amazon_algorithms/blazingtext_text_classification_dbpedia/blazingtext_text_classification_dbpedia.ipynb * edit introduction_to_amazon_algorithms/blazingtext_word2vec_subwords_text8/blazingtext_word2vec_subwords_text8.ipynb * edit introduction_to_amazon_algorithms/blazingtext_word2vec_subwords_text8/blazingtext_word2vec_subwords_text8.ipynb * edit introduction_to_amazon_algorithms/blazingtext_word2vec_text8/blazingtext_word2vec_text8.ipynb * edit introduction_to_amazon_algorithms/lda_topic_modeling/LDA-Introduction.ipynb * edit scientific_details_of_algorithms/ntm_topic_modeling/ntm_wikitext.ipynb * edit introduction_to_amazon_algorithms/ntm_synthetic/ntm_synthetic.ipynb * edit introduction_to_applying_machine_learning/ntm_20newsgroups_topic_modeling/ntm_20newsgroups_topic_model.ipynb * edit introduction_to_amazon_algorithms/seq2seq_translation_en-de/SageMaker-Seq2Seq-Translation-English-German.ipynb * edit introduction_to_amazon_algorithms/deepar_electricity/DeepAR-Electricity.ipynb * edit introduction_to_amazon_algorithms/k_nearest_neighbors_covtype/k_nearest_neighbors_covtype.ipynb * edit introduction_to_amazon_algorithms/xgboost_abalone/xgboost_abalone.ipynb * edit introduction_to_amazon_algorithms/xgboost_abalone/xgboost_abalone_dist_script_mode.ipynb * edit sagemaker-python-sdk/1P_kmeans_highlevel/kmeans_mnist.ipynb * edit sagemaker-python-sdk/1P_kmeans_lowlevel/kmeans_mnist_lowlevel.ipynb * edit introduction_to_amazon_algorithms/random_cut_forest/random_cut_forest.ipynb * edit introduction_to_amazon_algorithms/object2vec_sentence_similarity/object2vec_sentence_similarity.ipynb * edit introduction_to_amazon_algorithms/object2vec_movie_recommendation/object2vec_movie_recommendation.ipynb * edit sagemaker_neo_compilation_jobs/tensorflow_distributed_mnist/tensorflow_distributed_mnist_neo.ipynb * edit advanced_functionality/multi_model_xgboost_home_value/xgboost_multi_model_endpoint_home_value.ipynb * edit sagemaker_model_monitor/tensorflow/SageMaker-Model-Monitor-tensorflow.ipynb * edit sagemaker_model_monitor/fairness_and_explainability/SageMaker-Model-Monitor-Fairness-and-Explainability.ipynb * edit scientific_details_of_algorithms/lda_topic_modeling/LDA-Science.ipynb * edit sagemaker-debugger/tensorflow_profiling/tf-resnet-profiling-multi-gpu-multi-node-boto3.ipynb * edit sagemaker-debugger/tensorflow_profiling/tf-resnet-profiling-multi-gpu-multi-node.ipynb * edit aws_marketplace/using_model_packages/auto_insurance/automating_auto_insurance_claim_processing.ipynb * add links to inference/data_types/.html * edit data_types/hteml |
||
|
Shyam Namavarm
|
0e9eb3d661 |
Updated Processing Notebook to add FrameworkProcessor example and dem… (#2991)
* Updated Processing Notebook to add FrameworkProcessor example and demonstrate inclusion of custom dependencies with processing containers from SciKitLearn, PyTorch,MXNet etc * Added FrameworkProcessor example changes * Fixed grammer typo |
||
|
Ajay Karpur
|
af6667bd0b | infra: format all .ipynb files with black-nb (#2224) | ||
|
Eitan Sela
|
c51a1e028b |
Updated scikit_learn_data_processing_and_model_evaluation.ipynb for SageMaker SDK v2 (#1937)
Notebook needed updates to be compatible with the v2 of the SageMaker SDK, which is the new Default SDK version in SageMaker. |
||
|
Sean Morgan
|
ef9d461418 |
* Add framework_version to SKLearn estimator (#1716)
Co-authored-by: Sean Morgan <seanmrgn@amazon.com> |
||
|
sife
|
6eb6bb8e4b | Fix CN ECR URI suffix in Batch Transform and Processing Notebooks (#1206) | ||
|
sife
|
7a83cc5475 |
Fix ecr image uri suffix for CN partition (#1141)
* Add linear learner training job with file system input data source * Fix ecr image uri suffix for china partition |
||
|
Chuyang
|
714652a4f9 |
change: adding reinvent notebook examples (#941)
* Sagemaker debugger example notebook (#38) * add files for sagemaker debugger notebook * updated notebook * added subfolder * update files * Notebook to enable monitoring for existing Endpoints (#43) * MNIST training with TensorFlow and CloudWatch monitoring of Rule jobs (#49) * MNIST training with TensorFlow and CloudWatch monitoring of Rule jobs * Model monitor end to end notebook (#53) This notebook demonstrates the end to end flow of setting up an Endpoint with data capture, creating a baseline and setting up a monitoring schedule. * Fixing minor issues (#51) * SMDebugger notebook for plotting tensors in realtime (#39) * SMDebugger notebook for plotting tensors in realtime This shows how to run training job asynchronously and plot output of first convolutional layer activations and weights. * Update mxnet-realtime-analysis.ipynb * Adding TensorFlow MNIST analysis example with a custom gradient rule (#41) * Adding TensorFlow MNIST analysis example with a custom gradient rule * Addressing comments * Apply suggestions from code review * Correcting errors in the TensorFlow MNIST Custom Rule example (#47) * Correcting errors in the TensorFlow MNIST Custom Rule example * Correcting typos * Tornasole -> Debugger * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Edit pass for grammar in code review Simple editorial pass for readability. * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * SMDebugger notebook editorial review Edit pass for readability. * Update to use some new methods in smdebug and pysdk * First version or README for SM Debugger (#56) * First version or README for SM Debugger * Update README.md * Model monitoring visualization example (#52) Notebook for visualizing the results generated by a monitoring execution. * Debugger readme brief edit (#60) Terminology udpate * Adding example of MNIST TensorFlow analysis with Rules and reacting o… (#55) * Adding example of MNIST TensorFlow analysis with Rules and reacting off Rule statuses with CloudWatch Events * Correcting Typos and more instructions for Lambda setup * One more Typo fix * fixed example (#61) * fixed example * Add installing section * Modified realtime analysis notebook for MEAD/Loosleaf (#58) * Modified realtime analysis notebook for MEAD/Loosleaf As a result of this notebook will only be runnable after GA as setup section is missing. * Update mxnet version * Update mxnet version * Update install smdebug section * Notebook demonstrating how to enable spot training with sagemaker debugger (#44) * Notebook demonstrating the usage of spot training with SageMaker Debugger * Fixed the notebook to add the checkpoint s3 uri * Moved the files to right location. * Updated the notebook for GA * Added the description regarding how SageMaker works with Spot Training. * Making some content changes * Restructure notebooks, and update the rules notebooks (#57) * Move tensorflow debugging to own folder * Rename folder * Rename files add readme * Move and update custom rule notebook * Update links to notebooks in README * Test and update for GA, the rule notebooks for TF * Brought cloudwatch notebook to using_rules folder, and updated script name and import line, Also added to readme * Update main readme * Ishan's comments addressed * fix train_volume and mxnet version - train_volume_size should be 400GB - mxnet version should be 1.6.0 * fixed kernel name * fixed kernel to conda_mxnet_p36 * Add SageMaker Debugger XGBoost Rules notebook (#54) * Add SageMaker Debugger XGBoost Rules notebook * Rename notebook * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * XGBoost Rules notebook edit review Simple edit pass for grammar and style. * Address comments by rahul003 and john-andrilla * Address comments by john-andrilla * Add debughookconfig and rules description * Final test and add one more feature importance plot * Add description for SHAP * Rename 1p rules to builtin rules * Updated to imports * Add SageMaker Debugger XGBoost realtime analysis notebook (#50) * Add SageMaker Debugger XGBoost realtime analysis notebook * Remove pre-GA setup * Change all Debugger to Amazon SageMaker Debugger * clean up output of cells * Add an example notebook for data preprocessing using SageMaker Processing and Spark (#59) Add an example notebook for data preprocessing using SageMaker Processing and Spark * Add processing sklearn example (#63) Add processing sklearn example * tf-mnist-custom-rule.ipynb editorial review (#65) Simple edit pass for grammar and style. * XGBoost realtime analysis text edit (#64) * Start new review * Move notebook to a temp file for text review * Produce text diff * Copy to another file for edit * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * XGBoost Rules notebook edit review Simple edit pass for grammar and readability. * Change temp file with edits back to original * Changes to catch up with SDK (#66) * Add keras example, and rename folders to make it clear that they are tensorflow (#67) * Rename to tensorflow_using_rules * Add keras example and split notebooks into three different folders * Rename notebook * Incorporate editorial changes for custom rule notebook * Another rename * Editorial changes * Address review comments by adding description at top of scripts, and making tf_keras tensorflow_keras * Update tf_keras_resnet_byoc.py * Doc update and bug fixes in TF MNIST stop training job example (#70) * Doc update and bug fixes in TF MNIST stop training job example * Cleanup * Updated the text in notebook from Sagemaker-dbugger to Amazon SageMak… (#68) * Updated the text in notebook from Sagemaker-dbugger to Amazon SageMaker Debugger * Added try-except block around invoke_rule to catch NoMoreData exception * Removed the empty cell * Modified SageMaker Debugger to Amazon SageMaker Debugger * TF MNIST buildin rule doc fix and bug fix (#69) * TF MNIST buildin rule doc fix and bug fix * remove output selectively * Remove output selectively * Fix typos (#72) * Name Change (#73) * name change * fix * fix * Update tf-mnist-builtin-rule.ipynb Remove the in front of Amazon SageMaker * Update tf-keras-custom-rule.ipynb * Update links in readme (#74) * add sagemaker experiment management sample notebook (#40) * add sagemaker experiment management sample notebook * Downloading sdks and service2.json from a different s3 uri * Address comments and update text. * remove pre-GA cmds * remove cleanup and rename the directory * delete old dir * remove cell output * Fix intro text * Removed unnencessary imports and used the right pip command to install smdebug (#77) * Clear outputs except plots in xgboost debugger notebooks (#75) * Add regression plots * Add confusion matrix gif * Add plots back in * Use python -m instead of pip and use latest pysdk api * Remove extra exclamation point * Fix typos * SMDebugger Example with BYOC (#45) * Example with BYOC * Addressed review comments * Updates to text of notebook * Added a rule and hook from config * Change folder and notebook name * Remove old notebook and script * Remove extra files * Update README * Dont use import all * Updated notebook * Add Deep Graph Library Amazon examples for SageMaker (#48) * Add gcn_tox21 example * Add DGL examples for sagemaker Including GCMC, KGE and GCN * Add KGE hypertune example * add more details * Add sample notebook for AP (#62) * Create sagemaker_automl_direct_marketing.ipynb * Add files via upload * Notebook for AP editorial review Simple edit pass for grammar and style. * Apply suggestions from code review Applied changes from editor review. Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Add files via upload Updated to show the results of batch transform from Tanya * Delete sagemaker_automl_direct_marketing.ipynb Remove incorrectly named file. * Add files via upload Removed output * rebase staging repo with public repo (#78) * Adding a link to DeepRacer ArXiv paper (#915) * adding a video that shows deepracer working in various tracks * adding deepracer paper link to readme * fixing line breaks * fixing line breaks * fixing line breaks * fixing back slash * Add example notebooks for AWS Step Functions Data Science SDK (#917) * Support restoring checkpoint in ray; Add packages in dockerfile (#919) * Support restoring checkpoint in ray; Add packages in dockerfile * Minor formatting fix * Allow user to specify checkpoint in two ways; move notice to launch() * Remove extra space * Add dict and list in _autotype() * Recursively looking for checkpoint path * Fixed broken links (#897) * Adding a new sample notebook demonstrating using data from AWS Data Exchange for training a machine learning model" (#930) * Renamed sample notebook file (#932) * Adding a new sample notebook demonstrating using data from AWS Data Exchange for training a machine learning model" * Rename file * Sagemaker public notebook consistant with the AWS Deepracer console code (#927) * Sagemaker public notebook consistant with the AWS Deepracer console code 1. Fix Exception being Thrown By 4XX Errors 2. Separate User and System Errors for S3 Calls 3. Fix Out of Memory Issue in Training Worker 4. Reduced the time to upload sim traces to S3 to 1minute befor job exits 5. Remove sending training metrics to cloudwatch as reward graphs uses training metrics from the s3 bucket 6. Upload SIM_TRACE data to s3 bucket of the launched job for training and evaluation 7. Modified mameory backend system errors as inofrmation logs as SIMAPP is not halted by these errors 8. Don't allow the car to move backwards 7. Call os._exit when simapp encounters system or user error leading to exit * Changing the S3 bucket for the robomaker simapp * Add sample notebooks for multi-model endpoints functionality (#935) * Add sample notebooks for multi-model endpoints functionality. * Add batch RL example notebook (#926) * adding mxnet embedding serving notebook (#882) * adding ImagNet embedding notebook from gluon vision zoo * modified the resnet embedding following PR review * removed the training API part, updated to mxnet 1.4, enriched the markdown doc. * Embedding demo fix (#938) * using a more robust artifact finding mechanism using an environment variable to explicitely call model file by name instead of using os.listdir() * added the working demo to the fix branch for the PR * Add three ORL examples (#934) * Initial commit for ORL examples * Address comments on bin packing nb; Add news vendor * Finish three notebooks; Add README * Delete duplicated noteboks; Clean up cells * Fix typo & address comments * Add README for RL directory; Typo fix in network compression README file (#940) * Add README for RL directory; Typo fix in network compression README file * Modify README for batch example * Sagemaker debugger example notebook (#38) * add files for sagemaker debugger notebook * updated notebook * added subfolder * update files * Notebook to enable monitoring for existing Endpoints (#43) * MNIST training with TensorFlow and CloudWatch monitoring of Rule jobs (#49) * MNIST training with TensorFlow and CloudWatch monitoring of Rule jobs * Model monitor end to end notebook (#53) This notebook demonstrates the end to end flow of setting up an Endpoint with data capture, creating a baseline and setting up a monitoring schedule. * Fixing minor issues (#51) * SMDebugger notebook for plotting tensors in realtime (#39) * SMDebugger notebook for plotting tensors in realtime This shows how to run training job asynchronously and plot output of first convolutional layer activations and weights. * Update mxnet-realtime-analysis.ipynb * Adding TensorFlow MNIST analysis example with a custom gradient rule (#41) * Adding TensorFlow MNIST analysis example with a custom gradient rule * Addressing comments * Apply suggestions from code review * Correcting errors in the TensorFlow MNIST Custom Rule example (#47) * Correcting errors in the TensorFlow MNIST Custom Rule example * Correcting typos * Tornasole -> Debugger * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Edit pass for grammar in code review Simple editorial pass for readability. * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * SMDebugger notebook editorial review Edit pass for readability. * Update to use some new methods in smdebug and pysdk * First version or README for SM Debugger (#56) * First version or README for SM Debugger * Update README.md * Model monitoring visualization example (#52) Notebook for visualizing the results generated by a monitoring execution. * Debugger readme brief edit (#60) Terminology udpate * Adding example of MNIST TensorFlow analysis with Rules and reacting o… (#55) * Adding example of MNIST TensorFlow analysis with Rules and reacting off Rule statuses with CloudWatch Events * Correcting Typos and more instructions for Lambda setup * One more Typo fix * fixed example (#61) * fixed example * Add installing section * Modified realtime analysis notebook for MEAD/Loosleaf (#58) * Modified realtime analysis notebook for MEAD/Loosleaf As a result of this notebook will only be runnable after GA as setup section is missing. * Update mxnet version * Update mxnet version * Update install smdebug section * Notebook demonstrating how to enable spot training with sagemaker debugger (#44) * Notebook demonstrating the usage of spot training with SageMaker Debugger * Fixed the notebook to add the checkpoint s3 uri * Moved the files to right location. * Updated the notebook for GA * Added the description regarding how SageMaker works with Spot Training. * Making some content changes * Restructure notebooks, and update the rules notebooks (#57) * Move tensorflow debugging to own folder * Rename folder * Rename files add readme * Move and update custom rule notebook * Update links to notebooks in README * Test and update for GA, the rule notebooks for TF * Brought cloudwatch notebook to using_rules folder, and updated script name and import line, Also added to readme * Update main readme * Ishan's comments addressed * fix train_volume and mxnet version - train_volume_size should be 400GB - mxnet version should be 1.6.0 * fixed kernel name * fixed kernel to conda_mxnet_p36 * Add SageMaker Debugger XGBoost Rules notebook (#54) * Add SageMaker Debugger XGBoost Rules notebook * Rename notebook * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * XGBoost Rules notebook edit review Simple edit pass for grammar and style. * Address comments by rahul003 and john-andrilla * Address comments by john-andrilla * Add debughookconfig and rules description * Final test and add one more feature importance plot * Add description for SHAP * Rename 1p rules to builtin rules * Updated to imports * Add SageMaker Debugger XGBoost realtime analysis notebook (#50) * Add SageMaker Debugger XGBoost realtime analysis notebook * Remove pre-GA setup * Change all Debugger to Amazon SageMaker Debugger * clean up output of cells * Add an example notebook for data preprocessing using SageMaker Processing and Spark (#59) Add an example notebook for data preprocessing using SageMaker Processing and Spark * Add processing sklearn example (#63) Add processing sklearn example * tf-mnist-custom-rule.ipynb editorial review (#65) Simple edit pass for grammar and style. * XGBoost realtime analysis text edit (#64) * Start new review * Move notebook to a temp file for text review * Produce text diff * Copy to another file for edit * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * XGBoost Rules notebook edit review Simple edit pass for grammar and readability. * Change temp file with edits back to original * Changes to catch up with SDK (#66) * Add keras example, and rename folders to make it clear that they are tensorflow (#67) * Rename to tensorflow_using_rules * Add keras example and split notebooks into three different folders * Rename notebook * Incorporate editorial changes for custom rule notebook * Another rename * Editorial changes * Address review comments by adding description at top of scripts, and making tf_keras tensorflow_keras * Update tf_keras_resnet_byoc.py * Doc update and bug fixes in TF MNIST stop training job example (#70) * Doc update and bug fixes in TF MNIST stop training job example * Cleanup * Updated the text in notebook from Sagemaker-dbugger to Amazon SageMak… (#68) * Updated the text in notebook from Sagemaker-dbugger to Amazon SageMaker Debugger * Added try-except block around invoke_rule to catch NoMoreData exception * Removed the empty cell * Modified SageMaker Debugger to Amazon SageMaker Debugger * TF MNIST buildin rule doc fix and bug fix (#69) * TF MNIST buildin rule doc fix and bug fix * remove output selectively * Remove output selectively * Fix typos (#72) * Name Change (#73) * name change * fix * fix * Update tf-mnist-builtin-rule.ipynb Remove the in front of Amazon SageMaker * Update tf-keras-custom-rule.ipynb * Update links in readme (#74) * add sagemaker experiment management sample notebook (#40) * add sagemaker experiment management sample notebook * Downloading sdks and service2.json from a different s3 uri * Address comments and update text. * remove pre-GA cmds * remove cleanup and rename the directory * delete old dir * remove cell output * Fix intro text * Removed unnencessary imports and used the right pip command to install smdebug (#77) * Clear outputs except plots in xgboost debugger notebooks (#75) * Add regression plots * Add confusion matrix gif * Add plots back in * Use python -m instead of pip and use latest pysdk api * Remove extra exclamation point * Fix typos * Add readme for dgl_kge example (#79) Add Readme for dgl_kge example * Add sagemaker experiments LL sample notebook. (#80) * rebase staging with public repo (#81) * Adding a link to DeepRacer ArXiv paper (#915) * adding a video that shows deepracer working in various tracks * adding deepracer paper link to readme * fixing line breaks * fixing line breaks * fixing line breaks * fixing back slash * Add example notebooks for AWS Step Functions Data Science SDK (#917) * Support restoring checkpoint in ray; Add packages in dockerfile (#919) * Support restoring checkpoint in ray; Add packages in dockerfile * Minor formatting fix * Allow user to specify checkpoint in two ways; move notice to launch() * Remove extra space * Add dict and list in _autotype() * Recursively looking for checkpoint path * Fixed broken links (#897) * Adding a new sample notebook demonstrating using data from AWS Data Exchange for training a machine learning model" (#930) * Renamed sample notebook file (#932) * Adding a new sample notebook demonstrating using data from AWS Data Exchange for training a machine learning model" * Rename file * Sagemaker public notebook consistant with the AWS Deepracer console code (#927) * Sagemaker public notebook consistant with the AWS Deepracer console code 1. Fix Exception being Thrown By 4XX Errors 2. Separate User and System Errors for S3 Calls 3. Fix Out of Memory Issue in Training Worker 4. Reduced the time to upload sim traces to S3 to 1minute befor job exits 5. Remove sending training metrics to cloudwatch as reward graphs uses training metrics from the s3 bucket 6. Upload SIM_TRACE data to s3 bucket of the launched job for training and evaluation 7. Modified mameory backend system errors as inofrmation logs as SIMAPP is not halted by these errors 8. Don't allow the car to move backwards 7. Call os._exit when simapp encounters system or user error leading to exit * Changing the S3 bucket for the robomaker simapp * Add sample notebooks for multi-model endpoints functionality (#935) * Add sample notebooks for multi-model endpoints functionality. * Add batch RL example notebook (#926) * adding mxnet embedding serving notebook (#882) * adding ImagNet embedding notebook from gluon vision zoo * modified the resnet embedding following PR review * removed the training API part, updated to mxnet 1.4, enriched the markdown doc. * Embedding demo fix (#938) * using a more robust artifact finding mechanism using an environment variable to explicitely call model file by name instead of using os.listdir() * added the working demo to the fix branch for the PR * Add three ORL examples (#934) * Initial commit for ORL examples * Address comments on bin packing nb; Add news vendor * Finish three notebooks; Add README * Delete duplicated noteboks; Clean up cells * Fix typo & address comments * Add README for RL directory; Typo fix in network compression README file (#940) * Add README for RL directory; Typo fix in network compression README file * Modify README for batch example * Sagemaker debugger example notebook (#38) * add files for sagemaker debugger notebook * updated notebook * added subfolder * update files * Notebook to enable monitoring for existing Endpoints (#43) * MNIST training with TensorFlow and CloudWatch monitoring of Rule jobs (#49) * MNIST training with TensorFlow and CloudWatch monitoring of Rule jobs * Model monitor end to end notebook (#53) This notebook demonstrates the end to end flow of setting up an Endpoint with data capture, creating a baseline and setting up a monitoring schedule. * Fixing minor issues (#51) * SMDebugger notebook for plotting tensors in realtime (#39) * SMDebugger notebook for plotting tensors in realtime This shows how to run training job asynchronously and plot output of first convolutional layer activations and weights. * Update mxnet-realtime-analysis.ipynb * Adding TensorFlow MNIST analysis example with a custom gradient rule (#41) * Adding TensorFlow MNIST analysis example with a custom gradient rule * Addressing comments * Apply suggestions from code review * Correcting errors in the TensorFlow MNIST Custom Rule example (#47) * Correcting errors in the TensorFlow MNIST Custom Rule example * Correcting typos * Tornasole -> Debugger * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Edit pass for grammar in code review Simple editorial pass for readability. * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * SMDebugger notebook editorial review Edit pass for readability. * Update to use some new methods in smdebug and pysdk * First version or README for SM Debugger (#56) * First version or README for SM Debugger * Update README.md * Model monitoring visualization example (#52) Notebook for visualizing the results generated by a monitoring execution. * Debugger readme brief edit (#60) Terminology udpate * Adding example of MNIST TensorFlow analysis with Rules and reacting o… (#55) * Adding example of MNIST TensorFlow analysis with Rules and reacting off Rule statuses with CloudWatch Events * Correcting Typos and more instructions for Lambda setup * One more Typo fix * fixed example (#61) * fixed example * Add installing section * Modified realtime analysis notebook for MEAD/Loosleaf (#58) * Modified realtime analysis notebook for MEAD/Loosleaf As a result of this notebook will only be runnable after GA as setup section is missing. * Update mxnet version * Update mxnet version * Update install smdebug section * Notebook demonstrating how to enable spot training with sagemaker debugger (#44) * Notebook demonstrating the usage of spot training with SageMaker Debugger * Fixed the notebook to add the checkpoint s3 uri * Moved the files to right location. * Updated the notebook for GA * Added the description regarding how SageMaker works with Spot Training. * Making some content changes * Restructure notebooks, and update the rules notebooks (#57) * Move tensorflow debugging to own folder * Rename folder * Rename files add readme * Move and update custom rule notebook * Update links to notebooks in README * Test and update for GA, the rule notebooks for TF * Brought cloudwatch notebook to using_rules folder, and updated script name and import line, Also added to readme * Update main readme * Ishan's comments addressed * fix train_volume and mxnet version - train_volume_size should be 400GB - mxnet version should be 1.6.0 * fixed kernel name * fixed kernel to conda_mxnet_p36 * Add SageMaker Debugger XGBoost Rules notebook (#54) * Add SageMaker Debugger XGBoost Rules notebook * Rename notebook * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * XGBoost Rules notebook edit review Simple edit pass for grammar and style. * Address comments by rahul003 and john-andrilla * Address comments by john-andrilla * Add debughookconfig and rules description * Final test and add one more feature importance plot * Add description for SHAP * Rename 1p rules to builtin rules * Updated to imports * Add SageMaker Debugger XGBoost realtime analysis notebook (#50) * Add SageMaker Debugger XGBoost realtime analysis notebook * Remove pre-GA setup * Change all Debugger to Amazon SageMaker Debugger * clean up output of cells * Add an example notebook for data preprocessing using SageMaker Processing and Spark (#59) Add an example notebook for data preprocessing using SageMaker Processing and Spark * Add processing sklearn example (#63) Add processing sklearn example * tf-mnist-custom-rule.ipynb editorial review (#65) Simple edit pass for grammar and style. * XGBoost realtime analysis text edit (#64) * Start new review * Move notebook to a temp file for text review * Produce text diff * Copy to another file for edit * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * XGBoost Rules notebook edit review Simple edit pass for grammar and readability. * Change temp file with edits back to original * Changes to catch up with SDK (#66) * Add keras example, and rename folders to make it clear that they are tensorflow (#67) * Rename to tensorflow_using_rules * Add keras example and split notebooks into three different folders * Rename notebook * Incorporate editorial changes for custom rule notebook * Another rename * Editorial changes * Address review comments by adding description at top of scripts, and making tf_keras tensorflow_keras * Update tf_keras_resnet_byoc.py * Doc update and bug fixes in TF MNIST stop training job example (#70) * Doc update and bug fixes in TF MNIST stop training job example * Cleanup * Updated the text in notebook from Sagemaker-dbugger to Amazon SageMak… (#68) * Updated the text in notebook from Sagemaker-dbugger to Amazon SageMaker Debugger * Added try-except block around invoke_rule to catch NoMoreData exception * Removed the empty cell * Modified SageMaker Debugger to Amazon SageMaker Debugger * TF MNIST buildin rule doc fix and bug fix (#69) * TF MNIST buildin rule doc fix and bug fix * remove output selectively * Remove output selectively * Fix typos (#72) * Name Change (#73) * name change * fix * fix * Update tf-mnist-builtin-rule.ipynb Remove the in front of Amazon SageMaker * Update tf-keras-custom-rule.ipynb * Update links in readme (#74) * add sagemaker experiment management sample notebook (#40) * add sagemaker experiment management sample notebook * Downloading sdks and service2.json from a different s3 uri * Address comments and update text. * remove pre-GA cmds * remove cleanup and rename the directory * delete old dir * remove cell output * Fix intro text * Removed unnencessary imports and used the right pip command to install smdebug (#77) * Clear outputs except plots in xgboost debugger notebooks (#75) * Add regression plots * Add confusion matrix gif * Add plots back in * Use python -m instead of pip and use latest pysdk api * Remove extra exclamation point * Fix typos * SMDebugger Example with BYOC (#45) * Example with BYOC * Addressed review comments * Updates to text of notebook * Added a rule and hook from config * Change folder and notebook name * Remove old notebook and script * Remove extra files * Update README * Dont use import all * Updated notebook * Add Deep Graph Library Amazon examples for SageMaker (#48) * Add gcn_tox21 example * Add DGL examples for sagemaker Including GCMC, KGE and GCN * Add KGE hypertune example * add more details * Add sample notebook for AP (#62) * Create sagemaker_automl_direct_marketing.ipynb * Add files via upload * Notebook for AP editorial review Simple edit pass for grammar and style. * Apply suggestions from code review Applied changes from editor review. Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Add files via upload Updated to show the results of batch transform from Tanya * Delete sagemaker_automl_direct_marketing.ipynb Remove incorrectly named file. * Add files via upload Removed output * rebase staging repo with public repo (#78) * Adding a link to DeepRacer ArXiv paper (#915) * adding a video that shows deepracer working in various tracks * adding deepracer paper link to readme * fixing line breaks * fixing line breaks * fixing line breaks * fixing back slash * Add example notebooks for AWS Step Functions Data Science SDK (#917) * Support restoring checkpoint in ray; Add packages in dockerfile (#919) * Support restoring checkpoint in ray; Add packages in dockerfile * Minor formatting fix * Allow user to specify checkpoint in two ways; move notice to launch() * Remove extra space * Add dict and list in _autotype() * Recursively looking for checkpoint path * Fixed broken links (#897) * Adding a new sample notebook demonstrating using data from AWS Data Exchange for training a machine learning model" (#930) * Renamed sample notebook file (#932) * Adding a new sample notebook demonstrating using data from AWS Data Exchange for training a machine learning model" * Rename file * Sagemaker public notebook consistant with the AWS Deepracer console code (#927) * Sagemaker public notebook consistant with the AWS Deepracer console code 1. Fix Exception being Thrown By 4XX Errors 2. Separate User and System Errors for S3 Calls 3. Fix Out of Memory Issue in Training Worker 4. Reduced the time to upload sim traces to S3 to 1minute befor job exits 5. Remove sending training metrics to cloudwatch as reward graphs uses training metrics from the s3 bucket 6. Upload SIM_TRACE data to s3 bucket of the launched job for training and evaluation 7. Modified mameory backend system errors as inofrmation logs as SIMAPP is not halted by these errors 8. Don't allow the car to move backwards 7. Call os._exit when simapp encounters system or user error leading to exit * Changing the S3 bucket for the robomaker simapp * Add sample notebooks for multi-model endpoints functionality (#935) * Add sample notebooks for multi-model endpoints functionality. * Add batch RL example notebook (#926) * adding mxnet embedding serving notebook (#882) * adding ImagNet embedding notebook from gluon vision zoo * modified the resnet embedding following PR review * removed the training API part, updated to mxnet 1.4, enriched the markdown doc. * Embedding demo fix (#938) * using a more robust artifact finding mechanism using an environment variable to explicitely call model file by name instead of using os.listdir() * added the working demo to the fix branch for the PR * Add three ORL examples (#934) * Initial commit for ORL examples * Address comments on bin packing nb; Add news vendor * Finish three notebooks; Add README * Delete duplicated noteboks; Clean up cells * Fix typo & address comments * Add README for RL directory; Typo fix in network compression README file (#940) * Add README for RL directory; Typo fix in network compression README file * Modify README for batch example * Sagemaker debugger example notebook (#38) * add files for sagemaker debugger notebook * updated notebook * added subfolder * update files * Notebook to enable monitoring for existing Endpoints (#43) * MNIST training with TensorFlow and CloudWatch monitoring of Rule jobs (#49) * MNIST training with TensorFlow and CloudWatch monitoring of Rule jobs * Model monitor end to end notebook (#53) This notebook demonstrates the end to end flow of setting up an Endpoint with data capture, creating a baseline and setting up a monitoring schedule. * Fixing minor issues (#51) * SMDebugger notebook for plotting tensors in realtime (#39) * SMDebugger notebook for plotting tensors in realtime This shows how to run training job asynchronously and plot output of first convolutional layer activations and weights. * Update mxnet-realtime-analysis.ipynb * Adding TensorFlow MNIST analysis example with a custom gradient rule (#41) * Adding TensorFlow MNIST analysis example with a custom gradient rule * Addressing comments * Apply suggestions from code review * Correcting errors in the TensorFlow MNIST Custom Rule example (#47) * Correcting errors in the TensorFlow MNIST Custom Rule example * Correcting typos * Tornasole -> Debugger * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Edit pass for grammar in code review Simple editorial pass for readability. * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Editorial change Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * SMDebugger notebook editorial review Edit pass for readability. * Update to use some new methods in smdebug and pysdk * First version or README for SM Debugger (#56) * First version or README for SM Debugger * Update README.md * Model monitoring visualization example (#52) Notebook for visualizing the results generated by a monitoring execution. * Debugger readme brief edit (#60) Terminology udpate * Adding example of MNIST TensorFlow analysis with Rules and reacting o… (#55) * Adding example of MNIST TensorFlow analysis with Rules and reacting off Rule statuses with CloudWatch Events * Correcting Typos and more instructions for Lambda setup * One more Typo fix * fixed example (#61) * fixed example * Add installing section * Modified realtime analysis notebook for MEAD/Loosleaf (#58) * Modified realtime analysis notebook for MEAD/Loosleaf As a result of this notebook will only be runnable after GA as setup section is missing. * Update mxnet version * Update mxnet version * Update install smdebug section * Notebook demonstrating how to enable spot training with sagemaker debugger (#44) * Notebook demonstrating the usage of spot training with SageMaker Debugger * Fixed the notebook to add the checkpoint s3 uri * Moved the files to right location. * Updated the notebook for GA * Added the description regarding how SageMaker works with Spot Training. * Making some content changes * Restructure notebooks, and update the rules notebooks (#57) * Move tensorflow debugging to own folder * Rename folder * Rename files add readme * Move and update custom rule notebook * Update links to notebooks in README * Test and update for GA, the rule notebooks for TF * Brought cloudwatch notebook to using_rules folder, and updated script name and import line, Also added to readme * Update main readme * Ishan's comments addressed * fix train_volume and mxnet version - train_volume_size should be 400GB - mxnet version should be 1.6.0 * fixed kernel name * fixed kernel to conda_mxnet_p36 * Add SageMaker Debugger XGBoost Rules notebook (#54) * Add SageMaker Debugger XGBoost Rules notebook * Rename notebook * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_1p_rules/xgboost-regression-debugger-rules.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * XGBoost Rules notebook edit review Simple edit pass for grammar and style. * Address comments by rahul003 and john-andrilla * Address comments by john-andrilla * Add debughookconfig and rules description * Final test and add one more feature importance plot * Add description for SHAP * Rename 1p rules to builtin rules * Updated to imports * Add SageMaker Debugger XGBoost realtime analysis notebook (#50) * Add SageMaker Debugger XGBoost realtime analysis notebook * Remove pre-GA setup * Change all Debugger to Amazon SageMaker Debugger * clean up output of cells * Add an example notebook for data preprocessing using SageMaker Processing and Spark (#59) Add an example notebook for data preprocessing using SageMaker Processing and Spark * Add processing sklearn example (#63) Add processing sklearn example * tf-mnist-custom-rule.ipynb editorial review (#65) Simple edit pass for grammar and style. * XGBoost realtime analysis text edit (#64) * Start new review * Move notebook to a temp file for text review * Produce text diff * Copy to another file for edit * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * Update sagemaker-debugger/xgboost_realtime_analysis/temp-xgboost-realtime-analysis.ipynb Co-Authored-By: John Andrilla <38335507+john-andrilla@users.noreply.github.com> * XGBoost Rules notebook edit review Simple edit pass for grammar and readability. * Change temp file with edits back to original * Changes to catch up with SDK (#66) * Add keras example, and rename folders to make it clear that they are tensorflow (#67) * Rename to tensorflow_using_rules * Add keras example and split notebooks into three different folders * Rename notebook * Incorporate editorial changes for custom rule notebook * Another rename * Editorial changes * Address review comments by adding description at top of scripts, and making tf_keras tensorflow_keras * Update tf_keras_resnet_byoc.py * Doc update and bug fixes in TF MNIST stop training job example (#70) * Doc update and bug fixes in TF MNIST stop training job example * Cleanup * Updated the text in notebook from Sagemaker-dbugger to Amazon SageMak… (#68) * Updated the text in notebook from Sagemaker-dbugger to Amazon SageMaker Debugger * Added try-except block around invoke_rule to catch NoMoreData exception * Removed the empty cell * Modified SageMaker Debugger to Amazon SageMaker Debugger * TF MNIST buildin rule doc fix and bug fix (#69) * TF MNIST buildin rule doc fix and bug fix * remove output selectively * Remove output selectively * Fix typos (#72) * Name Change (#73) * name change * fix * fix * Update tf-mnist-builtin-rule.ipynb Remove the in front of Amazon SageMaker * Update tf-keras-custom-rule.ipynb * Update links in readme (#74) * add sagemaker experiment management sample notebook (#40) * add sagemaker experiment management sample notebook * Downloading sdks and service2.json from a different s3 uri * Address comments and update text. * remove pre-GA cmds * remove cleanup and rename the directory * delete old dir * remove cell output * Fix intro text * Removed unnencessary imports and used the right pip command to install smdebug (#77) * Clear outputs except plots in xgboost debugger notebooks (#75) * Add regression plots * Add confusion matrix gif * Add plots back in * Use python -m instead of pip and use latest pysdk api * Remove extra exclamation point * Fix typos * Add readme for dgl_kge example (#79) Add Readme for dgl_kge example * Add sagemaker experiments LL sample notebook. (#80) * Adding a new sample notebook demonstrating using data from AWS Data Exchange for training a machine learning model" (#930) * Renamed sample notebook file (#932) * Adding a new sample notebook demonstrating using data from AWS Data Exchange for training a machine learning model" * Rename file * Add batch RL example notebook (#926) * adding mxnet embedding serving notebook (#882) * adding ImagNet embedding notebook from gluon vision zoo * modified the resnet embedding following PR review * removed the training API part, updated to mxnet 1.4, enriched the markdown doc. * Embedding demo fix (#938) * using a more robust artifact finding mechanism using an environment variable to explicitely call model file by name instead of using os.listdir() * added the working demo to the fix branch for the PR * Add README for RL directory; Typo fix in network compression README file (#940) * Add README for RL directory; Typo fix in network compression README file * Modify README for batch example * resolve conflicts |