19 Commits

Author SHA1 Message Date
Zhaoqi 4f6b1f6b52 Revert "New folder structure (#4694)" (#4701)
This reverts commit 970d88ee18 due to broken blog links
2024-07-09 12:54:45 -04:00
Zhaoqi 970d88ee18 New folder structure (#4694)
* Deleted 17 duplicate notebooks (#4685)

* Updated README, removed broken links and fixed markdown (#4687)

* New Folder Structure Implementation - Archived remaining geospatial example notebooks (#4691)

* Archived remaining geospatial example notebooks

* Removed geospatial from README.md

* Archived remaining workshop notebooks (#4692)

* Archived outdated example notebooks between 1-90 views (#4693)

---------

Co-authored-by: jsmul <jsmul@amazon.com>
2024-07-09 11:48:53 -04:00
atqy 12085f3bea change badging domain url (#4459) 2023-10-23 08:30:00 -07:00
Nikhil Kulkarni c91ede982d Update Triton Inf2 LLM example documentation and improve flow (#4334)
* Update Triton Inf2 LLM example documentation and improve flow

* Format using black-nb
2023-07-23 19:15:22 -07:00
Nikhil Kulkarni ea725cfa0a Example notebook for using Triton ensembles in MME mode on GPU (#3995)
* Add MME Ensemble GPU example

* Delete model plan

* Format notebook and update notes

* Use boto3 client to download file instead of aws s3 cp

* Update to new s3 bucket
2023-06-30 10:25:50 -07:00
Nikhil Kulkarni 8a0dda6f69 Add inf2 examples for Triton on SageMaker (#4247)
* Add inf2 examples for Triton on SageMaker

* Change to use merged inf2 link on nv triton github

* Nit changes

* Enable larger timeout for LLM

* Format notebook
2023-06-15 15:12:07 -07:00
atqy 87b48bba1f migrate triton_resnet50.ipynb to regional bucket (#4187)
Co-authored-by: EC2 Default User <ec2-user@ip-172-16-85-103.us-west-2.compute.internal>
2023-06-05 18:10:57 -07:00
atqy 8a6784dd2d migrate Deploy-TensorFlow-Model-Using-NVIDIA-Triton.ipynb to regional bucket (#4163) 2023-06-02 19:34:07 -07:00
atqy ad106653a3 remediate tf-dali-ensemble-cv.ipynb to py38+ (#4089) 2023-05-25 09:58:16 -07:00
atqy 777abeb83a remediate notebook to py38+ (#4038) 2023-05-22 10:32:00 -07:00
atqy 3d28f1d8de Fix badges (#3977)
* edit CONTRIBUTING to include badges fix

* fix badges for read the docs
2023-05-03 17:27:57 -07:00
atqy 22b8203af3 Add badges (#3957)
* prep notebooks for badging propagation

* prep

* add badges to notebooks
2023-04-26 11:41:27 -07:00
João Moura 6c471f97c6 Triton Inference Business Logic Script + Fix of other example bugs (#3744)
* Fixed triton sentence transformers example bugs

* Added BLS Triton example with Stable Diffusion

* Fixed deployment instance type to match CI build env

* Removed text encoder compilation comment in TensorRT compilation script

* Fixed typo in notebook

* Changed directory of sentence transformer example to sagemaker-triton

Co-authored-by: Joao Moura <joaopcm@amazon.es>
Co-authored-by: atqy <95724753+atqy@users.noreply.github.com>
2023-01-25 08:54:59 -08:00
rsgrewal-aws e8c07e84aa Added end to end example for CV for Triton based Inference server (#3739)
* Added end to end example for CV for Triton

* changed the script failures

* fixed the buiold error for end point

* Fixed invoke error builds

* Fixed the model save paths

* aded the right instance typs to be used to run these notebooks

* Black formatting run on the cells

* Fixed formatting and new line capital characters

Co-authored-by: Sergiu Lupu <lusergiu@amazon.com>
Co-authored-by: atqy <95724753+atqy@users.noreply.github.com>
2023-01-17 12:53:54 -08:00
Marc Karp 6299535b80 Add TensorFlow Triton example (#3543)
* Add CatBoost MME BYOC example

* formatted

* Resolving comment # 1 and 2

* Resolving comment # 1 and 2

* Resolving comment # 4

* Resolving clean up comment

* Added comments about CatBoost and usage for MME

* Reformatted the jupyter file

* Added the container with the relevant py files

* Added formatting using Black. Also fixed the comments from the Jupyter file

* Added formatting using Black. Also fixed the comments from the Jupyter file

* Added formatting using Black. Also fixed the comments from the Jupyter file

* Add TensorFlow Triton example

* format TensorFlow Triton example

* Action feedback

* Fix link(s) to be descriptive

* Formatted

* Update delete cell

Co-authored-by: rsgrewal <rsgrewal@amazon.com>
Co-authored-by: atqy <95724753+atqy@users.noreply.github.com>
2022-09-13 12:07:21 -07:00
James Park e183569eb8 Initial files to show Triton fil example with Training using RAPIDS a… (#3524)
* Initial files to show Triton fil example with Training using RAPIDS and deploying ensemble for inference time using Conda

* Applied review suggestions and corrected spelling, grammar, link references, and code to call proper wait method instead of creating our own

* Fixed URL for when this will be posted to proper repo

* Refined endpoint waiting logic

* Changed wording of informational paragraphs
2022-08-10 10:56:42 -05:00
vikramelango 07918f8d4b SageMaker NVIDIA Triton benchmarking (#3314)
* added sagemaker triton ensemble artifacts

* fixed black lint reformat

* addressed review comments

* added note about GPU instance

* fixed typos per review comments

* updated labels file location to s3

* updated labels file s3 location

* added model repository image markdown

* added image file

* triton benchmark - tensorrt, pytorch

* reformatted notebooks using back-nb

* fixed review comments

* added pricing information

* cleared cell outputs

* fixed issues

* added ResourceLimitExceeded details

* added pricing information

* updated pricing information in the notebooks

* finalized pricing message

Co-authored-by: Julia Kroll <75504951+jkroll-aws@users.noreply.github.com>
Co-authored-by: EC2 Default User <ec2-user@ip-172-16-5-105.ec2.internal>
Co-authored-by: Shreya Pandit <shreya.pandit25@gmail.com>
Co-authored-by: atqy <95724753+atqy@users.noreply.github.com>
Co-authored-by: Aaron Markham <markhama@amazon.com>
2022-04-13 14:32:20 -07:00
vikramelango b382931ce5 added sagemaker triton ensemble artifacts (#3198)
* added sagemaker triton ensemble artifacts

* fixed black lint reformat

* addressed review comments

* added note about GPU instance

* fixed typos per review comments

* updated labels file location to s3

* updated labels file s3 location

* added model repository image markdown

* added image file

Co-authored-by: Julia Kroll <75504951+jkroll-aws@users.noreply.github.com>
2022-03-23 12:56:25 -05:00
Aaqib d3a871edfd CV and BERT Examples for NVidia Triton intergation for Amazon Sagemaker (#3022)
* Initial commit triton on sagemaker

* Adding sample image file

* Adding binary payload request examples

* Adding some initial documentation

* Adding nlp bert example files

* Changes for BERT and updating Triton to 21.07

* Adding notebook 1st draft

* Reformat

* Additional documentation

* Updated docs and bumped to v21.08

* Minor Cleanup

* Fix sagemaker-examples-grammar build

* Updated test image

* Fix review comments

* Updating prod uris

* Remove cv image from repo and download it adhoc for inference

* Fix typo in account id map

* Adding Triton notebooks to website
2021-11-12 16:23:43 -06:00