DevOps Concepts for MLOps-Embracing Automation and Tooling
Instructor Intro
()
Source Code Resources
A Function, the Essence of Programming
()
Operationalize Microservices
()
Continuous Integration for Microservices
()
What is Makefile and how do you use it?
()
What is DevOps?
()
Kaizen methodology
()
Infrastructure as Code for Continuous Delivery
()
Infrastructure as code
Continuous integration
Continuous delivery
Automation and tooling
DevOps Concepts for MLOps-Understanding Cloud Security
Responding to Compromised Resources and Workloads
()
Designing and Implementing Monitoring and Alerting
()
Audit Network Security
()
Rust Secure by Design
()
Preventing Data Races with Rust Compiler
()
Using AWS Config for Security
()
AWS Security Hub Demo
()
Shared responsibility
Identity and access management
Infrastructure protection
Incident response
DevOps Concepts for MLOps-Understanding the GitHub Source Control Platform
Explain How to Secure Your Account with 2FA
()
Understanding Access Permissions
()
Repository Permission Levels Explained
()
Repository Privacy Settings and Options
()
Unveiling Key Concepts of the GitHub Ecosystem
()
Demo: Implementing GitHub Actions
()
Demo: GitHub Codespaces
()
External Lab: Use GitHub Actions and Codespaces
Demo: GitHub Copilot
()
About two-factor authentication
Access permissions on GitHub
About Continuous Integration
About continuous deployment
Final Week-Reflections
Rust Hugging Face Candle- Introduction to Candle
Candle: A Minimalist ML Framework for Rust
()
Using GitHub Codespaces for GPU Inference with Rust Candle
()
VSCode Remote SSH development AWS Accelerated Compute
()
Building Hello World Candle
()
Exploring StarCoder: A State-of-the-Art LLM
()
Using Whisper with Candle to Transcribe
()
Exploring Remote Dev Architectures on AWS
()
rust-candle-demos
Configuring NVIDIA CUDA for your codespace
Getting Started Candle
Candle Examples
External Lab: Candle Hello World
Rust Hugging Face Candle-Rust for LLMs
Advantages of Rust for LLMs
()
Serverless Inference
()
Rust CLI Inference
()
Rust Chat Inference
()
External Lab: Run an LLM with Candle
Developer Guide cuDNN
cuDNN Webinar
Programming Tensor Cores in CUDA 9
Tensor Ops Made Easier in cuDNN
Rust Hugging Face Candle-Practical Applications of Candle
Continuous Build of Binaries for LLMOps
()
Chat Loop for StarCoder
()
Invoking Rust Candle on AWS G5-Part One
()
Invoking BigCode on AWS G5-Part Two
()
External Lab: Using BigCode to Assist With Coding
StarCoder: A State-of-the-Art LLM for Code
Falcon LLM
Whisper LLM
Candle Structure
Final Week Reflection
Key LLMOps Technologies-Getting Started With Rust Bert
Introduction to Rust Bert
()
Installation and Setup
()
Basic Syntax and Model Loading
()
Building a sentiment analysis CLI
()
Getting Started Rust Bert
External Lab: Translate a Spanish song to English
Rust Bert pipelines
ONNX Support Rust Bert
Loading pretrained and custom model weights
Key LLMOps Technologies-tch-rs: Rust bindings for PyTorch
Introduction to Rust PyTorch
()
Running a PyTorch Hello World
()
PyTorch Pretrained
()
External Lab: Run a Pretrained model
Running PyTorch Pretrained
()
Rust bindings for PyTorch
Key LLMOps Technologies-Using ONNX
Introduction to ONNX
()
ONNX Conversions
()
ONNX Concepts
ONNX with Python
Converters
ONNX Model Hub
Final Week-Reflections
External Lab: Use ONNX
Key Generative AI Technologies-Getting Started with GenAI Systems
Extending Google Bard
()
Exploring Google Colab with Bard
()
Exploring Colab AI
()
Exploring Gen App Builder
()
Bard FAQ
External Lab: Build a plot with Colab AI
Key Generative AI Technologies- Beginning Generative AI Solutions in Cloud Computing
Responsible AI with AWS Bedrock
()
AWS Bedrock with Claude
()
Summarizing text with Claude
()
Using the AWS Bedrock API
()
External Lab: AWS Bedrock
AWS Cloud Adoption Framework for Artificial Intelligence, Machine Learning, and Generative AI
Key Generative AI Technologies-Exploring Generative AI Solutions with AWS CodeWhisperer
Live Coding AWS CodeWhisperer Part One
()
Live Coding AWS CodeWhisperer Part Two
()
Live Coding AWS CodeWhisperer Part Three
()
Using AWS CodeWhisperer CLI
()
People perspective: Culture and change towards AI/ML-first
External Lab: Use CodeWhisperer for Rust Calculator