| Fast & Efficient LLM Inference with vLLMDeepLearning.AI | A full-precision Qwen model is compressed with LLM Compressor; size/perplexity checks guide deployment through vLLM; OpenAI-compatible requests and metrics lead to GuideLLM load… | Python and basic token/inference/GPU concepts are recommended. | Price: ask the provider. Price basis: Own page advertises Enroll Now and additional Pro quizzes/projects/accomplishment. Base lesson-access price and Pro…Online video lessons with advertised examples/resources; the page lists 3 code examples. Live cohort, mentoring and project access are not stated. |
| Efficiently Serving LLMsDeepLearning.AI | Token generation, KV caching, batching and quantization are implemented and benchmarked; LoRA and multi-LoRA LoRAX serving demonstrate throughput/latency tradeoffs. | Intermediate Python knowledge required by the public description. | Free learning option. Price basis: Own page advertises free course access for a limited time during platform beta; not perpetual free access or a Pro…Online video lessons with advertised examples/resources; the page lists 6 code examples. Live cohort, mentoring and project access are not stated. |
| Efficient Inference with SGLang: Text and Image GenerationDeepLearning.AI | Attention and KV cache are implemented before radix-tree shared-prefix caching across requests; caching and parallelism are applied to text and diffusion image generation, with… | Python and basic language-model knowledge are recommended. | Price: ask the provider. Price basis: Own page advertises Enroll Now and additional Pro quizzes/projects/accomplishment. Base lesson-access price and Pro…Online video lessons with advertised examples/resources; the page lists 3 code examples. Live cohort, mentoring and project access are not stated. |
| Quantization in DepthDeepLearning.AI | A custom PyTorch quantizer implements symmetric/asymmetric and tensor/channel/group schemes; quantization errors, size/performance and low-bit packing are evaluated. | Builds on Quantization Fundamentals; prior relevant foundation/PyTorch context expected. | Free learning option. Price basis: Own page advertises free course access for a limited time during platform beta; not perpetual free access or a Pro…Online video lessons with advertised examples/resources; the page lists 13 code examples. Live cohort, mentoring and project access are not stated. |
| Quantization Fundamentals with Hugging FaceDeepLearning.AI | Linear quantization, downcasting and Quanto are applied through Transformers to open language/multimodal models, with memory/quality effects examined before the advanced quantizer… | Basic machine learning and some PyTorch expected. | Free learning option. Price basis: Own page advertises free course access for a limited time during platform beta; not perpetual free access or a Pro…Online video lessons with advertised examples/resources; the page lists 3 code examples. Live cohort, mentoring and project access are not stated. |