How to Run 70B LLMs Locally on RTX 3090 OR 4060 - AQLM
13:18
Find in video from 01:00Overview of AQLM Method
How to Run 70B LLMs Locally on RTX 3090 OR 4060 - AQLM
4.2K viewsFeb 8, 2024
YouTubeFahd Mirza
Deep Dive: Quantizing Large Language Models, part 1
40:28
Find in video from 34:50bitsandbytes
Deep Dive: Quantizing Large Language Models, part 1
22.9K viewsMar 6, 2024
YouTubeJulien Simon
Quantization Process Explained | Basics, Waveforms, Parameters, and Solved Example
13:07
Quantization Process Explained | Basics, Waveforms, Parameters, a…
3.6K views5 months ago
YouTubeEngineering Funda
Deep Dive: Quantizing Large Language Models, part 2
27:13
Find in video from 07:00Group-wise Precision Tuning Quantization (GPTQ)
Deep Dive: Quantizing Large Language Models, part 2
4.2K viewsMar 6, 2024
YouTubeJulien Simon
Quantization Aware Training (QAT) With a Custom DataLoader: Beginner's Tutorial to Training Loops
26:13
Quantization Aware Training (QAT) With a Custom DataLoader: Begin…
2.5K viewsApr 9, 2024
YouTubeOscar Savolainen
2-bit Quantization is Magical! See How to Run Mixtral-8x7B on Free-tier Colab
12:05
Find in video from 02:31Performance of AQLM 2bit Model
2-bit Quantization is Magical! See How to Run Mixtral-8x7B on Free-t…
843 viewsFeb 21, 2024
YouTubeYeyu Lab
Quantizing LLMs - How & Why (8-Bit, 4-Bit, GGUF & More)
26:26
Quantizing LLMs - How & Why (8-Bit, 4-Bit, GGUF & More)
22.4K viewsNov 18, 2024
YouTubeAdam Lucek
19:06
LLM Quantization with llama.cpp on Free Google Colab | Llama 3.1 | G…
2.3K viewsAug 8, 2024
YouTubeTheAILearner
14:35
From Waves to Bits: Understanding Quantization, Encoding, and ADC …
325 views4 months ago
YouTubeLearnHub
59:04
LLM Quantization Techniques Explained - GPTQ AWQ GGUF HQ…
477 views8 months ago
YouTubeJoydeep Bhattacharjee
9:52
Find in video from 00:43What is Quantization and PV Tuning?
Llama 70B 3.1 Instruct AQLM-PV Released - Runs on 24GB VRAM - …
1.3K viewsSep 15, 2024
YouTubeFahd Mirza
27:43
Find in video from 13:00Understanding Quantization Algorithms
Quantize any LLM with GGUF and Llama.cpp
19.6K viewsMar 2, 2024
YouTubeAI Anytime
45:42
Quantization in vLLM: From Zero to Hero
1.2K views8 months ago
YouTubeSiemens Knowledge Hub
9:49
QTIP - Quantize Models to 2bit and 3bit with Trellises - Hands-on Demo
713 viewsNov 3, 2024
YouTubeFahd Mirza
8:31
What is Quantization? How is it performed?
202 viewsJan 17, 2025
YouTubeShriram Vasudevan
1:22
What is quantization? | Why essential for LLM deployment? #S…
8.7K views4 months ago
YouTubeGeeksforGeeks
33:39
AI Model Efficiency Toolkit (AIMET) Quantization Simulation
724 viewsAug 28, 2024
YouTubeQualcomm Developer
0:57
Mastering Quantization 3 Essential Types Explained
394 viewsNov 6, 2024
YouTubeEDGE AI FOUNDATION
0:54
What is Quantization?
13 views4 months ago
YouTubeData Science Made Easy
12:50
Image Representation and Storage: Sampling Rate and Quantization E…
110 viewsDec 2, 2024
YouTubeAwais Lodhi
9:57
What is LLM Quantization ?
3K viewsMar 19, 2025
YouTubeNew Machina
19:53
04 | ADC Quantization شرح
771 viewsMar 20, 2025
YouTubeSimplify AI
10:30
Find in video from 01:10Types of Quantization Formats
AutoQuant - Quantize Any Model in GGUF AWQ EXL2 HQQ
863 viewsApr 3, 2024
YouTubeFahd Mirza
19:17
Quadrature Amplitude Modulation - QAM | Basics, Constellation Diagr…
10.9K views6 months ago
YouTubeEngineering Funda
32:55
Find in video from 01:02Importance of Quantization
Part 1-Road To Learn Finetuning LLM With Custom Data-Quantizati…
159.7K viewsFeb 15, 2024
YouTubeKrish Naik
20:25
Introduction to LLM Quantization
3.4K views9 months ago
YouTubeVizuara
56:09
vLLM Office Hours - FP8 Quantization Deep Dive - July 9, 2…
3.4K viewsJul 11, 2024
YouTubeNeural Magic
8:52
SNR of Quantization Explained | Basics, Definition, and Derivation
1.5K views5 months ago
YouTubeEngineering Funda
11:11
Find in video from 06:01BitsandBytes NF4
Day 65/75 LLM Quantization Techniques [GPTQ - AWQ - Bitsan…
1.4K viewsApr 16, 2024
YouTubeFreeBirds Crew - Data Science and GenAI
3:02
What Is Quantization In Digital Signal Analysis? - Electrical Engin…
21 views6 months ago
YouTubeElectrical Engineering Essentials
See more videos
Static thumbnail place holder