Cross Layer Equalization: Everything You Need to Know

If you need help with anything quantization or ML related (e.g. debugging code) feel free to book a 30 minute consultation session! https://calendly.com/oscar-savolainen

I'm also available for long-term freelance work, e.g. for training / productionizing models, teaching AI concepts, etc.

Video Summary:
In this video, we cover one of the oldest neural network quantization techniques available Cross Layer Equalization (CLE). We go over the original paper from Qualcomm, and go over a Jupyter Notebook I wrote on how to do CLE on a ResNet model.

Links:
Gitub for Jupyter: https://github.com/OscarSavolainen/Qu...
Original paper: https://arxiv.org/abs/1906.04721

Timestamps:
00:00 Intro
01:06 Going over the paper
04:18 Coding - Graph tracing the model to get CLE pairs
07:43 FX quantization
08:10 Evaluation
09:15 Visualization
12:04 Outro