Bit by Bit: Leadership Conversation with Stevie Bathiche, Technical Fellow, Microsoft

In this conversation, Ben Bajarin from Creative Strategies and Stevie Batiste, a Technical Fellow at Microsoft, discuss the importance of NPUs (Neural Processing Units) in client silicon. They explain that NPUs are dedicated processors for AI workloads and are specifically designed to handle the structure of tensors. NPUs offer more efficient and faster processing of AI workloads compared to CPUs and GPUs. They also have a lower power consumption, making them ideal for running AI constantly in the background. The conversation highlights the significance of NPUs in enabling software developers to unlock new capabilities and create innovative applications.

Chapters

00:00 Introduction and Overview
03:00 Understanding the Structure of Tensors
07:39 Efficiency and Power of NPUs
09:42 Unlocking New Capabilities for Software Developers
15:12 Faster and More Power Efficient NPUs
26:21 The Impact of NPUs on Computing