DevFest Montréal 2026

← Back to the programme
3-5 · Just Can’t Get EnoughEnglish

Attention Attention Everywhere

Category
AI & ML
Format
Session — 40 minutes
Audience level
Intermediate

Everyone knows the line "attention is all you need". Far fewer could say what attention actually computes. This talk starts from a single sentence with an ambiguous pronoun and works forward until the attention formula appears on its own. Not presented and explained, but derived, one step at a time, with real numbers on screen throughout. Why comparing two embeddings directly fails. Why that failure forces every token to be split into three separate projections. What each projection does and what actually moves between tokens. Then it stops explaining and starts checking. The same math is run against the real weights of an open model, pulled out layer by layer, head by head, and recomputed by hand. The first measurement comes back wrong, and why it comes back wrong turns out to be more interesting than the mechanism itself.

Speakers

Dev J. Shah

SWE · TribalScale

A detail-oriented Software Engineer and GenAI Evangelist passionate about building scalable, cloud-based applications and AI-powered solutions. With a strong focus on engineering best practices and client collaboration, I deliver tailored solutions that meet unique needs. I channel that same passion into helping developers adopt GenAI technologies through technical blogs, videos, and conference talks.