2026
an archive of posts from this year
-
Duck typing, and how Python handles types
What duck typing is, how ABCs and Protocol affect it, and how type hints coexist with duck typing.
-
ROUGE
Recall-Oriented Understudy for Gisting Evaluation
-
Why cross entropy, of all things: from BCE to KL divergence
Why classification uses cross entropy instead of MSE, traced as a single line from information content and entropy through BCE and MLE to KL divergence.
-
Backpropagation through convolution: deriving kernel and input gradients
Derive the kernel and input gradients of a convolutional layer using the chain rule, and connect cross-correlation, full convolution, kernel flipping, and stamp accumulation.
-
Understanding Backpropagation Through Time (BPTT)
BPTT backpropagates gradients through temporal dependencies in an RNN. This post explains how BPTT works and how to compute its gradients.