Jonathan ‘Wolf’ Rentzsch:

Caps Lock doesn’t activate immediately upon strike. There’s a very small time window — perhaps a quarter of a second — where if you release the key inside the window, the keystroke is ignored.

Possibly meant to prevent accidental pressings of the Caps Lock key. Personally, I think the world would be a better place if there were no Caps Lock key at all.