A fundamental task of the brain is detecting patterns in the environment that enable predictions about the future. Here, we show that the salamander and mouse retinas can recognize a wide class of periodic temporal patterns, such that a subset of ganglion cells fire strongly and specifically in response to a violation of the periodicity. This sophisticated retinal processing may provide a substrate for hierarchical pattern detection in subsequent circuits.