Fragments of an Infinite Memory