Figure 5:
Semantic completion. Incomplete latent representations in the form of the index matrix are completed by the PixelCNN through a process we call semantic completion. The index matrix is already 30 times smaller than the image, and only part of that representation is selected by attention. The attention level is defined as the percentage of the index matrix that is stored in the memory trace. The partial patterns in the first row visualize the episodic memory traces. The next three rows visualize three instances of semantic completion based on the same incomplete memory traces. The first panel with 0% attention shows images generated from no information in the memory trace, one exemplar per digit from 1 to 9, which can be interpreted as dreaming. Note the higher reliability of the completion process with increased attention.

Semantic completion. Incomplete latent representations in the form of the index matrix are completed by the PixelCNN through a process we call semantic completion. The index matrix is already 30 times smaller than the image, and only part of that representation is selected by attention. The attention level is defined as the percentage of the index matrix that is stored in the memory trace. The partial patterns in the first row visualize the episodic memory traces. The next three rows visualize three instances of semantic completion based on the same incomplete memory traces. The first panel with 0% attention shows images generated from no information in the memory trace, one exemplar per digit from 1 to 9, which can be interpreted as dreaming. Note the higher reliability of the completion process with increased attention.

Close Modal

or Create an Account

Close Modal
Close Modal