Walking on an altar or simply looking at it will draw a black square on its spot. At least with a chaotic (black) altar. Ctrl-R suffices to display the altar again.