'l'ooking at an altar should tell you its color.
Right now the only way to find out the alignment of an altar is to either have a system that shows colors flawlessly and good eyesight, or to stand on the altar, which can possibly be fatal. (courtesy of hw3patch)