If you wield elemental shards you still get their attribute bonuses as well as their special powers (walking through walls, passage through water, or flight).

EDIT: Rings of mental stability also grant their learning bonus when wielded (rings of defense and protection, however, do not).