Ogre lords are hard to kill. I usually try to gain xp on 5-headed hydras before descending to kill ogre lords. I think it's better to visit the 1st levels of some dungeons and go back to hunt xp...