So you displace them a couple of times, simply because ADOM Sage makes it so easy. Suddenly they're all "The dwarven guardian doesn't seem to like being pushed around" and getting hostile on your ass. And what's even more unfair, after you kill him, as you are obligated and justified to do after he went and was a dick to you like that, Waldenbrook suddenly goes ballistic too.
Dwarves are real drama queens.