I figure human towns wouldn't really cater to use freaky trolls to much. but it would be nice if there was like 1-5% non-medium armor in regular shops.

I've run across a couple elven villages, maybe later in game developement we'll be able to find troll/ogre/giant villages with shops that sell stuff that can fit us.