A hostile stone giant or even stone giant lord in HMV is not an unreasonable challenge. There are multiple routes to the stairs, stone giants throw rocks so you can get away even with slow characters, and you can take advantage of the fact that HMV is a surface location to lure a giant out of the way.