While you are C as a chaos knight, you can gain the weird tome from the ghost librarian normally but then the mad minstrel refuses to accept it (unless you convert, I guess). This might be intentional or it might be an oversight. I have to say I was very glad I was able to chat with the ghost librarian, because he increases your literacy skill dramatically, making it easier to read scrolls of chaos resistance succesfully instead of wasting them if you try.