If you hail him and don't accept his quest, he will attack you. Didn't cause any negative faction hits, but he did reward achievement experience.