you can ward the house provided it is not blocking all entrances or on the objective. Seems to me you made an honest mistake due to a misunderstanding.
If you enforce only the rules that are written down on these forums, you will have 0 problems. dont act on "he said she said" rules.