I would add a thick piece of cardboard and a towel, so the weight is spread across a larger area of the door and not just in the two points on the hook.
Ive always hung mine on two ladder hooks that have foam around them. It hasnt been an issue so far. One time it moved the seal a little bit but it went right back.