HDMI ports are not designed for that kind of use, once the hdmi cable is inserted it almost always stays there and only gets removed maybe half a dozen times in its life. If you are going to be constantly plugging in and removing the cable it will eventually break especially for older or younger users who tend to wiggle the cable free instead of cleanly pulling or pushing it home.
All of my devices go through dedicated HDMI switches, this both protects the port on the receiver it self (I'd rather replace a £10 to £40 switch than a several hundred ££ receiver) and allows multiple devices to be attached to limited inputs. I do the same thing for my network too via a 16 port network switch.