Yes, we also have to warn people that our house is not child safe. I've also kind of stopped inviting a couple of people who insist on bringing their children to social events. We have a small, not child-safe house and occasionally like to have a small, informal gathering of adults for adult-chat and usually adult-type games like Cards Against Humanity - i.e. not suitable for children.

Occasionally we have invited friends and their kids over for an afternoon barbecue in the garden (the kids could run around in the garden, so it was fine). But if I'm honest I prefer just adults.