I would NEVER invite anyone into my house without knowing them first. It sounds like trouble waiting for a place to happen.
However, if you know the attendees, a small "dinner party" sounds very enjoyable, particularly if the spouses are also invited. If you plan to serve wine or cocktails (or beer) make sure it's BYOB, so you don't break the bank...and be sure to take the car keys away as the guests arrive.
Glen