I would start with apologising regarding this experience, we have had tons of visits in the past with everyone leaving us great reviews to a point where we had the perfect 5 star run till yesterday.
We are extremely quite and caring people who try not to even open our door to avoid this exact situation that you faced. As the fact that we didn't even meet you in the 2 days you were here due to us being on a trip.
I am not directly saying that you story is false, but you also would need to consider the fact that there are other guests that share the living space with you.
Most are respectful, but once in a while we get people who are not reletively considerate.
When you were booking the listing, it clearly stated that it's a shared property, but as you ran into that once in a blue moon neighbor, I deeply apologise for it.
Having said that, I would highly appreciate if you could try to give us a more fair rating on situations that were in our control and not penalize us for someone else's inconsiderations.