She's in the Neighbors' House, Not Mine

I know she lives right across from me. I see her coming and going almost every day. But last week when I needed to run an errand, I accidentally walked into their house by mistake. She was there waiting for someone at the door, all alone. We both froze. I tried explaining but it felt like a total disaster. Now I just stare out my window hoping she'll look up and see me, even though I know it's silly. Should have just moved or changed my route, right?