New City Nerves

I just moved to a new city and I've been avoiding going out because everything feels so unfamiliar. Even the grocery store down the street seems like an insurmountable challenge. Is this normal? How do people handle starting fresh in an entirely new place?