My Kids Know My Passwords

I let my kids use my phone when they need something, but I never set a password. Now they can see everything on there and I've told them not to tell anyone else my secrets. Is this crazy or just lazy? Am I being paranoid for worrying about what they might share with friends?