Got Myself Into A Quilting Mess...

So I decided to take up quilting. It started with a YouTube video about basic stitches and before you know it, I'm knee-deep in cotton fabric scraps at my grandma's old sewing table. The thing is, every time I sit down to work on this project, I just end up cutting out more patterns...which never seem to fit together properly when I try to sew them. And the colors! Oh man, trying to match those up has given me more headaches than a calculus exam did back in high school. Now my living room looks like a fabric store exploded and everyone keeps asking if I'm going to sell the quilts...and maybe they will because this is turning into quite an expense. But seriously, does anyone else struggle with piecing together these stubborn little patches? Is it normal to want to give up every time another corner doesn't align just right? Or am I really bad at it and should just stick to knitting? Please advise.