started knitting but it's kinda embarrassing

ok so i started learning how to knit recently and its like really fun but at the same time i feel super weird about it. i mean everyone always jokes about guys who do cross stitch or whatever but i never thought i would be one of those dudes who does something that seems a bit more traditionally girly... like knitting or sewing? im just not sure how to talk about it around my bros and stuff. last night i was super into it and forgot the time and stayed up really late, then my roommates came in asking what i was doing so loud cause they could hear the needles clinking and all. i told them but one of em made a joke about my hands becoming soft from all this yarn... im just not sure if its normal to feel like this or if im being too sensitive. anyone ever felt this way? is it weird or am i reading into things more than i should?