i might be the asshole at work

hey everyone i need to confess something and im kinda worried if this is normal or not. so a while back we got a new manager named amy, shes younger than me by about ten years but seems super smart and capable. anyway ever since she started theyve been making us do these really annoying team building exercises every friday afternoon which i just hate. its like the opposite of my work style. so yesterday during one of those activities someone mentioned that im not participating much, and amy asked me if there was something wrong with how we were doing things, as in is it bothering me or anything? her words made me realize people might think ill been acting all distant and cold but thats just because these activities arent my thing. so i kind of exploded on the group, telling them all that its annoying and wasteful time spent when we could be focusing on actual work. everyone went super quiet after and amy looked like she had no idea what to do. then a little later someone came up to me saying they were worried id just messed things up big time with amy because of how i spoke out, that maybe i overreacted and was coming off as a bit too confrontational. im really freaking out now wondering if this is something others would say or if its just my own anxiety making it seem worse? so does anyone have any advice or ideas what to do next to smooth things over? am i totally being the asshole here?