I'm having hat issues.

As all 9 of our readers know, I grew up in the Boston area and am a huge Red Sox fan. But I've been living in San Diego for 3 years now, and since I'm here, I go to a lot of Padres games. The Padres play in the National League, and lately have been pretty terrible, so I didn't have much of quandry about cheering for them. The one time they played the Sox in interleague, I rooted for close games, ultimately won by the Sox.
But on Friday night, I took it to a new level. I bought a Padres hat. It looks like the one pictured above, except instead of a white front, it that "sand" color of the Pads away uniforms. It cost about $25 and fits my head like a glove.
I wore it the next morning on a coffee run, and instantly felt weird about it. Like I was cheating. Now its sitting on top of my dresser, taunting me. A harlot trying to temp me away from my myriad Red Sox caps.
Did I make a huge mistake? Am I just an over-analytical freak? Are you really still reading this? I can't decide if I've made commited a huge act of betrayal or not here. Help me Pink Hat Nation, you're my only hope.