It's no problem. Hell, many older members on this site are already aware of this, but Brit is just short for Britney... and I'm not a girl.
It depends on the intention for Brit. There are male and female versions of it and Britney is the female version. It is silly, regardless, since it just means you are a citizen of Briton.