I have more of a physical connection to Barcelona than Oldham, as in I have lived in Barca. I support Latics because my dad does, Oldham are my team but it doesn't mean to me that I can't root for or even support other teams, espcially ones that are so many miles apart in every sense.
I always root for one team over another as a neutral too. I find any other concept baffling but each to their own ey?!