I'm thinking the outdoor does have some kind of microbes on them that causes the difference.
Thats sounds like the most likely scenario. The spores are present but conditions aren't right for them to do their thing until the plant comes inside. The UV light idea is probably better...but maybe try hanging one outside in the sun?