I flower with micron-filtered air, so I haven't run into mold in 15+ years. (I strongly recommend it to those who are not currently doing it
I DO know about mold, especially how it throws millions of spores rather quickly. I would definitely chop anything which showed mold and remove it from the area. You'll cut down on the chances of the rest molding as quickly.
Personally, since mold is an issue, I would drop the RH and dry the crop a lot quicker. You may lose terpenes, but you'll preserve oil rich flower.