I only remove dead leaves or the occasional huge fan leaf that is blocking the light from bud growth underneath. Otherwise I just leave them, it may look ugly at times to have yellow leaves admist all the green but o well.
I also lollipop certain strains but thats another subject.