Put like that, I see your point, but I do think it would be distracting. Not "OMG No!" but not something I'd want to encounter on a narrow trail where I needed to focus.

And yeah - what about sitting down, or climbing up rocks? I like me some good denim or corduroy not as modesty but as actual protection in such a circumstance?

I don't have problems with nudity, I have problems with discomfort...