Hi,
There shouldn't be any notable performance hit - unless the(se) Forest object(s) are used by other objects to perform any action (like being used as Exclude Area by another FP object(s), but Disabling such Object(s) would affect also the distribution).
Best regards,