Hi Vincent,
I'm afraid, that’s currently not possible – unfortunately, that's the actual limitation of the Library Browser.
Let me mention, that any Forest object can be used as an XRef Object / XRef Scene. In case you'll be using it as the XRef Object, I would suggest you have both Display Influences and Select Influences selected in the XRef Merge window (as this will bring to your new scene also all objects needed to rebuild the Forest object).
Thanks for your feedback, it's very important to us.
Best regards,