As for a config file to list the locations - that idea apparently crossed our minds at various points (including the comment above to consult ld.so.conf where available), and does make sense (as a separate ticket) but did not happen yet.
Originally posted by @jimklimov in #317 (comment)