The problem is that you need a good meta-data system that will allow you to track what was linked into each binary

Fantastic idea! This would be a really important project to see developed!