Factory out attribute init code

This will allow us not to build certain providers as they are
now-self registering and the registration code is factored out
of the attribute manager class