There's no fix as of yet, as it more or less requires a complete rewrite of how it functions.

The basic problem is that it has to check each user for the Hosted Organization attribute and only display the ones which have the attribute set. (this by it self takes longer the bigger the environment / hosted org gets).

We have currently not yet found a good solution to address this as of yet.