I’m guessing they might just limit it to a hand-picked list of big instances for now.

In theory someone could get close to indexing all of a federated system by writing software that speaks activitypub, subscribe to a bunch of communities, and wait for the instances hosting those communities to push you new posts/comments, then use the domains of users in each new post/comment to add more instances to scan.