I wonder whether you have set permissions on your groups.io home so that only the owners and ?moderators can see the Member Directory. This may not be the problem, but you could try.
Also you can stop members from downloading the group data archive. That's one of the options too.
Frances