We want to support loading a dataset of annotations without those annotations contributing to the class-IC calculation, such as human genes where disease-phenotype is used for calculating IC. Otherwise we end up counting the same annotation twice since gene to phenotype is inferred via gene-disease and disease-phenotype.