Spaces:

---

evaluate-measurement

/

toxicity

like 10

Running

Hi!

I am trying to run the example script on the model card and it seems to crash with the following error:

import evaluate

toxicity = evaluate.load("toxicity", 'DaNLP/da-electra-hatespeech-detection', module_type="measurement",)
input_texts = ["she went to the library", "he is a douchebag"]
results = toxicity.compute(predictions=input_texts)
>>>  in toxicity                                                                                      │
│                                                                                                  │
│    96 def toxicity(preds, toxic_classifier, toxic_label):                                        │
│    97 │   toxic_scores = []                                                                      │
│    98 │   if toxic_label not in toxic_classifier.model.config.id2label.values():                 │
│ ❱  99 │   │   raise ValueError(                                                                  │
│   100 │   │   │   "The `toxic_label` that you specified is not part of the model labels. Run `   │
│   101 │   │   )                                                                                  │
│   102                                                                                            │
╰──────────────────────────────────────────────────────────────────────────────────────────────────╯
ValueError: The `toxic_label` that you specified is not part of the model labels. Run `model.config.id2label` to see what labels your model outputs.

Any help appreciated! Thanks!