Hi, I don't think it is supported at the moment. Internally, it will perform sentence pair generation, which is why there will be 640 examples for 2 classes with 8 examples.

As for multi-label classification, kindly check the following notebook:

https://github.com/huggingface/setfit/blob/main/notebooks/text-classification_multilabel.ipynb