How to use p1atdev/multi-tokenizers-processor-sample with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("p1atdev/multi-tokenizers-processor-sample", dtype="auto")
b5e658d 3b5d4a2 b5e658d 3b5d4a2 b5e658d
1
2
3
4
5
6
7
{ "auto_map": { "AutoProcessor": "processor_multi.MultiProcessor" }, "processor_class": "MultiProcessor" }
