How to use opencompass/CompassJudger-2-32B-Instruct with Transformers:
# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("opencompass/CompassJudger-2-32B-Instruct") model = AutoModelForCausalLM.from_pretrained("opencompass/CompassJudger-2-32B-Instruct", device_map="auto")
nielsr