How to use Entropiex/DeepAnalyze-8B-4bit-nf4-noDQ with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="Entropiex/DeepAnalyze-8B-4bit-nf4-noDQ")
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Entropiex/DeepAnalyze-8B-4bit-nf4-noDQ", dtype="auto")
Entropiex