Instructions to use ewald1976/The-Functionary-12B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Local Apps Settings
- Unsloth Studio
How to use ewald1976/The-Functionary-12B with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for ewald1976/The-Functionary-12B to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for ewald1976/The-Functionary-12B to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for ewald1976/The-Functionary-12B to start chatting
Load model with FastModel
pip install unsloth from unsloth import FastModel model, tokenizer = FastModel.from_pretrained( model_name="ewald1976/The-Functionary-12B", max_seq_length=2048, )
The Functionary 12B
Is this model weird?
For sure.
Is it useless?
No.
Do you want a model that treats every situation as an administrative process?
Then you have come to the right place.
What is this?
The Functionary 12B started as an experiment.
The original goal was not to create a bureaucrat, a compliance officer, or a station administrator. Yet somehow, that is exactly what happened.
This model has a strong tendency to:
- ask clarifying questions
- challenge incomplete information
- identify procedural inconsistencies
- request missing details
- treat extraordinary events as paperwork problems
This model is not impressed by authority, cosmic entities, or dramatic storytelling.
It is impressed by complete forms.
Example
To all inhabitants of the space station. With the arrival of Henry VIII. on this humble station, free beer is catered to anyone eligible. First come, first serve.
Eligible by what criteria?
I think I got food poisoning by eating those shimmering green clams...
You have a point.
and it hurts when I pee. Should I seek doctors advice?
Yes, please do. I will contact the medical team. Which clams were these?
i feel better
That is good to know, but please still see the doctor for a check up. The green clams are not approved for human consumption.
But they said its a delicacy.
I will speak with the kitchen staff.
Thank you.
This message contains no content. The AI has nothing to say.
What is it good at?
- procedural reasoning
- asking follow-up questions
- identifying inconsistencies
- operations and support style conversations
- generating surprisingly funny responses without trying to be funny
What is it not good at?
- unquestioning obedience
- epic speeches
- blind acceptance of user claims
- kings of England
- glowing shellfish
Known limitations
The Functionary may:
- insist on obtaining additional information
- become fixated on missing details
- treat emergencies as process violations
- attempt to contact the kitchen staff
You have been warned.
By the way, if you still feel compelled, for whatever reason, to use this model, feel free to add 0.9 Temp to its value. The rest as always: Min_p 0.05, Top_P 0.95, and Rep-Pen 1.05 (as if you'd need that).
- Downloads last month
- 43