Not impressed?
I'm not sure, maybe it doesn't like my usual test questions, but it performs worse than phi-4 it seems. For example this pretty easy question >>>
There are three killers in a room. Someone enters the room and kills one of them. Nobody leaves the room. How many killers are left in the room?
think
Alright, let's break this down step by step to understand the problem clearly.
First, there are initially three killers in the room. Then, someone enters the room and kills one of them. After that, it's mentioned that nobody leaves the room.
So, initially, there are three killers. When someone enters, they kill one killer. This means that one killer is removed from the group. Since nobody leaves after the killing occurs, we only need to account for the remaining individuals in the room.
Therefore, by subtracting the one killed from the initial number of killers, we can determine how many killers remain.
/think
After the person enters and kills one killer, there are two killers left in the room.
llama.cpp build: 4518, build-in template. temp 0.5-0.7, rep pen 1.1