FredZhang7 commited on
Commit
e0a0bf0
·
verified ·
1 Parent(s): 61f411e

update personal preference ranking

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -45,9 +45,9 @@ Think step by step. Solve this problem without removing any existing functionali
45
 
46
  | **Rank** | **Model Name** | **Token Speed (tokens/s)** | **Debugging Performance** | **Code Generation Performance** | **Notes** |
47
  |----------|----------------------------------------------|----------------------------|------------------------------------------------------------------------|-----------------------------------------------------------------------|-------------------------------------------------------------------------------------------|
48
- | 1 | codestral-22b-v0.1-IQ6_K.gguf (this repo) | 34.21 | Excellent at complex debugging, often surpasses GPT-4o and Claude-3.5 | Good, but may not be par with GPT-4o | Best overall for debugging in my workflow, use Balanced Mode. |
49
- | 2* | Claude-3.5-Sonnet | N/A | Poor in complex debugging compared to Codestral | Excellent, better in design and more creative than GPT-4o in code generation | Great for code generation, but weaker in debugging. |
50
- | 2* | GPT-4o | N/A | Good at complex debugging but can be outperformed by Codestral | Excellent, generally reliable for code generation, more knowledgable | Balanced performance between code debugging and generation. |
51
  | 4 | DeepSeekV2 Coder Instruct | N/A | Good, but outputs the same code in complex scenarios | Excellent at general code generation, rivals GPT-4o | Excellent at code generation, but has data privacy concerns as per Privacy Policy. |
52
  | 5* | Qwen2-7b-Instruct bf16 | 78.22 | Average, can think of correct approaches | Sometimes helps generate new ideas | High speed, useful for generating ideas. |
53
  | 5* | AutoCoder.IQ4_K.gguf (this repo) | 26.43 | Excellent at solutions that require one to few lines of edits | Generates useful short code segments | Try Precise Mode or Balanced Mode. |
 
45
 
46
  | **Rank** | **Model Name** | **Token Speed (tokens/s)** | **Debugging Performance** | **Code Generation Performance** | **Notes** |
47
  |----------|----------------------------------------------|----------------------------|------------------------------------------------------------------------|-----------------------------------------------------------------------|-------------------------------------------------------------------------------------------|
48
+ | 1* | codestral-22b-v0.1-IQ6_K.gguf (this repo) | 34.21 | Excellent at complex debugging, often surpasses GPT-4o and Claude-3.5 | Good, but may not be par with GPT-4o | One of the best overall for debugging in my workflow, use Balanced Mode. |
49
+ | 1* | Claude-3.5-Sonnet | N/A | Poor in complex debugging compared to Codestral | Excellent, better in design and more creative than GPT-4o in code generation | Great for code generation, but weaker in debugging. |
50
+ | 1* | GPT-4o | N/A | Good at complex debugging but can be outperformed by Codestral | Excellent, generally reliable for code generation, more knowledgable | Balanced performance between code debugging and generation. |
51
  | 4 | DeepSeekV2 Coder Instruct | N/A | Good, but outputs the same code in complex scenarios | Excellent at general code generation, rivals GPT-4o | Excellent at code generation, but has data privacy concerns as per Privacy Policy. |
52
  | 5* | Qwen2-7b-Instruct bf16 | 78.22 | Average, can think of correct approaches | Sometimes helps generate new ideas | High speed, useful for generating ideas. |
53
  | 5* | AutoCoder.IQ4_K.gguf (this repo) | 26.43 | Excellent at solutions that require one to few lines of edits | Generates useful short code segments | Try Precise Mode or Balanced Mode. |