| CPU Model | GPU Model | LLM Name | RAM | Tokens per Second |
|---|---|---|---|---|
| i5-6500 | GTX 1660 Super | phi3-3b | 8 GB | 44.55 |
| i5-6500 | GTX 1660 Super | llama3-8b | 8 GB | 6.49 |
| i5-6500 | GTX 1660 Super | gemma2-9b | 8 GB | 10.77 |
| i5-6500 | GTX 1660 Super | qwen2-7b | 8 GB | 9.38 |
| i5-6500 | GTX 1660 Super | aya-8b | 8 GB | 3.76 |
| i5-6500 | GTX 1660 Super | codegemma-7b | 8 GB | 0.24 |
| i5-6500 | GTX 1660 Super | llava-7b | 8 GB | 8.26 |
| i5-6500 | GTX 1660 Super | gemma-7b | 8 GB | 0.13 |
| i5-6500 | GTX 1660 Super | llama2-7b | 8 GB | 39.84 |
| i5-6500 | GTX 1660 Super | mistral-7b | 8 GB | 37.0998 |
