|
官方提供了一个供测试的免费api ADOTX_API_KEY： - sktax-XyeKFrq67ZjS4EpsDlrHHXV8it
BaseUrl: - https://guest-api.sktax.chat/v1
apis/README.md
Model Performance | Benchmarks | A.X 4.0 | Qwen3-235B-A22B
(w/o reasoning) | Qwen2.5-72B | GPT-4o | | Knowledge | KMMLU | 78.32 | 73.64 | 66.44 | 72.51 | | CLIcK | 83.51 | 74.55 | 72.59 | 80.22 | | KoBALT | 47.30 | 41.57 | 37.00 | 44.00 | | MMLU | 86.62 | 87.37 | 85.70 | 88.70 | | General | Ko-MT-Bench | 86.69 | 88.00 | 82.69 | 88.44 | | MT-Bench | 83.25 | 86.56 | 93.50 | 88.19 | | LiveBench2024.11 | 52.30 | 64.50 | 54.20 | 52.19 | | Instruction Following | Ko-IFEval | 77.96 | 77.53 | 77.07 | 75.38 | | IFEval | 86.05 | 85.77 | 86.54 | 83.86 | | Math | HRM8K | 48.55 | 54.52 | 46.37 | 43.27 | | MATH | 74.28 | 72.72 | 77.00 | 72.38 | | Code | HumanEval+ | 79.27 | 79.27 | 81.71 | 86.00 | | MBPP+ | 73.28 | 70.11 | 75.66 | 75.10 | | LiveCodeBench2024.10~2025.04 | 26.07 | 33.09 | 27.58 | 29.30 | | Long Context | LongBench<128K | 56.70 | 49.40 | 45.60 | 47.50 | | Tool-use | FunctionChatBench | 85.96 | 82.43 | 88.30 | 95.70 |
Lightweight Model Performance
| Benchmarks | A.X 4.0 Light | Qwen3-8B
(w/o reasoning) | Qwen2.5-7B | EXAONE-3.5-7.8B | Kanana-1.5-8B | | Knowledge | KMMLU | 64.15 | 63.53 | 49.56 | 53.76 | 48.28 | | CLIcK | 68.05 | 62.71 | 60.56 | 64.30 | 61.30 | | KoBALT | 30.29 | 26.57 | 21.57 | 21.71 | 23.14 | | MMLU | 75.43 | 82.89 | 75.40 | 72.20 | 68.82 | | General | Ko-MT-Bench | 79.50 | 64.06 | 61.31 | 81.06 | 76.30 | | MT-Bench | 81.56 | 65.69 | 79.37 | 83.50 | 77.60 | | LiveBench | 37.10 | 50.20 | 37.00 | 40.20 | 29.40 | | Instruction Following | Ko-IFEval | 72.99 | 73.39 | 60.73 | 65.01 | 69.96 | | IFEval | 84.68 | 85.38 | 76.73 | 82.61 | 80.11 | | Math | HRM8K | 40.12 | 52.50 | 35.13 | 31.88 | 30.87 | | MATH | 68.88 | 71.48 | 65.58 | 63.20 | 59.28 | | Code | HumanEval+ | 75.61 | 77.44 | 74.39 | 76.83 | 76.83 | | MBPP+ | 67.20 | 62.17 | 68.50 | 64.29 | 67.99 | | LiveCodeBench | 18.03 | 23.93 | 16.62 | 17.98 | 16.52 |
GitHub - SKT-AI/A.X-4.0: SKT A.X LLM 4.0
skt/A.X-4.0 · Hugging Face
skt/A.X-4.0-Light · Hugging Face
| 
微信登陆 
