DiLoCoX (Qwen1.5-107B on WT-103)
DiLoCoX (Qwen1.5-107B on WT-103) is an announced but not yet released language model from China Mobile, released June 26, 2025. Its makers disclosed about 107B parameters.
The distributed training of foundation models, particularly large language models (LLMs), demands a high level of communication. Consequently, it is highly dependent on a centralized cluster with fast and reliable interconnects.
Check it against your own PC →
Lab
China Mobile
Released
June 26, 2025
Weights
announced but not yet released
Parameters
107B disclosed
Context
–
Price / M tokens
–
Epoch ECI
not yet rated
Benchmark results
Epoch AI has not published results for DiLoCoX (Qwen1.5-107B on WT-103) yet. New models are usually evaluated within days to weeks.