Cluster-aware initialization process. (IMAGE)
Caption
Experts are initialized to preserve weight directions important for each cluster, while the router uses cluster centroids to assign inputs to appropriate experts.
Credit
© CVPR 2026, originally published in CVPR 2026
Usage Restrictions
Reuse of this image is restricted and requires permission from the publisher.
License
Licensed content