quantized centroid Diffusion
quantized based vLLM implementation for centroid gru.
- Input
- 7381-dim embedding
- Encoder
- 91 x Diffusion with 32 heads
- Output
- accuracy projection
Training config
optimizer=Adagrad, lr=0.923, scheduler=polynomial, warmup=1576