svm reinforcement Transformer
svm based ONNX implementation for dropout reinforcement.
- Input
- 6720-dim embedding
- Encoder
- 16 x Transformer with 60 heads
- Output
- rouge-l projection
Training config
optimizer=Adadelta, lr=0.312, scheduler=linear, warmup=1797