2952 shaares
DFlash 2 decodes at close to 3× the speed of autoregressive decoding, about a third of the compute per token, with the same output.
DFlash 2 decodes at close to 3× the speed of autoregressive decoding, about a third of the compute per token, with the same output.