Svelte Hacker News logo
  • top
  • new
  • show
  • ask
  • jobs
  • about

Set Block Decoding Is a Language Model Inference Accelerator

arxiv.org

3 points by veryluckyxyz 9 hours ago