Browse topics

#speculative-decoding

1 article

  • Speculative Decoding

    How speculative decoding preserves a target model's distribution while replacing serial decode steps with parallel verification.