
Research3w ago
TreeGraft: Adaptive Multi-Drafter Grafting for Tree-Based Speculative Decoding
TreeGraft introduces an adaptive multi-drafter grafting method for tree-based speculative decoding, addressing the trade-off between drafter size and tree…
#Speculative Decoding#Large Language Models#Inference Acceleration#TreeGraft#Inference#LLM