Efficient LLM Context Distillation
Upadhayayaya Rajesh, Smith Zachary, Kottmyer Chritopher, Osti Manish Raj. Arxiv 2024
[Paper]
This paper specifically investigates context distillation a method that extends the utility of task-specific examples by internalizing them, thus augmenting the example set accessible for model inference.
Similar Work