Lew, Alexander K. and Zhi-Xuan, Tan and Grand, Gabriel and Mansinghka, Vikash K. ::: Sequential Monte Carlo Steering of Large Language Models Using Probabilistic Programs
Table of Contents
1. concepts
- infilling
- hard constraints
- prompt intersection
- sequential monte carlo
- sequential monte carlo steering
- approximate optimization
- beam search
- token masking - delete token not satisfying constraint
- particle filters
- Feynman-Kac Transformer Models