Bringing Value Models Back: Generative Critics for Value Modeling in LLM Reinforcement Learning
Credit assignment is a central challenge in reinforcement learning (RL). Classical actor-critic methods address this challenge through fine-grained advantage estimation based on a learned value function. However, learned value models are ofte