GLOVER++: Unleashing the Potential of Affordance Learning from Human Behaviors for Robotic Manipulation