Yeah, replace the belt. Also check the auto tensioner to make sure it is good condition. If you see marks where it looks like rusty water has come out of it replace it. Check for this both at the pulley itself and at the pivot point for the pulley arm.