Replace the entire tensioner, not just the pulley. They get weak over time......

And yeah, electrical is always fun..... for certain values thereof. But, if it's working properly, run with it. Might just have needed the terminals cleaned a bit.