I'm gonna go with the San Diego Padres, since they are rarely the answer to anything.
true that lol
But the Padres actually came pretty close to relocating to Washington D.C. in the 70's; not to Toronto.
So it looks like it was either the Phillies, Pirates or Giants. I can't figure it was...