That would be specific to a yevama.
Of course, and thats why r' Yose did it like that
(question is why 5 times unless it was quints)
The point is that most chumros come from somewhere
The reason (according to meforshim there) is that he didn;t want pleasure from a mitzva
It's easy to see how that could morph into a modern day stringency
couple that with R' Eliezer's way (Megaleh Tefach, Bu'al K'Shed)......