definitely not accepted by all
Source?
I believe it's a straight halacha...
Eta: i checked the Dirshu M"B hilchos yom kippur... where the M"B talks about Havdalah he brings the sdai chemed who quotes the minchas pittim who says it's assur and the sdai chemed is docheh his proof. He then brings a whole slew of "contemporary" poskim (r'sz, R elyashiv..) who seem to all agree that with boruch hamavdil it would be muttar to drink (some even without) then ends off with the C' HaG"riz Yuma that leaves with a tzruch iyun if it would be muttar, I looked up there and although he does leave off like that it seemed he is noteh ltzad heter.
Conclusion: seems like its only a daas yaachid who assurs
If u have some other source/ contemporary pose who assurs please post..