I tried both layouts and logged out/in between, but I think i found my issue.
While currently on google docs and I believe previous versions of word, you can add the nikud of Shin or Sin above any letter as a Cholam, the new version has a dedicated cholam nikud. When you add a nikud for a sin above a random letter it will give you the error.
Edit: The above applies to both Hebrew and Hebrew Standard.