It didn’t work for me. My test user doesn't have any admin roles, MFA is enabled by Conditional access policy but the VDI public IP address is excluded as a trusted location.
OneDrive and Outlook sign in without any problems; it’s just Teams 2.1 that’s having issues.
I checked the Signin Logs and I noticed Error 9002341
This led me to the comments on this article: https://techcommunity.microsoft.com/t5/windows-it-pro-blog/upcoming-changes-to-windows-single-sign-on/bc-p/4167626/highlight/true#M7419
The failing SSO seems to be a known problem with non-persistant machines.
The mentioned workaround in the comments (EnableADAL,DisableAADWAM, DisableADALatopWAMOverride) didn't work for me either.
I guess the next thing I will try in the lab is hybrid joining the machines, at the moment i'm using AD Seamless SSO