Unstable Livekit Room Connection for Subroom Audio

When invited into a whisper group, a participant can no longer toggle their microphone, webcam or enable screenshare.

W to whisper also doesn't work.

Can be reproduced on current staging as of creating this issue.