I don't want guys listening to me

Ensure you are broadcasting/sharing. Your browser may ask for permission, to start, you must approve this.
Now, just below the preview of your cam, if you have a microphone and do not want to broadcast it, select the microphone button to turn it off and go video only.