Yes, everything was literally fine with them using the bathroom before. No, they are NOT the people making a big deal out of the restroom. That would be the people making laws literally making it illegal for them to use the restroom they feel comfortable in. If those laws weren't being introduced and passed all over the country by transphobes riled up by bad faith right wing outrage media, this wouldn't even be a discussion at all.
What happened was that conservatives who are transphobic made it a wedge issue and got low-information voters all up in arms about the existence of trans people, which leads to the very historically common "I don't care if trans people exist I just wish they wouldn't do it in front of me" arguments like the one you're making here.
They riled up their base, who they know won't think about this very deeply but instead will simply lash out in the direction they're pointing. That's why this is an issue now.
If they really didn't care about trans people existing, no one would be saying things like "if that trans woman goes to the bathroom with my daughter I will assault her", because reasonable people don't assault others for simply minding their business and using the restroom. However, the right wing outrage machine has successfully scared their base into thinking trans people using the restroom they identify with is being "shoved down their throat". They were just fine using the restroom they felt comfortable in until bigots decided, despite the lack of evidence, that it was dangerous and needed to be illegal.