I don't think it is unreasonable to expect access to a restroom when required to be inside the building.

OSHA requires employers to provide such access. But you might be right that volunteers are not afforded the same privilige.
https://www.osha.gov/restrooms-sanitation

That said, restrooms in public spaces and restaurants and stores are open for use. I would think that restrooms in buildings would start reopening.