Last time I went to see my advisor at the Jobcentre, it ended up getting rather noisy at one point. It was in an open-plan office, and there were several appointments taking place at the same time. I said to her something like, "I'm having a really hard time focusing on what you're saying with all this noise around me."
It kind of makes sense that the world is structured to suit neurotypical people. I'm not saying it's ideal, just that it makes sense that the world has evolved to suit the majority rather than the minority.
It is a annoying, though. The Joncentre has a lift so that wheelchair users can get upstairs. But I wasn't given the option of having my appointment away from all the noise.