Some places are seen as no go areas for wheelchair users and people with mobility issues, campaigners say.