The ability to live the life one wants with public transport is one of the key factors of sustainable and inclusive societies. Given the current trend in the transport domain, providing accessible public transport is necessary in order to allow people to participate in their day-to-day activities without using a car. Using survey data obtained from Sweden, this study investigates factors that may have a negative effect on the perceived accessibility of public transportation in major city areas and other areas. Overall, regression analyses show that time and economic resources, organizational and temporal functions, frequent travel by public transport, and geographical context all act as accessibility barriers. These findings highlight the need not only to target increased mobility in urban environments, but also to turn the focus to the citizenry’s perceived accessibility. These findings point to implications for policies, planning and interventions targeted at accessible public transport. Adopting an accessibility-oriented approach to urban development, including the individual perspective, could be a pathway for creating a socially sustainable transport system.