Background: Physical distancing and social isolation impacted people on a large scale and deterioration in the peoples’ quality of life under the COVID-19 pandemic was noted. The purpose of the study was to examine the association between social isolation and the quality of life among elderly people aged between 63 and 79 years. Method: This is a cross-sectional analytical study, and data were collected using the purposive sampling technique. Chi-square test was used to see the difference between groups, and to assess prospective associations between independent and dependent variables, a simple logistic regression was used. Results: The results of the study showed that elderly people who felt isolated during COVID-19 experienced a stressful life, compared to those who did not feel isolated (OR=0.14; 95% CI:0.03-0.55). Similarly, those who had mandatory isolation were also related to stressful life, and the result was statistically significant (OR=0.12; 95% CI:0.29-0.48). Moreover, elder people who had chronic health problem was associated with stressful life during COVID-19 (OR=0.22; 95% CI:0.06-0.86). Conclusion: The present findings suggest that social isolation has decreased the quality of life for elderly people under COVID-19. Moreover, elderly people who had health problems had also experienced stressful life.