Earthquakes are known as one of the deadliest natural disasters that have caused many fatalities and homelessness through history. Due to the unpredictability of earthquakes, quick provision of buildings damage maps for reducing the number of losses after an earthquake has become an essential topic in Photogrammetry and Remote Sensing. Low-accuracy building damage maps waste the time that is required to rescue the people in destructed areas by wrongly deploying the rescue teams toward undamaged areas. In this research, an object-based algorithm based on combining LiDAR raster data and high-resolution satellite imagery (HRSI) was developed for buildings damage detection to improve the relief operation. This algorithm combines classification results of both LiDAR raster data and high-resolution satellite imagery (HRSI) for categorizing the area into three classes of “Undamaged,” “Probably Damaged,” and “Surely Damaged” based on the object-level analysis. The proposed method was tested using Worldview II satellite image and LiDAR data of the Port-au-Prince, Haiti, acquired after the 2010 earthquake. The reported overall accuracy of 92% demonstrated the high ability of the proposed method for post-earthquake damaged building detection.