Lithological studies and geological unit mappings are generally applicable to many fields of natural resource management. Relatively suitable aquifers have been formed in complex formations in northwest Shahrood due to the presence of carbonate rocks as well as erosion and tectonic forces in the region. This study aims to identify and separate the calcareous formations that can form karst aquifers in the study area. As a result of erosion and tectonic forces, the rocks of the region exhibit spectral fluctuations, making it difficult for mapping geological formations using multispectral images. Therefore, Landsat 8 satellite-based images were processed by adopting the minimum noise fraction (MNF), independent component analysis (ICA), and band ratio (BR). The indices of calcareous formations and shale formations were created by the BR through the spectral behavior of pure pixels. Moreover, the support vector machine (SVM) and maximum likelihood (ML) were employed for classification. The SVM classifier proved more capable of classification than the ML classifier, and the transform ICA outperformed the MNF in the separation of formations. The lithological maps were extracted using the SVM with an overall accuracy (OA) of 68.04%. Furthermore, a method decision tree (DT) was employed to improve the classification accuracy. The DT classifier was then utilized to reclassify lithological maps that were classified by SVM and ML through morphological characteristics and indices of formations The DT classifier improved the lithological map accuracy by 10%. The boundaries of calcareous formations were extracted from non-calcareous formations with an accuracy of 93%, and the regional constructions were separated with an accuracy of ∼80  %  . Finally, the lithological map was developed with a kappa of 0.734 and an OA of 78.59%.