In the present study, concentration, distribution, ecological effect and potential health impacts of PTEs in agriculture soils and weathered sediments of District Swabi of Khyber Pakhtunkhwa (KP) Pakistan have been evaluated. Standard sampling procedures were followed to collect samples from all over the study area. Laboratory analyses were carried out to determine physicochemical properties and elemental concentrations through Atomic Absorption Spectroscopy (AAS). The relationships between variables were explored and possible sources of contamination identified using statistical techniques, such as Principal Component Analysis (PCA). The degree of contamination was evaluated using different environmental pollution indicators, such as: Enrichment Factor (EF), Contamination Factor (CF), Geoaccumulation Index (Igeo) and Pollution Load Index (PLI). An exposure assessment model was used and validated for adults and children to estimate ecological and human health risks. Analytical results indicated that the presence of PTEs in the examined soils and sediments is related with lithogenic processes and anthropogenic activities. The multivariate analyses showed that the elements Hg, Mn, Ni and Pb were the most important factors causing elemental variation, whereas EC, TDS and Zn also had a significant influence. The pollution indices computed showed high levels of enrichment of some of the elements, indicating moderate to severe contamination in various areas, exceeding SEPA 2018 guideline values. The most critical contaminants (unpolluted to moderately polluted) were identified as Hg and Cd by the geoaccumulation assessment, while most other elements were in the unpolluted to moderately polluted range. Generally, the ecological risk assessment results indicated low levels of risk for most of the PTEs, with relatively high levels of concern for Hg and Cd. Human health risk assessment showed that children were more vulnerable to noncarcinogenic effects than adults due primarily to their oral ingestion route of exposure. Additionally, some locations had Cr and Ni concentrations that were above the acceptable limits for carcinogenic risk. The results of the present study emphasize the need for ongoing environmental monitoring and management plans in order to reduce contamination and potential health risks in the area.