These sectors, though, have only 30 per cent of the credit share.
The central bank, in its annual report for FY2013-14, said gross non-performing assets in the system have grown to 4.1 per cent in FY'14 from 3.4 per cent a year ago.
It also said the contribution of mandatory priority sector loans to the overall bad assets have come down during the last fiscal.
Stating that the state-run banks are the chief sources of stress, RBI said these six specifically identified sectors of infrastructure, metals and products, textiles, chemical and chemical products, engineering industries and mining and quarrying alone contributed 36 per cent of gross NPAs, as against their 30 per cent contribution to total advances.
The gross non-performing assets ratio for the non-priority sector grew to 4 per cent as of March 2014 as against 3 per cent in the year ago period, while the same for priority sector stood stable at 4.4 per cent, it said.
"The non-priority sector has contributed more in the deterioration of the loan asset quality of the banking sector in recent years," it said, adding that the contribution of PSL loans to the overall bad loans narrowed to 36 per cent as of FY'14 from 40 per cent in FY'13.
Commenting on the health of the sector, the RBI said it "remains satisfactory".
On reports of some improvement shown by the banks in the asset quality in the fourth quarter, the RBI hinted at there not being a cause for celebration yet, as this was due to the asset sales to ARCs.
Additionally, it also highlighted the lurking threat, pointing out at the high growth in restructured assets during the previous fiscal 2012-13.