Surgical treatment of breast cancer aims to identify and remove all malignant tissue. Intraoperative assessment of tumor margins is, however, not exact; thus, re-excision is frequently needed, or excess normal tissue is removed. Imaging methods applicable intraoperatively could help to reduce re-excision rates whilst minimizing removal of excess healthy tissue. Optical coherence elastography (OCE) has been proposed for use in breast-conserving surgery; however, intraoperative interpretation of complex OCE images may prove challenging. Observations of breast cancer on multiple length scales, by OCE, ultrasound elastography, and atomic force microscopy, have shown an increase in the mechanical heterogeneity of malignant breast tumors compared to normal breast tissue. In this study, a micro-scale mechanical heterogeneity index is introduced and used to form heterogeneity maps from OCE scans of 10 ex vivo human breast tissue samples. Through comparison of OCE, optical coherence tomography images, and corresponding histology, malignant tissue is shown to possess a higher heterogeneity index than benign tissue. The heterogeneity map simplifies the contrast between tumor and normal stroma in breast tissue, facilitating the rapid identification of possible areas of malignancy, which is an important step towards intraoperative margin assessment using OCE.