Although rare, inflammatory breast cancer may be why your nipple is itching like crazy. Other symptoms include redness and skin like an orange peel.