Wash it thoroughly with water and mild household detergent.

Accumulated detergent from prior washings can cause problems with the soap dispenser. Use a new dispenser made for the dishwasher. Also check to make sure the dispenser tray isn't cracked.