Any process that modulates the frequency, rate or extent of phosphate transport. Phosphate transport is the directed movement of phosphate into, out of or within a cell, or between cells, by means of some agent such as a transporter or pore.