Optimization of optical transmission capacity

A method for transmitting a coherent optical data signal includes receiving a data signal from an interface, and encoding the data signal with a forward error correcting (FEC) encoder according to a mix of modulation formats. The FEC encoder generates an FEC encoded signal which is used to generate modulation symbols according to the modulation formats. The FEC encoded signal of modulation symbols is spectrally shaped to generate a shaped signal, and pre-distorted before transmission. The shaped signal is pre-distorted by adding a predetermined amount of chromatic dispersion to generate a smoothed signal, and the smoothed signal is transmitted according to the modulation formats.