Abstract:The novel two phase noise compensation algorithms based on Kalman filter in coherent optical orthogonal frequency division multiplexing(CO-OFDM) systems are proposed. The two algorithms insert the pilot frequency into the time domain of the transmitter and perform the Kalman filter of the pilot at the receiving terminal, and finally apply the interpolation algorithm to compensate the phase noise of all the OFDM subcarriers. The simulation results show that the two proposed algorithms based on Kalman filter have better performance of the bit error ratio(BER) and can effectively reduce the error floor at the condition of the large phase noise while the BER of the decision feedback algorithm based on the minimum mean square error (MMSE) criterion tends to 10-4 and the error floor occurs at phase noise rate of 10-4. Therefore, the proposed phase noise compensation algorithms can improve the performance of CO-OFDM communication systems.