Advanced Digital Filtering Techniques For Mitigation Of Linear And Nonlinear Impairments In Coherent Optical Transmission Systems