Fairness Evaluation and Inference Level Mitigation in LLMs