Making use of the quantum correlators associated with the Maxwell field vacuum distorted by the presence of plane parallel material surfaces we rederive the Casimir-Polder interaction in the presence of plane parallel conducting walls. For a configuration consisting of a conducting wall and a magnetically permeable one new results for the Casimir-Polder interaction potential are obtained.