The influence of head misalignments on the performance of binaural reproduction systems through loudspeakers is often evaluated in the frequency domain. The changes in magnitude give us an idea of how much of the crosstalk is leaked into the direct signal and therefore a sweet spot performance can be estimated. However, as we move our heads, the time information of the binaural signals is also affected. This can result in ambiguous cues that can destroy the virtual experience. In this paper, we present an analysis in the time domain of the influence of head misalignments. Using the interaural cross-correlation we estimate the interaural time delay and define a sweet spot. The analysis is based on measurements carried out on 21 different loudspeaker configurations, including two- and four-channels arrangements. Results show that closely spaced loudspeakers are more robust to lateral displacements than wider span angles. Additionally, the sweet spot as a function of head rotations increases systematically when the loudspeakers are placed at elevated positions.