When the common boundary separating two (2) or more contiguous lots is covered by a building or a permitted group of buildings, such lots shall constitute a single building site and the side yard as required by this Title shall not apply to such common boundary line. The side yard requirements of this Title shall apply only to the exterior boundaries of the contiguous lots so joined.