Outdoor temperature can really effect the way a rifle will shoot. When it is very hot outside, I often times take two even three rifles to the range and switch between them letting the one just shot, cool in the shade.
I will shoot the rifle, swab the barrel, set it in the shade, walk and check the target, return and shoot the next rifle, and follow the same schedule. By the time I get back to the original rifle I find the barrel has cooled and any effect barrel heating might cause is greatly reduced.
I have a friend that takes a cooler with him and actually wraps the barrel in towels that have been iced and cooled. He does his swabbing, wraps the barrel, target checking, etc and claims it helps his barrel heating issues.
When I do not do anything, I normally will get one flier in a five shot group. Is that from barrel heat or just my fault.. Who knows. But it is a good excuse.