Colonies of wasps don’t overwinter. The queen fizzles out at the end of summer and that’s when the disenchanted workers have time on their hands and start to become a nuisance. But no, they won’t build a nest now, they will gradually die off.
New queens hibernate through the winter and start new colonies in the spring but as far as I know, they go and find a new place to nest.
However, just in case perhaps the best thing would be pinpoint exactly where they are getting into your roof, wait till the wasps are dead later in the autumn then try and block the hole where they are getting in.

It could be one of the Ichneumon wasps.
These wasps are smaller and slimmer, with a very pronounced ‘wasp waist’and they have those horrible parasitic lifestyles involving inserting their eggs into other living creatures.
If you have a photo – please send it and I’ll try and identify it.

Its abdomen had similiar black/yellow markings.
Any idea what it might be?