It has been reported that the tumbleweed is reaching roof height up to several times a day.
About 20 residences on a new development have been hit the hardest with the grass blowing over from neighbouring fields.
Authorities say that there is nothing that they can do about the problem.
Hairy panic is a short-lived perennial native to inland Australia. Outbreaks of the weed take place across the country every year but Wangaratta has been hit bad this year due to drier than average conditions.