Worms still wiggling

We've had a wormery for many years. One of my first tasks on moving into the new house was to transfer the worms from the tiny bin they had sat in in our little flat into the palatial surroundings of a new Can-o-worms. They've had their ups and downs but this year we have barely been able to keep up with their munching away at the waste we give them. The only thing is they seem to have started sharing their home with hundreds of tiny fruit flies. I'm guessing these might all bite the dust as the weather gets colder, but does anyone have any ideas of how to get rid of them? A swarm of flies everytime you open the wormery isnt that pleasant.