Make a new garden and when Seedows comes, hit him with a shovel until he disappears.

He will throw bad seeds and they will plant themselves. Then get 2 Weedings and 2 Gatherlings, they will take care of the garden.

If you like you can hire Night Watchlings and Watchlings to scare the worms and the brown birds.

If they become residents sell them.