Tomatoes planted in pasture are sick

by BrownDog
(Camdenton, MO, USA)

I recently started an organic garden in Mid-Missouri. The land was previously pasture for cattle.

I planted half of my tomatoes in this new garden and half of them in a raised bed. The plants in the ground garden are not doing well. The ones in raised beds are doing great, all purchased from the same farm.

The sick tomatoes are stunted and the bottom leaves are yellowing or have brown spots the have died and rotted away parts of the leaves. Some of the leaves are curling.

The Cherokee Purples are almost completely without leaves, they have either shrunk so small, rotted off with the petiole still intact, or something has chewed them.

I have seen a few aphids on them, but nothing else. I did one treatment with Neem Oil, and have seen a huge reduction in aphids. The problem is effecting 18 plants, not one seems to be growing well.

I would really appreciate some help with diagnosis. Thanks.