Stumpokapow
listen to the mad man
Typically don't build ANY farms until the end of feudal age. Depending on the map, you can make it well into castle before you should start getting farms. Farms generate food much more slowly than deer/sheep, and cost wood, which is valuable for early offensive strategies.
Other than that I agree completely
From what I remember, most pre-Castle rush strategies were doomed because of how good garrison defence of the Town Centre is. I remember mostly trying to get to Castle ASAP and then going offensive. But you're right, you obviously herd your cows and hunt any very close deer and strip the berry bushes first before farming. I like farming, though, because it keeps a huge chunk of your villagers close to the TC which means you can respond very actively by ringing the bell if anything comes up.