The couple wasn't fleeing from Hitler out of fear, but their disagreement with the whole regime made them leave. They started with a garden, and since they were vegetarians, they relied heavily on their crops for food.