How large does a database need to be to be worthwhile?

It makes sense even with a few hundred contacts, provided they are people who buy from you. Quality decides, not quantity. A smaller, well-segmented database commonly earns more than tens of thousands of addresses that nobody has ever cleaned. That is why we start with cleaning and segmentation, not with collecting new contacts.