Do you train models from scratch, or only fine-tune existing ones?
FAQBoth, depending on the task. With language models, fine-tuning an existing open-source model on your terminology and data is almost always sufficient, because it is an order of magnitude cheaper. Training from the ground up makes sense for specific machine learning and computer vision tasks using your own data. We always first check whether the simpler route is enough.