What hardware is needed to run your own model?

FAQ

It depends on the size of the model and the number of users. Smaller open-source models run on a single server with a more powerful graphics card; larger ones need dedicated hardware or a rented private cloud. Before buying anything we calculate how many queries a day you will have and compare the cost of running it yourself with the cloud option.

More questions and answers