Open and closed models
A model you call over an API and a model you download are the same kind of object underneath. The difference is whether anybody will give you the file.
Local and cloud inference
Downloading the weights is the easy part. Getting them to answer a question at a speed anyone will tolerate is where the decision gets made.