Forums

Deploy an LLM (pretrained Llama2) from local to pythonanywhere

I have been exploring LLMs for a few months now; It is very interesting to be able to run open-source models locally. I wonder if anyone here has successfully hosted one on pythonanywhere and how they did it!

Kindly, Thanks.

It will likely depend on how resource-intensive it is, since we have restrictions on CPU usage and memory.