I had couple 13B models loaded in, it was ok. But I really wanted a 30B so I got a runpod. I’m using it for api, I did spot pricing and it’s like $0.70/hour

I didn’t know what to do with it at first, but when I found Simply Tavern I kinda got hooked.