So, is there any way to get it working as a front-end for a local llama installation?

It is a progressive web app so you can save it to your home screen to behave like an app on both iOS and Android.

You might double check the API key is correct.

Also make sure you have access to the model you’ve selected, you may not have GPT4 access by default if you’re using that.

I believe it’s GPT3.5 by default and you can request GPT4 access.

Thanks!

Good question, I hadn't really thought about it before but I think an export is possible. Conversations are stored in your browsers local storage, adding the ability to export/import seems entirely possible.

It might even be possible to generate a web link on export that you can use to load conversations on another device.

As far as server side storage goes personally I'd like to handle as little of other peoples data as possible even if it's just AI chat conversations. It's not out of the question though, I just need to look into it further.

Edit - I mention here I will add the ability to export. I’ve also added a GitHub Issue with the feature request.

Now I just have to not be lazy and do it eventually.

If you’ve created a new account and generated an api key I think you just need to go Billing —> overview and setup your payment method.

I think you get $20 credit for signing up after that and your key is active.

Edit - the default model will be 3.5 as well. I think you have to request GPT4 access still. But they’re giving out access pretty quick these days I think.

Edit 2 - Actually it looks like GPT4 should be available from the start as well now. Nice!