29

It’s called Pi and it’s a conversational AI made to be more of a personal assistant. In the bit of time I’ve used it, it’s done far better than I expected at reframing and simplifying my thoughts when I’m overwhelmed.

Obviously, talking to a real person is much better if possible, but the reality is some of us don’t have the finances to pay for therapy or other ways to cope with the anxiety/depression that so often comes with ASD. What are your thoughts on this?

you are viewing a single comment's thread
view the rest of the comments
[-] TheBluePillock@lemmy.world 3 points 4 months ago

I would love to be corrected, but when I looked into it, it sounded like you'd probably want 32gb VRAM or better for actual chat ability. You have to have enough memory to load the model, and anything not handled by your GPU takes a major performance hit. Then, you probably want to aim for a 72 billion parameter model. That's a decently conversational level and maybe close to the one you're using (but it's possible they're higher? I'm just guessing). I think 34B models are comparatively more prone to hallucination and inaccuracy. It sounded like the 32GB VRAM was kinda entry point for the 72B models so I stopped looking, because I can't afford that.

So somebody with more experience or knowledge can hopefully correct me or give a better explanation, but just in case, maybe this is a helpful starting point for someone.

You can download models on huggingface.co and interact with them through a web-ui like this one.

this post was submitted on 15 Feb 2024
29 points (87.2% liked)

Autism

6515 readers
11 users here now

A community for respectful discussion and memes related to autism acceptance. All neurotypes are welcome.

We have created our own instance! Visit the following community for more info:

Our Community

Values

Rules

  1. No abusive, derogatory, or offensive post/comments e.g: racism, sexism, religious hatred, homophobia, gatekeeping, trolling.
  2. Posts must be related to autism, off-topic discussions happen in the matrix chat.
  3. Your posts must include a text body. It doesn't have to be long, it just needs to be descriptive.
  4. Do not request donations.
  5. Be respectful in discussions.
  6. Do not post misinformation.
  7. Mark NSFW content accordingly.
  8. Do not promote Autism Speaks.
  9. General Lemmy World rules.

Encouraged

  1. Open acceptance of all autism levels as a respectable neurotype.
  2. Funny memes.
  3. Respectful venting.
  4. Describe posts of pictures/memes using text in the body for our visually impaired users.
  5. Welcoming and accepting attitudes.
  6. Questions regarding autism.
  7. Questions on confusing situations.
  8. Seeking and sharing support.
  9. Engagement in our community's values.
  10. Expressing a difference of opinion without directly insulting another user.
  11. Please report questionable posts and let the mods deal with it. Chat Room

Helpful Resources

Relevant Communities

Autism:

ADHD:

Bipolar:

Mental Health:

Misc:

Neurodivergence:

Social:

^lemmy.world/c/autism^ ^will^ ^happily^ ^promote^ ^other^ ^ND^ ^communities^ ^as^ ^long^ ^as^ ^said^ ^communities^ ^demonstrate^ ^that^ ^they^ ^share^ ^our^ ^community's^ ^values.^

Lemmy World Donations

The admins of our instance work hard to ensure that we have a good place to host our community. They are also helpful at protecting our community from trolls and other malicious actors. They do this for free, so if you appreciate our community, please consider donating to them. The first link is the preferred method, but both work.

founded 1 year ago
MODERATORS