cole

joined 2 years ago
MODERATOR OF
[–] cole 2 points 5 days ago

Oh yeah, 100% agree the future is local. I think we'll have dedicated chips that have specific models burned on to them to run ultra fast and efficiently.

The mainframe style of computing always goes out of vogue as soon as it can because it sucks

[–] cole 10 points 5 days ago (3 children)

sure - but the unpaid volunteer building your free and open source software wants to go faster so they can spend less of their valuable time on it.

In-general, if you feel this way, lead by example. Fork or contribute but don't just complain

[–] cole 7 points 5 days ago* (last edited 5 days ago) (2 children)

So do I. You can structure and use the tools responsibly.

Two things I really like using LLMs for right now:

1). Search complex codebases for summaries of "how does this work". Especially if you are working outside of a project you normally work in, but your code still utilizes it and you want to understand some behavior (or at least know where to look).

2.) PR reviews. I've been building a custom skill for awhile now that does a great second pass on PRs. I do my initial review, then sic the LLM on it. It often turns up small things I overlooked that are worth addressing.

Currently, I use LLMs in more of a read-only manner, but I have had success in giving them well-structured easier tickets, if your project has good guidelines and you use the planning mode. You need to have an understanding of where you are working to even utilize these.

I know it's an unpopular take, because the hive mind wants LLMs to fail SO bad here, but I think there is a usecase for these long-term for B2B software dev.

That said, I generally disagree with the shoving LLMs into things. There are a lot of wasteful examples where companies replace a perfectly good deterministic thing with a token generator and then it gets worse.

[–] cole 10 points 5 days ago (10 children)

yes - God forbid people try to use tools to enable them to get things done faster. If folks worked in software they'd see that LLMs will not be going away there. Folks need to understand that FOSS is not an exception here. They're welcome to fork and maintain things thanklessly themselves if they dislike it.

[–] cole 1 points 3 weeks ago* (last edited 3 weeks ago) (2 children)

yes you are right and everyone else is a little uneducated for thinking this could actually be a fire risk

[–] cole 3 points 1 month ago

you are absolutely right. there is value to these in software engineering and the people who don't realize that and learn how and when to apply them will be left behind

[–] cole 1 points 2 months ago

The irony here is if you host your open source project somewhere where it isn't being scraped by LLMs your legal case might be weaker.

What an interesting idea

[–] cole 1 points 2 months ago (2 children)

I think it might be hard to argue that it is a clean room implementation if the project is in the training data for the model, which it probably will have been

[–] cole 1 points 2 months ago (2 children)

...do you not use JavaScript?

[–] cole 1 points 2 months ago

exact same story as I. have also been eyeballing NixOS lol. big time investment for me though

[–] cole 3 points 2 months ago

hey I appreciate it! I've never had a donation link and I've refused thus far to add one. I can afford it so I'm happy just to run it as-is.

At one point I wanted to set up an OpenCollective, but it's quite a lot of work actually.

I may post a donation link eventually, but for now no worries!

9
[Update] Recent outage (self.lemdroid)
submitted 2 months ago by cole to c/lemdroid
 

Sorry about that. Our hosting provider went down.

At the moment our architecture looks roughly like this:

  • Lemmy backed on a OneProvider VPS
  • everything else hosted at Fly.io (we heavily rely on the private networking that fly.io provides, they rock!)

In the future, I'm planning on moving Lemmy backend and pictrs to live in my basement. I have a 1 gig symmetric connection with a backup failover, so I honestly think it'll be more reliable than these cheap hosting providers and it will be cheaper.

Just want to give a quick update on what's happened and how we'll fix it going forward!

9
Recent Slowdowns (self.lemdroid)
submitted 5 months ago by cole to c/lemdroid
 

Hi! I know lemdro.id has been a bit slower than usual lately. I'm working to move us to totally dedicated hardware to mitigate this.

Expect early January, although I will make efforts to speed us up on our existing hosting provider.

41
submitted 10 months ago* (last edited 10 months ago) by cole to c/birding@lemmy.world
 

Captured these beauties near Olympic National Park

11
submitted 1 year ago* (last edited 1 year ago) by cole to c/lemdroid
 

Retrieval of most pictures seems to not be currently working. I am still attempting to understand and resolve this.

Edit: This has been fixed

15
Maintenance Tonight (self.lemdroid)
submitted 1 year ago* (last edited 1 year ago) by cole to c/lemdroid
 

UPDATE DAY 2: backend has successfully been migrated onto new dedicated hosting after some pain. there should not be major downtime from here on. tomorrow I will be working on integrating a better backup solution and then I'll leave it alone for a little while.

UPDATE: I was able to deploy the database onto dedicated server hardware tonight, but have not finished moving over the other components I wanted to. You may notice a performance degradation due to increased database-backend latency (...or maybe it will just be better anyways, lol).

I will finish off work on this tomorrow!

Lemdro.id has been struggling with some performance issues lately, as you've likely noticed. This is due to changes made by our hosting provider that causes the database to run much slower. Tonight at 10pm PST, I will be putting lemdro.id into maintenance mode to migrate some parts of the infrastructure to a new dedicated server.

Thanks for your patience!

 

Hey all! I've done a lot of database maintenance work lately and other things to make lemdro.id better. Wanted to give a quick update on what's up and ask for feedback.

For awhile, we were quite a ways behind lemmy.world federation (along with many other instances) due to a technical limitation in lemmy itself that is being worked on. I ended up writing a custom federation buffer that allowed us to process activities more consistently and am happy to say that we are fully caught up with LW and will not have that problem again!

Additionally, on the database side of things, I've setup barman in the cluster to allow for point of time backups. Basically, we can now restore the database to any arbitrary point in time. This is on top of periodic automatic backups which also gets pulled to storage both on my personal NAS as well as a Backblaze bucket (both encrypted of course).

Today, I deployed a new frontend at https://next.lemdro.id. This one is very early stages and experimental but is being developed by https://lemm.ee and seems promising!

If you live outside of the US and experience consistently long load times I want to hear from you! I am deploying the first read replica node to Europe soon, so if you live in that region you'll soon notice near-instaneous loading of content. Very exciting!

Finally, looking for feedback. Is there anything you want to see changed? Please let me know!

 

Google today announced a handful of wearable and navigation updates, starting with public transit directions in Google Maps for Wear OS.

71
submitted 2 years ago by cole to c/android
 

cross-posted from: https://lemmy.zip/post/10370094

21
submitted 2 years ago* (last edited 2 years ago) by cole to c/lemdroid
 

I am rolling out the Photon UI as a replacement to the default lemmy UI right now. Initially, only about 50% of requests will be routed to Photon, determined by a hash of your IP address and user agent (sorry for any inconsistencies...). As I determine that this configuration is stable I will be slowly increasing the percentage until Photon is the new default frontend for lemdro.id.

If you have any difficulties, please reach out. Additionally, the "old" lemmy frontend will remain available at https://l.lemdro.id

Edit: I am aware of some problems with l.lemdro.id. It wasn't designed to run on a subdomain so I'll need to add a proxy layer to it to redirect requests. A task for tomorrow!

FINAL EDIT: https://l.lemdro.id is now fully operational, if you choose to use the old lemmy UI it is available there

9
submitted 2 years ago by cole to c/lemdroid
 

Over the course of the last couple weeks, I managed to root cause and solve the problem causing stale sorting on lemdro.id. My apologies!

 

We typically like Pixel phones a lot, but we have some reservations about Google's quality control

view more: next ›