anzo

joined 3 years ago
MODERATOR OF
[–] anzo@programming.dev 0 points 15 hours ago (1 children)

Please replace retarded with another word so that I don't have to remove your comment for ableism (it has been reported.) Thanks!

[–] anzo@programming.dev 2 points 15 hours ago* (last edited 15 hours ago) (3 children)

I believe this discussion is important, just the other day I was sad about people colluding inference and training like if both were having the same carbon footprint. I am not defending Sam Altman or anyone else. But we need to look at the facts for what they're. Running a quantized local model, accepting latency and all, can make your use of LLMs as low as playing video games. I already said that in the past, and I only got downvoted. Maybe because everyone is hurt bout this technology, which is having detrimental consequences. I am not saying there aren't any problems... but I am accepting the world for what it is, as GPT4 has said ~3 years ago: confetti has left the cannon.

So, we need to deal with this reality. The training done on data like open source code, or even copyrighted materials, will always be a debt.

Just like colonialism. And yet, we are not hating each other for "simple" stuff like eating chocolate or drinking coffee which is most often than not unethically sourced. OR the minerals that make our electronic devices..

Again, it's not that I am vouching to ignore the issues. But I rather have us take the conversation as a debate or dilemma. Not just start attacking one another.

This all seems like that caricature of a vegan that hates the vegetarians for eating some cheese.

Look at the common ground. Here, on lemmy, more often than anywhere else, we have a big chunk of values and ethics in common.

[–] anzo@programming.dev 1 points 15 hours ago (1 children)

I think you're the one wrong. You were accusing zd9 to be defending diffusion models and LLMs. So they said: yes, I am precisely using those and not just any other machine learning algorithm. Yet, you didn't seem to understand... or you're just really unable to see yourself as being incorrect? :/

[–] anzo@programming.dev 2 points 2 days ago

Oh yeah I meant to say that some sciences have origins that predate empiricism itself. Astronomy for example. Also, some may argue that not all sciences are rooted on evidence in the same way (e.g. positivism would call psychoanalysis a pseudoscience even though there're powerful conclusions that were drown without evidence and have helped people).

Actually, all hypothesis start with a certain lack of evidence. Some hold for their own value, as potential explanations... Yes, O am not talking about maths anymore but about all sciences. For example many subatomic particles that are investigated by CERN. That's why I believe your approach was shortsighted.

[–] anzo@programming.dev 2 points 2 days ago (2 children)

Can we really separate maths and physics? I don't think so. Also, is empiricism the appropriate way to define sciences? Isn't that a modern shortsightedness??

[–] anzo@programming.dev 29 points 5 days ago (2 children)

Sounds great. Who's stefano? Since I don't know them and the source code is not published yet I am uncertain about this.

And can you explain what's the lighthouses method to bypass NAT? Never heard of it. Seems like the model for this app is p2p-like more than "strict self-host" (similar to scuttlebutt and other projects), am I right?

[–] anzo@programming.dev 3 points 6 days ago (1 children)

thanks :) I kinda felt it was the wrong word but didn't bother to check on a dict. I will try to remember for next time, is funny that I am still learning the language after so many years of being terminally online xD

[–] anzo@programming.dev 7 points 1 week ago (1 children)

Only that in this case the censored word was: gay sex. They were talking about random gay sex.

[–] anzo@programming.dev 11 points 1 week ago (3 children)

Great headline, a failure for both companies. Haha! Yeah, I am a cynic and dislike canonical

[–] anzo@programming.dev 5 points 1 week ago (1 children)

I'm sure you can find better examples... Not only is a small time window, it also seems to me is more to do with tooling on each environment than your actual IT.

[–] anzo@programming.dev 18 points 1 week ago (5 children)

It never occurred to me that people would collude trade with capitalism. I needed this comic, thanks.

[–] anzo@programming.dev 1 points 1 week ago

I didn't mean to imply such a thing. But to answer your question: maybe yes. There are batches and hardware issues can correlate to these.

 
 

I don't understand why Meta (of all companies) would do this. But here we are... with it, the ecological footprint of your waifu girlfriend that just so happens to be a professional coder, goes from Y liters of waters and Z Megawatts to the mere cheap use of your local gpu, just like gaming. What a time to be alive.

 
 
 

Apparently Gemma 4 (by deepmind) are very energy-efficient for their capabilities.

The post itself seems to recommend a company (neuralwatt.com) but it's unrelated to project wagtail (an open source CMS made with django) so I consider it legit, they're just vouching for this new approach that shows users their ecological footprint basically.

(Of course, running these at a homelab is possible. hence the relevance of this info for the community)

 

cross-posted from: https://programming.dev/post/51407459

Check what can you use and at what rate of token per seconds would it be... It has examples of many models and quantization levels. Huge resource!

 

cross-posted from: https://programming.dev/post/51407459

Check what can you use and at what rate of token per seconds would it be... It has examples of many models and quantization levels. Huge resource!

 

cross-posted from: https://programming.dev/post/51407459

Check what can you use and at what rate of token per seconds would it be... It has examples of many models and quantization levels. Huge resource!

 

cross-posted from: https://programming.dev/post/51407459

Check what can you use and at what rate of token per seconds would it be... It has examples of many models and quantization levels. Huge resource!

 

Check what can you use and at what rate of token per seconds would it be... It has examples of many models and quantization levels. Huge resource!

 

Examine a GH user's profile, to help quickly decide how much to invest in their contributions. - ehmatthes/gh-profiler

view more: next ›