this post was submitted on 07 Mar 2025
41 points (91.8% liked)

Open Source

35384 readers
149 users here now

All about open source! Feel free to ask questions, and share news, and interesting stuff!

Useful Links

Rules

Related Communities

Community icon from opensource.org, but we are not affiliated with them.

founded 5 years ago
MODERATORS
top 12 comments
sorted by: hot top controversial new old
[–] JOMusic@lemmy.ml 7 points 3 weeks ago* (last edited 3 weeks ago)

GitHub here: https://github.com/allenai/OLMoE.swift

Ai2 make as much of their training data available as possible: https://huggingface.co/datasets/allenai/OLMoE-mix-0924

[–] jeena@piefed.jeena.net 5 points 3 weeks ago (1 children)

I wonder how bit it is, normally they call them something with 3B or 7b

[–] oktoberpaard@feddit.nl 1 points 3 weeks ago (1 children)

It’s 7 billion parameters big.

[–] jeena@piefed.jeena.net 1 points 3 weeks ago

Ah, nice, not bad for a iPhone model.

[–] kekmacska@lemmy.zip 3 points 3 weeks ago

Wanna see how you git clone and compile it on ios

[–] foremanguy92_@lemmy.ml 3 points 3 weeks ago (2 children)
[–] 2xsaiko@discuss.tchncs.de 6 points 3 weeks ago (2 children)

It probably uses Apple’s CoreML. Not sure if Android has an equivalent API.

[–] foremanguy92_@lemmy.ml 1 points 3 weeks ago (1 children)
[–] 2xsaiko@discuss.tchncs.de 3 points 3 weeks ago (1 children)

It's Apple's API for hardware-accelerated machine learning. Their new devices have specialized ML hardware so it's actually feasible to run on mobile devices. Probably what they also use for Apple Intelligence. https://developer.apple.com/documentation/coreml

[–] foremanguy92_@lemmy.ml 1 points 3 weeks ago* (last edited 3 weeks ago)

Seems like a good project to implement on the green side (Or pinguin side)

[–] JOMusic@lemmy.ml 2 points 3 weeks ago

according to the linked article, it sounds like it is for performance reasons.