this post was submitted on 17 May 2026
2 points (100.0% liked)

Qwen

68 readers
3 users here now

A community all about the Qwens! (LLMs, VLMs, WANs...)

Here their blog page and their free chat interface

Post are allowed to have any format.

It is advised to put "Qwen" into the title somewhere.

Da Rules

  1. please be nice <3 🧸
  2. no bigotry or general evil-doings please! πŸ’–
  3. no politics 🌏❌
  4. please don't make me add more rules <3

founded 1 year ago
MODERATORS
 

im so sleepy.

agents driven by language models (LMs) call functions to do stuff. Functions like these:

  • read_file(path, from, to)
  • write(path, content)
  • list_fir(path, show_hidden = false)
  • edit_file(path, old_string, new_string)

this is not a simplification btw.

so far, LMs were told to generate any of these formats to call a function:

  • json, which sucks cuz of c-escape
  • xml which sucks cuz of closing tags
  • yaml which sucks cuz of multilinear strings being indented (sucks for LMs)
  • just bash which sucks cuz of security

wow these all have problems with something, hm?

worst of all: we wanna save tokens wherever possible. so if an LM has to generate a full </parameter> for each argument in a function, that adds up quick

Introducing: my new format

wowie let's have a look at this format!

[write path="file.txt" content=

content of file here
horray newlines
no c escape! cool, i can regex all I want [\s\S]*

]

now isnt that simple?

  • no string escape problems
  • no xml-closing tags
  • no json-brace-foolery
  • no... | symbols for multilinear strings

now, of course, this is a new format. so language models suck at generating it, right?

WRONG

even a local 2-bit quant of qwen 3.6 35B-A3B aligned to it super easily.

and! even a dense Qwen3 4B model at Q4 quant worked with it flawlessly. I'm tired and need to sleep.

now congratulate me! say "horray wow ur such a genius ohmygod we are gonna save so many tokens and thus mΓΆney".

go, go head. im not gonna ask an LM to do it, that much is clear.

or, even better: tell me what SUCKS about this, im always open for critical feedback.

id rather be wrong than believe im right all the time.

you are viewing a single comment's thread
view the rest of the comments
[–] Smorty@lemmy.blahaj.zone 1 points 13 hours ago (1 children)

then i have "bad" news.

i made thiup, it's not a standard.

meaning: you would have to write the entire agentic scaffolding yourself.

which honestly, is a fun project.
ive done it, its nice being able to see exactly what's goin on.

im sure ur super duper smart and already know this, but: all that an agent is, is just:

  • parsing the tokens as they come in
  • notice when the LM writes a tool call
  • parse it after its done
  • execute
  • return the output

so umm... if thats what u feel like doing, good luck! πŸ’–

that is a need, I'm gonna stop playing modded minecraft and work on this instead. it sounds like a lot of fun!