PSP Go style! It would be small enough to fit in your pocket, but can slide open to reveal the controls. It's still brilliant, it's a shame that form never took off.
My 2nd choice would probably be a clamshell (like the Nintendo DS). Everything else is honestly a bit too big to be very portable.