None of the options you've suggested are bad. And you can always respec for 100 space bucks anyway.

In my very subjective opinion, I stay away from Magic Initiate and Eldritch Blast in general unless I'm planning on taking the Agonizing Blast from the Warlock class itself.

In general, I would say Magic Initiate feats are not worth it on full spellcasters. You get 3 feats in total, and it’s likely you will use 2 of those 3 feats for ASI to get your casting stat to 20. If you take Magic Initiate, you might as well just do a 1-level dip into that class instead and get more benefit out of it without any drawbacks; you still can get 6th-level spells at 11, have 20 in your main casting stat with two ASIs, and full spell slot progression since you retain that if you multi into separate full spellcasting classes.

For your case in particular OP, I would consider doing a 2-level dip if you want to use EB as a damage cantrip on your Bard. The main reason is because a lv2 Warlock can get 2 passives, and 2 of the choices is adding your CHA modifier to EB damage and having EB be able to push back enemies on hit. You absolutely want the damage bonus from CHA, and then it’s generally a toss up between Devil’s Sight (24m darkvision through normal and magical darkness) or Repelling Blast for more utility. I think you’ll still have the best Bardic Inspiration die, but you will miss out on 6th-level spells. You’ll also get the Warlock benefits of having two replenishable spell slots every short rest, which can be used to cast your Bard spells if you need to.

I’m curious whether taking the magic initiate feat for warlock is better than a multiclass dip (and how well Warlock synergises with Bard to begin with); something to consider as well is that you’re a full spell caster, so I’d imagine you’re basically always going to have something better to concentrate on than a level 1 hex. But yes, you would be able to re-target that hex just like a typical warlock.

As far as whether actor is better, what sort of bard are you going for? You already got expertise in 2 skills at level 3; what did you put it towards?

I almost did the same to get eldritch blast as I thought my bard needed an every turn spell to cast. In my experience you are only a few levels away from having enough spell slots to make the problem go away. Also as a bard you will get the option to take a couple spells from any class which shoukd help round you out.

Be a swords bard, take sharpshooter at level 4, find two hand crossbows, and just pew-pew everything with 3 shots per turn (flourish allows to you to target the same target with your multi-attack, and you get an offhand attack for 3 attacks) that have +10 damage on each of them. And you get to enjoy all those nice bard spells and skills on top!