"I don't see how fighting with fear-spells is worse than just stabbing you to death. You say they tried to do that too, but frankly you don't seem likely to have fought them off with your daggers." Not unless those riders are a bunch of first-circle wizards afraid to ride into melee - no, focus. Gord crawls back from the cliff-edge to where he can stand up and fix Merry with his glare.
When Gord said he'd leave, they didn't say they'll go after you when you're alone. The Black Riders have been chasing them for a while, but not attacking others. If he leaves now he should be fine.
These halflings are acting like they're still under a fear spell. Gord's tempted to round them off to civilians - noncombatants who don't want to fight and should be given the benefit of the doubt - except civilians don't normally go around uniformly armed with magic daggers. Maybe they're just rich, but then where are their servants, their guards? Or - no, he shouldn't assume; maybe magic weapons are plentiful and cheap in this world, and any real fighters would be dripping with magic items.
Merry doesn't look like a real fighter, unless he's a very good actor, but everyone has to start somewhere. Gord has Remove Fear prepared, but it'd be silly to spend it now and not during the potential fight itself.
"Translate this. You don't want to tell me why they're after you. That's your right. But I won't fight on your side just because they're Black and scary. If I help you, and you kill them, it's as if I've killed them myself." He's not going to explain how fighting purely in defense makes the fight more dangerous, he's already straining Merry's capacity for translation.
"In a few minutes my spell for understanding all tongues will run out. Only you will be able to translate for me, until tomorrow morning. I'm inclined to come back in the morning, heal any survivors, and maybe try talking to the Black Riders then and hear their side of the story. Do you not want to fight them? How could I trust you not to kill them, if I help you defend yourselves? Translate exactly what I've just said." And give the rest of his party a last chance to say something more useful.