She's... not allergic to good aligned clerics? But it is still tactically sensible. "I'll make sure to scream if I see any goblins."

All right, time to go into the church!

It's a fairly spartan and militaristic building inside. Maybe all churches of Tyr are like this, or maybe this is an old fort that's been given new life. 

There are a few armour wearing warriors in the main room. In the side, there is a pair of dead bodies, laid on the back with their eyes closed, awaiting burial.

"Would you be able to render us aid?" One of the probably-paladins asks.

"...we have a kind of time-sensitive situation going on but maybe?"

"I thought I should lead with that. We would render aid unto you, but we're somewhat besieged right now."

"What's wrong?"

"A devil is on the loose. We've been tasked with tracking her down. The good news is that we have found her, the bad news is she is ruthless."

"Karlach?"

He nods. "Champion of Zariel."

"I'm from a different planet, what do those proper nouns mean?"

"Zariel is the newest Archdevil, dedicated to fighting the Blood War between demons and devils. Karlach is her champion, and Mount Celestia weeps at whatever purpose has brought her to the Material."

"Is that your devil or a different one?" he asks Wyll.

"The very same." Well. At the very least he can definitely find her.

"Do you think we should deal with Karlach now or Master Halsin?"

"I don't want to lose track of her, and she's already causing harm."

"What kind of stuff is she doing?" he asks the paladins.

"She's been attacking us since she found us. Hit and run attacks. Though it seems she does not like her chances against people somewhere fortified."

"What about non-adventurers?"

"Once she has finished with us, she will target them."

Fair enough. "Let me talk to my party."

He heads outside so Shadowheart gets a vote too. "Karlach is a devil and the champion of Zariel, and she's rampaging about. Wyll has taken an oath to slay her, and it'd be convenient to do it while he knows where she is. Let's vote. Four out of six means we fight. I'm for fighting, obviously."

"Probably for the best we deal with the rampaging devil."

"It will be a worthy challenge."

"And the paladins of Tyr may have resources they can give us."

"Every. Kitten.  In. Every. Tree--"

Cayden ruffled Astarion's hair. "You won last vote!"