Also not sure If disabling QTE [Quick time events] in the Options menu would make this easier. ›››
Disabling "difficult QTEs" does not affect this sequence.
You have a short time to get up the ladder and release all three of the she-elves, so it has to be accomplished without hesitation or missteps. Moving quickly and directly to each one will give you more time to complete the QTEs.