Merging often involves editing the commit message to:

  • Remove the remote parts
  • Add a "Closes gh-1234 in 2.3.x" section

It might be possible to automate both.