@ryanweal W/the XMPP plugin, if you type “reply <username> <message>”, it will reply to the last post of <username>. You can also reply to a particular notice with “reply #678971 <message>” with the number being the notice id.