If you then tap your profile picture (in the upper right-hand corner of the messaging app), you'll now see the Trash option.
One of the best Android settings is somewhat hidden away, but I really wish Google enabled it by default on future Android ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results