Move to Trash Command

Just discovered something and not sure how to fix it. Example - if I have a folder with one image - a RAW with XMP attachment and JPG copy (of the same image) - and I go to Menu>Action>Move to trash to delete the JPG, the XMP attachment will follow. I would assume that the XMP attachment would follow the RAW file if I deleted it, but not the JPG. (God knows how many times I unknowingly did this.) Anyone know how I can adjust this? Thanks.

Rich Green