- Create the folder you want to move the files into.
- Select all the files and right-drag them (i.e. drag while pressing the right mouse button) into the relevant folder.
- When you release the right-button, a menu will popup offering various copy/move options.
One of them is "Git move versioned item(s) here". - Select that option and your files will be moved into the selected folder.
Git will also be aware that the files did not disappear but were moved.

ps: Comments and/or links to this article are most welcome!