I have uploaded student photos individually and using the bulk upload method and they always come up with the head of the photo 90 degrees to the left. these are .jpgs in version 2.3
[UPDATE] More test instructions:
a) In Windows 10, double click on an image. It should open the preview software. Select rotate. Windows 10 will automatically modify and save the "Orientation" exif data (Orientation: rotate 90). The image will be displayed rotated in Windows 10 now.
b) Try to upload the image in a Moodle file resource. Once uploaded from the file picker, the image is displayed with the original orientation in the file manager (incorrect behavior). If you uploaded the same image in Facebook or Google Photo it would be displayed with the modified orientation (the expected behavior).