For people using Windows 10 LTSC builds, where the Windows Photos app is not available (and not installable), or for people with nostalgic feelings, you can restore the original Windows Photo Viewer from Windows 7.
The full article with registry hacks can be found here: https://www.tenforums.com/tutorials/14312-restore-windows-photo-viewer-windows-10-a.html. It reactivates Windows Photo Viewer as an option to open image files with, though you still need to manually make the association.
In a corporate environment, to force the file association to Windows Photo Viewer for various common file types, you can do so through GPO by creating a file associations XML: