Most of the time I hold a camera normally, but sometimes a vertical shot is the most appropriate. Occasionally I will perform a vertical crop of a horizontal image (but not often – this knocks out a lot of image data).
In presenting my photo work in sets meant to be scrolled top to bottom, as I like to do, I encountered a problem with the integration of vertically-oriented (“tall”) images into groups of horizontally-oriented (“wide) images. Only around five percent of my photos are tall, but they are no less important.