I think I found the reason for the underlying issue:
It only happens when the album contains a image with a big width:height ratio.
I had a screenshot with a very high width and low height in that album and that made it crash.
I just now created a new screenshot with the dimensions 1273:23 pixels and put that in a new empty album. Trying to view that album or scanning its faces also caused the same crash.