Face focus while culling images of the elderly

The new Face Focus while culling generally does an excellent job, but it sometimes fails with images of the elderly. Attached are excerpts from three images with varying light and shadow. The settings were "Limit to eye" at 100%. The images are from a Fuji X-H2.