Guiding Hand

Automatically cropping images.

Published: 19 November 2021

Aims

If we semi-automate suggestions for better imagery based on design guidelines then can we help journalists improve the look of the BBC News website?

Outline

Our audiences use images to make better sense of the news. Our research shows that they use imagery to navigate our pages and decide which stories to read.

It’s essential then that the images we select help with this process, and that journalists follow best practice when doing this selection.

We drew on the expertise of Sue Vágó the head of design in BBC News. She ran training for journalists with advice such as:

  • Use close crops and bold imagery
  • Don’t centre all faces in the frame
  • Use text in images sparingly and always check it is legible.

We aimed to fold that guidance into an AI-powered prototype called guiding hand.

Guiding Hand: how does it work?

So let’s say you are writing an article. You find a picture that you think might be a good fit to tell the story. You send the picture to guiding hand for a recommended crop.

The prototype finds faces automatically, using facial recognition. It auto-crops the largest face, and suggests it to journalists. Other faces can be selected and cropped.

 

Guiding hand finds faces

Rule of thirds for alignment

For each face the prototype offers three alignment options, to the right eye, to the left eye or centred on the face.

Tracey Ullman aligned to the left
One option is to place the left eye one third along from the left.
Tracey Ullman aligned to the centre
Guiding Hand also suggests cropping the picture so it is centred on the face.
Tracey Ullman aligned to the right
Another option is to place the right eye one third along from the right.

Text identification and previews

Text in images is super difficult to read, especially on mobile. So we identify text and remind journalists to try to find alternate imagery. If the text is essential to the image, we offer a preview to show how it looks on mobile, and alongside a headline.

Screenshot of the guiding hand user interface for journalists
The guiding hand user interface includes a suggested targeted crop.

 

Next steps

We will continue testing this out with users and get their feedback. The prototype is stable and is already being used right now by our journalists around the world.

Results

The prototype is being tested with teams in the newsroom. Initial feedback from journalists and the BBC News online design team is very positive.

 

Team

  • Tamsin Green

    Tamsin Green

    Former News Labs Senior Software Engineer
  • Joe Whitwell

    Joe Whitwell

    Former News Labs Journalist
  • Muhammed Hasan

    Muhammed Hasan

    Former News Labs Graduate Software Engineer

BBC News Labs

  • News

    Insights into our latest projects and ways of working
  • Projects

    We explore how new tools and formats affect how news is found and reported
  • About

    About BBC News Labs and how you can get involved
  • Follow us on X

    Formerly known as Twitter

Search by Tag:

Rebuild Page

The page will automatically reload. You may need to reload again if the build takes longer than expected.

Useful links

Theme toggler

Select a theme and theme mode and click "Load theme" to load in your theme combination.

Theme:
Theme Mode: