FAO BBC: Double-encoded UTF-8 in Programme's JSON.

[Ralph Corderoy]

Hi,

I noticed get_iplayer showing

Rothaí Móra an tSaoil: Series 1

and wondered if it was a bug, but the BBC's JSON has

$ curl -sS https://www.bbc.co.uk/programmes/b09w6dhm.json |

grep -o '"Roth[^"]*"'

"Rotha\u00c3\u00ad M\u00c3\u00b3ra an tSaoil"
"Rotha\u00c3\u00ad M\u00c3\u00b3ra an tSaoil"
$

and get_iplayer is correctly showing U+c3 and U+ad after `Rotha'.

The problem is the BBC have taken a UTF-8 encoding of the intended rune
and encoded it again as UTF-8.

$ iconv -f utf-8 -t ucs-2be <<<$'\xc3\xad \xc3\xb3' |

od --endian=big -tx2

0000000 00ed 0020 00f3 000a
0000010
$

Thus the title is meant to be

$ printf 'Rotha\u00ed M\u00f3ra an tSaoil\n'
Rothaí Móra an tSaoil
$

Can a BBC lurker please see if they can stop it happening. Thanks.