v3.13 released

[RS]

v3.13 has been released.
https://github.com/get-iplayer/get_iplayer/wiki/release310to319#release313

[RS]

This reply seems to have gone astray, possibly because the message was
sent to me rather than the list.

Has this release solved the refresh issue? Thanks.
Amro

Post by RS
v3.13 has been released.

https://github.com/get-iplayer/get_iplayer/wiki/release310to319#release313
The release notes say it has (see the last item). As far as I can tell,
it has.

Best wishes
Richard

[RS]

Has this release solved the refresh issue? Thanks.
Amro

Post by RS
v3.13 has been released.
https://github.com/get-iplayer/get_iplayer/wiki/release310to319#release313

The release notes say it has (see the last item). As far as I can tell,
it has.

Best wishes
Richard

[Amro Bilal]

Apologies, yes it looks I mistakenly replied to you directly rather than the list. And thanks a lot for answering my question.
All the best
Amro

Sent from my iPhone

Has this release solved the refresh issue? Thanks.
Amro

Post by RS
v3.13 has been released.
https://github.com/get-iplayer/get_iplayer/wiki/release310to319#release313

The release notes say it has (see the last item). As far as I can tell, it has.
Best wishes
Richard
_______________________________________________
get_iplayer mailing list
http://lists.infradead.org/mailman/listinfo/get_iplayer

[Clive]

I've been away so my apologies if this has been covered. I understand
that scraping the BBC pages was broken but is fixed in v3.13 - well, not
for me it seems. I am using get_iplayer in a Terminal within Linux Mint.
For example, there are three episodes of Hitchhiker available but only
Episodes 1 & 2 are found by the term: get_iplayer hitch. I can get the
third episode from the pid. Can anyone offer any guidance please?

Thank you.

Clive

[Roger Bell_West]

I've been away so my apologies if this has been covered. I understand that
scraping the BBC pages was broken but is fixed in v3.13 - well, not for me it
seems. I am using get_iplayer in a Terminal within Linux Mint. For example,
there are three episodes of Hitchhiker available but only Episodes 1 & 2 are
found by the term: get_iplayer hitch. I can get the third episode from the
pid. Can anyone offer any guidance please?

Since I have successfully downloaded that same programme with 3.13,
can you confirm absolutely that you're running the new version?

(Yes, I know it sounds stupid. I've done it before.)

R

[Clive]

Post by Roger Bell_West

I've been away so my apologies if this has been covered. I understand that
scraping the BBC pages was broken but is fixed in v3.13 - well, not for me it
seems. I am using get_iplayer in a Terminal within Linux Mint. For example,
there are three episodes of Hitchhiker available but only Episodes 1 & 2 are
found by the term: get_iplayer hitch. I can get the third episode from the
pid. Can anyone offer any guidance please?

Since I have successfully downloaded that same programme with 3.13,
can you confirm absolutely that you're running the new version?
(Yes, I know it sounds stupid. I've done it before.)
R

get_iplayer > x.txt produces:

get_iplayer 3.13-ppa31d, Copyright (C) 2008-2010 Phil Lewis
  This program comes with ABSOLUTELY NO WARRANTY; for details use
--warranty.
  This is free software, and you are welcome to redistribute it under
certain
  conditions; use --conditions for details.

[Roger Bell_West]

Post by Clive
get_iplayer 3.13-ppa31d, Copyright (C) 2008-2010 Phil Lewis

OK, that's not a "pure" 3.13, and maybe that's your problem. I'm
running directly off the github download. Anyone else using this PPA
version?

[Clive]

Post by Roger Bell_West

Post by Clive
get_iplayer 3.13-ppa31d, Copyright (C) 2008-2010 Phil Lewis

OK, that's not a "pure" 3.13, and maybe that's your problem. I'm
running directly off the github download. Anyone else using this PPA
version?

If you were to email me the .pl script directly I could rename the one I
have and try your copy in its place.

[SquarePenguin]

Post by Roger Bell_West
OK, that's not a "pure" 3.13, and maybe that's your problem.

Unlikely. That's just the Ubuntu PPA which basically installs the exact same
files as if you do it manually.

I'm using it and see episodes 2 and 3 just fine. (I don't see 1 because I
haven't refreshed my cache in a while).

[Graeme Thorn]

Hi,

I would suggest doing a full cache rebuild using get_iplayer
--cache-rebuild --type="radio", as it could be that the days then g_ip
couldn't download are missing from them.

G

Post by SquarePenguin

Post by Roger Bell_West
OK, that's not a "pure" 3.13, and maybe that's your problem.

Unlikely. That's just the Ubuntu PPA which basically installs the exact same
files as if you do it manually.
I'm using it and see episodes 2 and 3 just fine. (I don't see 1 because I
haven't refreshed my cache in a while).
_______________________________________________
get_iplayer mailing list
http://lists.infradead.org/mailman/listinfo/get_iplayer

[Clive]

Post by RS
get_iplayer
--cache-rebuild --type="radio"

That worked. Wow, never seen so many lines of dots on the terminal
screen. Thank you, I now have three episodes of hitchhiker showing. Must
do that for TV also.

Thank you again.

Clive

[Colin Law]

Post by RS
get_iplayer
--cache-rebuild --type="radio"

That worked. Wow, never seen so many lines of dots on the terminal screen.
Thank you, I now have three episodes of hitchhiker showing. Must do that for
TV also.

cache-rebuild fixed it for me too (I was already using --type=radio).

Thanks

Colin

[John Reay]

I installed 3.13 from the Ubuntu PPA, replacing 3.12.

if I run get_iplayer from the command line it shows >get_iplayer
3.13-ppa31d, Copyright (C) 2008-2010 Phil Lewis

However the Web PVR screens still say 3.12. I think maybe it's just
the text that wasn't updated, but not 100% sure

Post by SquarePenguin

Post by Roger Bell_West
OK, that's not a "pure" 3.13, and maybe that's your problem.

Unlikely. That's just the Ubuntu PPA which basically installs the exact same
files as if you do it manually.
I'm using it and see episodes 2 and 3 just fine. (I don't see 1 because I
haven't refreshed my cache in a while).
_______________________________________________
get_iplayer mailing list
http://lists.infradead.org/mailman/listinfo/get_iplayer

[Colin Law]

Post by Roger Bell_West

Post by Clive
get_iplayer 3.13-ppa31d, Copyright (C) 2008-2010 Phil Lewis

OK, that's not a "pure" 3.13, and maybe that's your problem. I'm
running directly off the github download. Anyone else using this PPA
version?

I am seeing the same issue (only the first two episodes) running that
version on a pi.
$ apt-cache policy get-iplayer
get-iplayer:
Installed: 3.13-ppa31d~stable
Candidate: 3.13-ppa31d~stable
Version table:
*** 3.13-ppa31d~stable 0
500 http://packages.hedgerows.org.uk/raspbian/ stable/ Packages
100 /var/lib/dpkg/status

[RS]

Post by Roger Bell_West

Post by Clive
get_iplayer 3.13-ppa31d, Copyright (C) 2008-2010 Phil Lewis

OK, that's not a "pure" 3.13, and maybe that's your problem. I'm
running directly off the github download. Anyone else using this PPA
version?

I too can see three episodes. I didn't wait for the PPA (for ubuntu
16.04.3). I took the new get_iplayer Perl file from the .zip archive and
replaced it in /usr/bin/. Curiously it is now showing
get_iplayer 3.13-ppa31d
which I don't think it did when I first started using the new version.
Maybe the PPA has been updated in a software update.

Best wishes
Richard

[RS]

Post by Roger Bell_West

Post by Clive
get_iplayer 3.13-ppa31d, Copyright (C) 2008-2010 Phil Lewis

OK, that's not a "pure" 3.13, and maybe that's your problem. I'm
running directly off the github download. Anyone else using this PPA
version?

I too can see three episodes.  I didn't wait for the PPA (for ubuntu
16.04.3). I took the new get_iplayer Perl file from the .zip archive and
replaced it in /usr/bin/.  Curiously it is now showing
get_iplayer 3.13-ppa31d
which I don't think it did when I first started using the new version.
Maybe the PPA has been updated in a software update.
Best wishes
Richard

The get_iplayer script now in /usr/bin/ is not the one I copied there.
my $version_text;
is now
my $version_text = '3.13-ppa31d';

I have just tried on another machine. I refreshed the cache.
A search gave me two episodes.
I installed the PPA and refreshed the cache again. I did not rebuild
the cache, but nor did I after copying the get_iplayer script to
/usr/bin/ on my main machine I can still only see the first two episodes.

Best wishes
Richard

[RS]

Post by RS

Post by Roger Bell_West

Post by Clive
get_iplayer 3.13-ppa31d, Copyright (C) 2008-2010 Phil Lewis

OK, that's not a "pure" 3.13, and maybe that's your problem. I'm
running directly off the github download. Anyone else using this PPA
version?

I too can see three episodes.  I didn't wait for the PPA (for ubuntu
16.04.3). I took the new get_iplayer Perl file from the .zip archive
and replaced it in /usr/bin/.  Curiously it is now showing
get_iplayer 3.13-ppa31d
which I don't think it did when I first started using the new version.
Maybe the PPA has been updated in a software update.

The get_iplayer script now in /usr/bin/ is not the one I copied there.
my $version_text;
is now
my $version_text = '3.13-ppa31d';
I have just tried on another machine.  I refreshed the cache.
A search gave me two episodes.
I installed the PPA and refreshed the cache again.  I did not rebuild
the cache, but nor did I after copying the get_iplayer script to
/usr/bin/ on my main machine  I can still only see the first two episodes.

I have run diff to compare the get_iplayer in the .zip archive with the
PPA version.
my $version_text = '3.13-ppa31d';
is the only difference reported.

A more likely explanation is that the searches were done at different
times. As I understand it, and I haven't checked the code, --refresh
only goes back 7 days, and maybe it is now too old. That doesn't quite
work as an explanation because episode 3 was broadcast on Radio 4 at
1830 on 22 March and won't be repeated on Radio 4 Extra until 29 March.
Maybe the 7 days has been shortened. I have a vague recollection that
the 7 days runs from the start of the week, and that would fit.

Best wishes
Richard

[RS]

Post by RS
A more likely explanation is that the searches were done at different
times.  As I understand it, and I haven't checked the code, --refresh
only goes back 7 days, and maybe it is now too old.  That doesn't quite
work as an explanation because episode 3 was broadcast on Radio 4 at
1830 on 22 March and won't be repeated on Radio 4 Extra until 29 March.
Maybe the 7 days has been shortened.  I have a vague recollection that
the 7 days runs from the start of the week, and that would fit.

The way in which the cache is refreshed is explained here.
https://github.com/get-iplayer/get_iplayer/wiki/cache

It says,
"get_iplayer does NOT index 30 days of programme listings every time the
cache is updated - it indexes no further back than the beginning of the
previous calendar week. This means that you must update your cache each
calendar week for a month after installation in order to build up a full
30 days of programme data. From then on, the 30-day buffer should be
maintained as long as you update the cache at least once per calendar week."

According to that description, a programme broadcast less than 6 days
previously ought to have been indexed without the need to re-build the
cache. It may be that the new scraping algorithm works differently and
the documentation needs to be updated.

Has anyone come across any other examples?

Best wishes
Richard

[Nic Siddle]

Similar apparent problem with Chain Reaction. Not picking up latest in
Series 3 ep 6 (Jack Dee and Jeremy Hardy). Running Windows 10 Home 64
bit. Updated to get i-player 3.13. Current PVR search includes the
following lines:-

_Chain_Reaction_name_radio

_Chain_Reaction_Series_11_name_radio

_Chain_Reaction_Series_3_name_radio

However, when I put the PID into the quick URL search, it finds and
records OK.

I am non-tech and rarely understand the list messages - but would
welcome any advice

Nic

Post by RS

Post by RS
A more likely explanation is that the searches were done at different
times.  As I understand it, and I haven't checked the code, --refresh
only goes back 7 days, and maybe it is now too old.  That doesn't
quite work as an explanation because episode 3 was broadcast on Radio
4 at 1830 on 22 March and won't be repeated on Radio 4 Extra until 29
March. Maybe the 7 days has been shortened.  I have a vague
recollection that the 7 days runs from the start of the week, and
that would fit.

The way in which the cache is refreshed is explained here.
https://github.com/get-iplayer/get_iplayer/wiki/cache
It says,
"get_iplayer does NOT index 30 days of programme listings every time
the cache is updated - it indexes no further back than the beginning
of the previous calendar week. This means that you must update your
cache each calendar week for a month after installation in order to
build up a full 30 days of programme data. From then on, the 30-day
buffer should be maintained as long as you update the cache at least
once per calendar week."
According to that description, a programme broadcast less than 6 days
previously ought to have been indexed without the need to re-build the
cache.  It may be that the new scraping algorithm works differently
and the documentation needs to be updated.
Has anyone come across any other examples?
Best wishes
Richard
_______________________________________________
get_iplayer mailing list
http://lists.infradead.org/mailman/listinfo/get_iplayer

[iz]

Once get_iplayer updates the cache in any given week, it doesn't go
back to the previous week. Ordinarily that would be unnecessary, but
you can force it with the use of --refresh-limit or --cache-rebuild,
as has already been suggested. It's likely that people did their first
update this week with the old broken get_iplayer, and thus subsequent
updates with the new get_iplayer didn't go back to last week.

[RS]

Post by iz
Once get_iplayer updates the cache in any given week, it doesn't go
back to the previous week. Ordinarily that would be unnecessary, but
you can force it with the use of --refresh-limit or --cache-rebuild,
as has already been suggested. It's likely that people did their first
update this week with the old broken get_iplayer, and thus subsequent
updates with the new get_iplayer didn't go back to last week.

You may be right, but both machines I have tried had the cache refreshed
during the last calendar week. The one I updated to v3.13 on Saturday
evening has indexed the Jack Dee/Jeremy Hardy episode of Chain Reaction
broadcast on Radio 4 Extra at 2330 on 23 March. The one I updated last
night has not.

That suggests that with the new algorithm it is going to be necessary to
refresh more than once a week to maintain a complete cache.

Best wishes
Richard

[iz]

Post by RS
That suggests that with the new algorithm it is going to be necessary to
refresh more than once a week to maintain a complete cache.

There is no "new algorithm", and you don't have to refresh more often
than you did before. If you can't live with a hole in your cache, just
rebuild it.

[RS]

Post by iz
There is no "new algorithm", and you don't have to refresh more often
than you did before. If you can't live with a hole in your cache, just
rebuild it.

I have another machine which had not been refreshed in the last week.
It has just been updated to v3.13 and refreshed but not re-built. It
has indexed episodes 2 and 3 of the Hithchhiker's Guide to the Galaxy
and the Jack Dee/Jeremy Hardy episode of Chain Reaction, so you are right.

Although I have not seen it mentioned in the documentation, I did not
need to re-install the PPA. It was updated to v3.13 automatically by a
software update.

Best wishes
Richard

[SquarePenguin]

Post by Clive
Episodes 1 & 2 are found by the term: get_iplayer hitch. I can get the
third episode from the pid. Can anyone offer any guidance please?

Unless my installation is broken too I'm surprised you can see anything with
`get_iplayer hitch`.

Those episodes are radio so I'd expect to have to use get_iplayer --type=radio
hitch` to see those episodes.

Perhaps a typo (or some other option preference saved), but nonetheless I'm also
surprised you get episodes 1 and 2 but not 3. Being the oldest episode I'd have
guessed at episode 1 not being available simply by dint of not updating the
cache over the last 30 days.

Try forcing a cache update `get_iplayer --type=all --refresh`

After the above, could you post the output of `get_iplayer --type=radio hitch` ?

[Clive]

Post by SquarePenguin

Post by Clive
Episodes 1 & 2 are found by the term: get_iplayer hitch. I can get the
third episode from the pid. Can anyone offer any guidance please?

Unless my installation is broken too I'm surprised you can see anything with
`get_iplayer hitch`.
Those episodes are radio so I'd expect to have to use get_iplayer --type=radio
hitch` to see those episodes.
Perhaps a typo (or some other option preference saved), but nonetheless I'm also
surprised you get episodes 1 and 2 but not 3. Being the oldest episode I'd have
guessed at episode 1 not being available simply by dint of not updating the
cache over the last 30 days.
Try forcing a cache update `get_iplayer --type=all --refresh`
After the above, could you post the output of `get_iplayer --type=radio hitch` ?

I download much more radio than TV so I have radio set in the prefs
file. I had done a forced --refresh previously (albeit only on radio)
and noted that many programs were added to the list so thought nothing
of it. As requested:

get_iplayer 3.13-ppa31d, Copyright (C) 2008-2010 Phil Lewis
  This program comes with ABSOLUTELY NO WARRANTY; for details use
--warranty.
  This is free software, and you are welcome to redistribute it under
certain
  conditions; use --conditions for details.


Matches:
44741:    The Hitchhiker's Guide to the Galaxy: Hexagonal Phase -
Episode 1, BBC Radio 4, b09th4hf
44742:    The Hitchhiker's Guide to the Galaxy: Hexagonal Phase -
Episode 2, BBC Radio 4, b09v734q
44743:    The Hitchhiker's Guide to the Galaxy: Hexagonal Phase -
Episode 3, BBC Radio 4, b09w16mn
INFO: 3 matching programmes

You'll see from an earlier response that the problem has now been
resolved with a full rebuild of the cache.

Regards

Clive