1198: More Podcast problems BUG#5013

[Owyn]

Will do Ludek.
PM me the email you want it sent to.

[Owyn]

I created a zip backup of MM.DB as of now.
I will be updating to 1202 shortly and am considering a cleanup / rebuild after the update.

Specifically:
1) Tools->Options->Podcasts:Check for new Updates=Manually (Done)
2) Via SQL Viewer: DELETE FROM PodcastEpisodes
3) Via Location Node, Podcasts, All: Remove all tracks from Library Only
4) Run Update All
5) Rescan Podcasts
6) Re-remove old episodes from selected subscriptions

Comments about:
- Validity of process
- Whether to hold off on cleanup to assist in testing

Thanks, Owyn

[Owyn]

Did some less drastic cleanups and crosschecks.

1)Installed 1202. Must have forgot to commit Update Frequency change. Lots of pending episodes downloaded. Reran SQL check after Update All finished. Same 24 rows. Did quick check on New Podcasts Auto Playlist. Looks ok.

2)Cross checked FTS->genre:podcast to AS->Genre=podcast. One discrepancy, the Artie Shaw track showed up in AS. Rescanned Artie Shaw folder. Fixed discrepancy.

3)Cross checked FTS->genre:podcast to Location...Podcasts folders(All). Some historical, genre!=podcast, tracks in folders. Moved non podcast tracks to other location. Also had one episode track with a blank genre, DIIK. Fixed genre. Discrepancy fixed.

4)Cross checked genre:podcast to Podcast Subscriptions. Looks like Podcast node is missing the tracks which show in the SQl querry. Working on cleaning that up now. Planning to unsubcribe resubscribe mixed up subscriptions. Later.

[Owyn]

Well that got interesting.
Cleaned up NPR Story of the Day.

1)Unsubscribed keeping episodes. Left with Artie Shaw, 4 error episodes, and 1 valid new episode.

2)Removed "Artie Shaw" episode from Library only. Rescanned "Artie Shaw" folder to restore it to Music tracks.

3)Removed 4 error (grayed out) episodes

4)Resubscribed. Looks good now.

5)Reran id error querry. Down to 20 rows.

Psigh. Process works, just a bit time consuming.

Objective of this is to clean out all known discrepancies as of 1202 and monitor for any new problems.

[Owyn]

Finished cleanup from error report.
Now have FTS = AS = Location = 599 tracks.
However, Podcast Subscriptions node shows 571 files.

Darned if I can remember what causes that.

[Ludek]

Owyn, I am just testing on your DB and have no issues so far.

I downloaded 2 episodes from the 'NPR: All Songs Considered Podcast' and both are correctly downloaded and always shown as black (playable from local drive) in the subscription and also appears in the 'Podcast Subscriptions' node.

The only difference is that 'Podcast Subscriptions' node shows 552 files, advanced searching for Genre [x] Podcast shows 581, but I guess that this could be caused by the fact that you unsubscribed some podcasts without '(o) Unsubscribe and delete episodes' having checked in the past, could not this be the cause? In the other hand they should appear in the 'gray' subscriptions, but if e.g. the episode name already exists in the subscription then it is not added in order to prevent from duplicates.

[Owyn]

Ludek:
Things are getting really confused at the moment. I have 10 new errors from the SELECT.

Two questions:
1) Did you see the same SELECT errors?
2) Any comments on the proposed more brutal cleanup procedure?
http://www.mediamonkey.com/forum/viewto ... 15#p179157

[Ludek]

Owyn, if you would like to validate the process,
the cleanup that should work is:

1) Backup your DB
2) DELETE FROM PodcastEpisodes
3) Remove all tracks with genre 'Podcast' from Library Only
4) Run Update All and see if everything works

this could be easier to find the clue if there will be less podcasts episodes than 500.

Re:

Finished cleanup from error report.
Now have FTS = AS = Location = 599 tracks.
However, Podcast Subscriptions node shows 571 files.

Which cleanup you used? Could you describe the steps?

Btw. I found a clue, if a track is deleted from library then the idTrack in PocdastEpisodes table doesn't seem to be updated, this might be the reason why there are some rows fo the query
"SELECT * FROM PodcastEpisodes WHERE IDTrack > (SELECT MAX(ID) FROM Songs)"

I will investigate.

[Owyn]

For each Podcast in error report:
- Edit Subsciption. Copy feed URL. Set Show Removed On.
- Unsubscribe keeping episodes.
- Remove any grayed out episodes from subscription
- Edit Subscription. Paste saved URL. Click OK to resubscribe.
- SQL Viewer: Re-run saved select. Confirm error episodes removed from query results.

Setting up now to test mass cleanup procedure. Expect that new episode count will be low on first pass due to dead subscriptions. Re-scan of podcasts folder via Location should add them back.

[Owyn]

Checked counts before rebuild.

FTS = Location = 590 tracks
AS = 580

Difference (10) is number of error tracks from SELECT.

[Owyn]

I terminated the Update All tasks. Started downloading newest episode for all podcasts. Would have been lots of duplicates.

Going to do a Delete From again, then Locations re-scan, and then Update All.

[Owyn]

Aaargh. Re-scan aborted (Reproducable). Got debug log second time. Looking at it now. Will upload to Mantis.

[Owyn]

Uploaded.
Note: I am testing with Standard (Not Gold). Might make a difference.

[Ludek]

For each Podcast in error report:
- Edit Subsciption. Copy feed URL. Set Show Removed On.
- Unsubscribe keeping episodes.
- Remove any grayed out episodes from subscription
- Edit Subscription. Paste saved URL. Click OK to resubscribe.
- SQL Viewer: Re-run saved select. Confirm error episodes removed from query results.

Yes, I tried this and there are no issuses with this, isn't it?

Btw. if you unsubscribe keeping episodes (i.e. just '(o) Unsubscribe' selected) then there should not be any grayed out episodes, isn't it? So why I should 'Remove any grayed out episodes from subscription' in the next step if they are no? Which feed you tested? I could test the same feed directly on your DB. If you have an exact steps to reproduce, put it here. Thank you.

Re: the rescan:
If I understand correctly you are saying that Locations re-scan causes the episodes with idTrack > max( Songs.ID) to get back??

[Ludek]

Btw. Where I can download the Bex's SQL Viewer, the link ( http://home.online.no/~kar-m-kr/SqlViewer.2.3.mmip.zip ) from http://www.mediamonkey.com/forum/viewto ... =2&t=24841 doesn't seem to work