1198: More Podcast problems BUG#5013

[Owyn]

Btw. Where I can download the Bex's SQL Viewer, the link ( http://home.online.no/~kar-m-kr/SqlViewer.2.3.mmip.zip ) from http://www.mediamonkey.com/forum/viewto ... =2&t=24841 doesn't seem to work

I emailed you my copy of the MMIP.

[Owyn]

For each Podcast in error report:
- Edit Subsciption. Copy feed URL. Set Show Removed On.
- Unsubscribe keeping episodes.
- Remove any grayed out episodes from subscription
- Edit Subscription. Paste saved URL. Click OK to resubscribe.
- SQL Viewer: Re-run saved select. Confirm error episodes removed from query results.

Yes, I tried this and there are no issuses with this, isn't it?

Yep. Managed to get everything cleaned up as per previous post (everything at 599, no errors in Select).

Btw. if you unsubscribe keeping episodes (i.e. just '(o) Unsubscribe' selected) then there should not be any grayed out episodes, isn't it? So why I should 'Remove any grayed out episodes from subscription' in the next step if they are no? Which feed you tested? I could test the same feed directly on your DB. If you have an exact steps to reproduce, put it here. Thank you.

I have a lot of old episodes I hang onto. Many of them are no longer available from feeds. Did not want to delete them and have to recover from backups.

The 24 episodes from the SELECT are the ones which still appeared in the Subscription list after the Unsubscribe.

Re: the rescan:
If I understand correctly you are saying that Locations re-scan causes the episodes with idTrack > max( Songs.ID) to get back??

No. The task aborts after re-adding 54 of the approx 600 tracks to the library. I uploaded a directory listing of my Podcast folders to Mantis.

[Ludek]

I tested further on your DB and found a very strange thing:
AS for 'Genre equals "Podcast"': 579 files
FTS for "genre:podcast": 581 files

so I created following AS rules:
1. Genre doesn't equal 'Podcast'
1. Any text field contains 'Podcast'
and suspected that no files will be in results, BUT there are 3 files!
In addition all 3 files have genre = 'Podcast'

The 3 files are:
Title: 'Bush Picks Laser Background For Presidential Portrait' , Podcast: 'The Onion'
Title: '10-Year-Old Makes Plea To Interview Obama', Podcast: 'NPR: Story of the Day Podcast'
Title: 'Today in Music History: December 10, 2008', Podcast: 'Brian Ibbott'

I found out that genre ID for 'Podcast' genre should be 1165 and it seems that it is not for the 3 files. Strange, it looks like your DB is somehow corrupted.

[Ludek]

I have a lot of old episodes I hang onto. Many of them are no longer available from feeds. Did not want to delete them and have to recover from backups.

I understand, but they should be black and not grayed out after unsubscribing. Which feed you tested??

The 24 episodes from the SELECT are the ones which still appeared in the Subscription list after the Unsubscribe.

This implies that they should still be in DB.
No, I see something now!!!
When unsubscribing there is 'DELETE FROM PodcastEpisodes WHERE idPodcast = x AND idTrack < 0 ', BUT
there should rather be 'DELETE FROM PodcastEpisodes WHERE idPodcast = x AND ((idTrack < 0) OR NOT EXISTS (SELECT ID FROM Songs WHERE ID = idTrack ))) '

I will fix.

[Owyn]

I have a lot of old episodes I hang onto. Many of them are no longer available from feeds. Did not want to delete them and have to recover from backups.

I understand, but they should be black and not grayed out after unsubscribing. Which feed you tested??

That is, or has not been till now, a problem. The "real" tracks showed in black.

The 24 episodes from the SELECT are the ones which still appeared in the Subscription list after the Unsubscribe.

This implies that they should still be in DB.
No, I see something now!!!
When unsubscribing there is 'DELETE FROM PodcastEpisodes WHERE idPodcast = x AND idTrack < 0 ', BUT
there should rather be 'DELETE FROM PodcastEpisodes WHERE idPodcast = x AND ((idTrack < 0) OR NOT EXISTS (SELECT ID FROM Songs WHERE ID = idTrack ))) '

I will fix.

That will fix the problem of cleaning up junk IDTrack but still does not address the issue of how they got bad in the first place.

[Owyn]

The 3 files are:
Title: 'Bush Picks Laser Background For Presidential Portrait' , Podcast: 'The Onion'
Title: '10-Year-Old Makes Plea To Interview Obama', Podcast: 'NPR: Story of the Day Podcast'
Title: 'Today in Music History: December 10, 2008', Podcast: 'Brian Ibbott'

I found out that genre ID for 'Podcast' genre should be 1165 and it seems that it is not for the 3 files. Strange, it looks like your DB is somehow corrupted.

Those episodes are I think on the error list. No historical value to them. They would all normally be auto-deleted.

The Any Text Field search would also pick up tracks with "Podcast" in album, or other fields.

The issue of data base corruption raises a more serious issue. Database repair. Any suggestions?

[Owyn]

Ok. I
1) Backed up my database (again)
2) Removed all tracks from Location...Podcasts and ran DELETE FROM PodcastEpisodes
3) Verified FTS genre:podcast nothing left
4) Verified no rows left in PodcastEpisodes
5) Ran Update All (All Podcasts now set to Do Nothing(6))
6) Verified PodcastEpisodes now populated. Verified that all rows had IDTrack=-1 and Downloaded=0.
7) Deleted the Buzz Out Loud track via WE. It was the next one on the scan list for previous test.
8 ) Ran Re-scan for Computer...Podcasts. It prematurely stopped again. Error in debug log. No exception dialog from MM3.
9) Looked at PodcastEpisodes. IDTrack and Downloaded unchanged for all rows.

Psigh.

[Ludek]

Is it the 081212.1306 log? Where I can find 081212.1306 log, on our FTP or it is attached somewhere?

[Owyn]

Is it the 081212.1306 log? Where I can find 081212.1306 log, on our FTP or it is attached somewhere?

Uploaded to Mantis now. I was sure I had done it before.
http://www.ventismedia.com/mantis/view.php?id=5013

[Ludek]

The 3 files are:
Title: 'Bush Picks Laser Background For Presidential Portrait' , Podcast: 'The Onion'
Title: '10-Year-Old Makes Plea To Interview Obama', Podcast: 'NPR: Story of the Day Podcast'
Title: 'Today in Music History: December 10, 2008', Podcast: 'Brian Ibbott'

I found out that genre ID for 'Podcast' genre should be 1165 and it seems that it is not for the 3 files. Strange, it looks like your DB is somehow corrupted.

Those episodes are I think on the error list. No historical value to them. They would all normally be auto-deleted.

The Any Text Field search would also pick up tracks with "Podcast" in album, or other fields.

The issue of data base corruption raises a more serious issue. Database repair. Any suggestions?

I didn't check the script (SQL Viewer), but isn't it possible that the script damaged the 3 files, does it allow to edit values in DB? It seems that the 3 files had changed idSong, which would implied that another entry in GenresSongs table is used and therefore there is another (bad) idGenre used for these tracks.

[Owyn]

The log is from the previous test, but, same scenario.

[Owyn]

I took a look at Genre and GenreSong tables in my database.

Code: Select all

SELECT * FROM Genres WHERE GenreName LIKE  '%Podc%'

and

Code: Select all

SELECT * FROM Genres WHERE GenreName = 'Podcast'

Showed I had one entry in Genres. ID=1165, UsageCount=83

Code: Select all

SELECT * FROM GenresSongs WHERE IDGenre = 1165

Showed 83 rows but a quick scan showed a lot of junk IDSong

Code: Select all

SELECT * FROM GenresSongs WHERE IDGenre = 1165 AND IDSong NOT IN (SELECT ID FROM Songs)

Showed 36 rows and FTS genre:podcast had already shown 47 current valid tracks with Genre=Podcast.
36+47=83

So

Code: Select all

DELETE FROM GenresSongs WHERE IDGenre = 1165 AND IDSong NOT IN (SELECT ID FROM Songs)

Cleaned it up.

And

Code: Select all

SELECT * FROM Genres WHERE GenreName = 'Podcast'

Confirmed I had one entry in Genres. ID=1165, UsageCount=47

[Owyn]

Whoa!

Code: Select all

SELECT *  FROM GenresSongs WHERE IDSong NOT IN (SELECT ID FROM Songs)

Found 2336 rows.

Maybe time for a new database maintenance task.

[Ludek]

Owyn, your DB is definitely corrupted, but what could cause this corruption? Any script?? Btw. watching the log -> waht are the TmpADFFolder, TmpADFDupCont , TmpDelSugg1TSC, TmpDelSugg2TSC, ... tables??

[Owyn]

Temp tables. Maybe from Advanced Duplicate Find & Fix.
I can grep the script code to trace down source of all temp tables if needed.

See my sig for all installed scripts.