1155: Download temporary files left behind

Owyn · Post by **Owyn** » Sun Apr 06, 2008 9:54 am

I use a small 2GB partition (F: on my system) for my paging file, temporary files (F:\Temporary Internet Files), and as a staging area for downloads from the Internet.

While adding a lot of subscriptions yesterday I got a low disk space on folder warning on F: followed by an error (1120 Out of space, I think) from MM.

I did some quick cleanups and got past the problem. Today I took a close look at my F: drive and found about 350MB of temporary MP3 files left over. No big, about time to run CCleaner anyway, and it got rid of the residue.

Also noticed I had some partial downloads left over due to the aforementioned problems. Managed to get another orphaned temp file.

Was able to reproduce the second problem by:
- Creating a zero length file with the expected path+name of an un-donloaded episode
- Downloading the episode

MM created a name[1] file and left the temp file behind.

Owyn · Post by **Owyn** » Mon Apr 07, 2008 11:55 am

Just checked temp files and I have managed to accumulate another 359MB in a day.

Biggest burden is episodes but feed info also being left behind.

Code: Select all

F:\>dir /s "Temporary Internet Files"
 Volume in drive F is TEMP
 Volume Serial Number is CCC1-F70D

 Directory of F:\Temporary Internet Files\Content.IE5

04/06/2008  04:50 PM           311,296 index.dat
               1 File(s)        311,296 bytes

 Directory of F:\Temporary Internet Files\Content.IE5\JDZ9FA26

04/07/2008  07:03 AM        42,673,842 Coverville-080406[1].m4a
04/07/2008  07:15 AM            34,154 HeartOfTheNightShow[1].xml
04/07/2008  07:15 AM           137,125 podcasting[1].xml
04/07/2008  07:16 AM            13,536 podcast[1].xml
04/07/2008  07:17 AM           102,498 podcast[2].xml
04/07/2008  07:17 AM            15,096 podcast[3].xml
04/07/2008  07:18 AM            42,420 podcast[4].xml
04/07/2008  07:24 AM         1,220,067 sa_d_podcast_080407[1].mp3
04/07/2008  07:24 AM            43,434 subterranea[1].xml
04/07/2008  07:24 AM            41,331 twit[1].xml
04/06/2008  11:22 AM        90,061,899 webcast-audPod-4_1_2008[1].mp4
              11 File(s)    134,385,402 bytes

 Directory of F:\Temporary Internet Files\Content.IE5\MF0UEA11

04/07/2008  07:15 AM            13,765 2325-11424_3-0[1].xml
04/07/2008  07:14 AM        20,351,050 CBCR2Beethoven2008_2008-04-07[1].mp3
04/07/2008  07:21 AM        69,051,565 CBCR330_2008-04-07[1].mp3
04/07/2008  07:14 AM         5,171,353 CBCR3Track_2008-04-07[1].mp3
04/07/2008  07:18 AM            47,862 NotLamePodcast[1].xml
04/07/2008  07:17 AM         3,189,532 npr_89422698[1].mp3
04/07/2008  07:16 AM            13,742 podcast[1].xml
04/06/2008  08:42 AM       116,772,031 Subterranea_2008-02-26[1].mp3
04/07/2008  07:15 AM            35,753 TransatlanticAcousticShow[1].xml
04/07/2008  07:23 AM            58,372 WarNewsRadio[1].xml
              10 File(s)    214,705,025 bytes

 Directory of F:\Temporary Internet Files\Content.IE5\U5HW1YCS

04/07/2008  07:18 AM           271,274 feed[1].xml
04/07/2008  07:17 AM           636,201 mattstodayinhistory[1].xml
04/07/2008  07:16 AM         3,348,775 npr_89423493[1].mp3
04/07/2008  07:17 AM            13,354 podcast[2].xml
04/07/2008  07:15 AM            40,152 r330[1].xml
04/07/2008  07:23 AM            86,015 radiolab[1].xml
04/07/2008  07:15 AM            32,070 rss[1].xml
04/07/2008  07:15 AM             3,872 rss[2].xml
04/07/2008  07:23 AM             3,319 SV[1].xml
               9 File(s)      4,435,032 bytes

 Directory of F:\Temporary Internet Files\Content.IE5\UOFOKLHU

04/07/2008  07:14 AM           209,934 CelticFolkPodcast[1].xml
04/07/2008  07:23 AM             4,354 CR[1].xml
04/07/2008  07:17 AM            53,615 doctorow_podcast[1].xml
04/07/2008  07:23 AM           149,549 feed[1].xml
04/07/2008  07:14 AM           249,379 irish[1].xml
04/07/2008  07:17 AM         4,174,452 npr_89423519[1].mp3
04/07/2008  07:15 AM            70,728 podcast[1]
04/07/2008  07:16 AM           170,122 podcast[1].xml
04/07/2008  07:22 AM           361,776 roadhouse[1].xml
04/07/2008  07:23 AM            22,032 RootsRockRadio[1].xml
04/07/2008  07:23 AM            70,997 sciam_podcast_i_d[1].xml
04/07/2008  07:18 AM           236,450 ThePopularMechanicsShow[1].xml
              12 File(s)      5,773,388 bytes

     Total Files Listed:
              43 File(s)    359,610,143 bytes
               0 Dir(s)     690,798,592 bytes free

Time to run CCleaner again.

Owyn · Post by **Owyn** » Mon Apr 07, 2008 12:10 pm

Cleaned

Code: Select all

F:\>dir /s "Temporary Internet Files"
 Volume in drive F is TEMP
 Volume Serial Number is CCC1-F70D

 Directory of F:\Temporary Internet Files\Content.IE5

04/07/2008  01:06 PM           311,296 index.dat
               1 File(s)        311,296 bytes

     Total Files Listed:
               1 File(s)        311,296 bytes
               0 Dir(s)   1,050,157,056 bytes free

Teknojnky · Post by **Teknojnky** » Mon Apr 07, 2008 2:31 pm

As far as I know, the IE temporary internet files are managed by IE, not MM.

I would not expect MM to clear this, and if it did I would consider it a bad idea.

Owyn · Post by **Owyn** » Mon Apr 07, 2008 2:42 pm

Teknojnky wrote:As far as I know, the IE temporary internet files are managed by IE, not MM.

I would not expect MM to clear this, and if it did I would consider it a bad idea.

I think it is a MM issue. Podcast episode downloads appears to be a 4 step process.

1)Download episode from feed item url to temp
2)When download complete apply podcast tagging rules to episode.
3)Move episode from temp to location specified by downloads destination mask
4)Queue new episode for add of tag info to library database

Teknojnky · Post by **Teknojnky** » Mon Apr 07, 2008 2:58 pm

I would expect MM to use the temp folder specified in the options, and if it doesn't, I would consider that the bug.

And I agree that MM should clean up its own temp files, in the folder specified. But it shouldn't be using temporary internet files cache (although I suppose that could be a by-product of using IE to download the podcasts/xml).

Ludek · Post by **Ludek** » Tue Apr 08, 2008 1:45 am

Thx for reporting this. It is a by-product of using IE to download the podcasts/xml, but we can disable the caching. I guess we will.

Owyn · Post by **Owyn** » Tue Apr 08, 2008 4:07 am

Ludek wrote:Thx for reporting this. It is a by-product of using IE to download the podcasts/xml, but we can disable the caching. I guess we will.

Tx. FYI I have IE7 installed on this system but almost never use it. Basically only there for sites which won't work in FF2.

PS: Did I get the process flow correct for episode downloads?

Podcast episode downloads appears to be a 4 step process.

1)Download episode from feed item url to temp
2)When download complete apply podcast tagging rules to episode.
3)Move episode from temp to location specified by downloads destination mask
4)Queue new episode for add of tag info to library database

Reason I am asking is that is part of MM podcast notes I have been building up for posting to Wiki. Like to have them correct.

Owyn · Post by **Owyn** » Tue Apr 08, 2008 7:18 pm

Found another part of the puzzle.

Some of the temp cleanup is delayed until MM3 exits.

Previous testing had MM3 running continuously.

Today I was working on MediaMonkey.ini changes, which require restarts of MM3, and when I checked on temp later I saw that files which had persisted were now gone.

Teknojnky · Post by **Teknojnky** » Tue Apr 08, 2008 7:55 pm

Also, may or may not be relevant, but you can adjust the amount of cache alotted for temporary internet files, in the IE options/control panel.

Owyn · Post by **Owyn** » Wed Apr 09, 2008 5:48 am

Teknojnky wrote:Also, may or may not be relevant, but you can adjust the amount of cache alotted for temporary internet files, in the IE options/control panel.

This appears to have no impact on MM3. I had this set to 40MB, and, have now bumped it to 200MB. Looks like the option only applies to IE directly.

Ludek · Post by **Ludek** » Thu Apr 10, 2008 1:25 am

The IE caching that bothers you is disabled in build 1156.
i.e. MM is no longer caching to the location. You can check over in the build or higher once is available.

Owyn · Post by **Owyn** » Thu Apr 10, 2008 1:39 am

Ludek wrote:The IE caching that bothers you is disabled in build 1156.
i.e. MM is no longer caching to the location. You can check over in the build or higher once is available.

Thanks. Will test when available.

I assume a consequence of this is that failed downloads will no longer resume / recover partial download.

The problem is at it's worst during initial adds of a lot of subscriptions (which is what I was doing when the problems started). I was initially concerned about potentially large amounts of disk space being consumed by persistent temp files. I was less concerned later when I discovered a lot of files only persisted as long as MM3 was running.

Owyn · Post by **Owyn** » Mon Apr 14, 2008 11:31 pm

Tested in 1159. Fixed.