There is a new revision with added progress bar and corrected some SQL queries and values which are reported. I created the new thread for it at http://www.mediamonkey.com/forum/viewtopic.php?f=2&t=38683.

You are very nice person, thanks for kind words. I'll try to do my best and to deserve your trust in me :)

I think Stats will be in very good hands.
Go on, ZvezdanD!

I wouldn't mind seeing some of the MN stats because I do use some of them, it would be really nice to consolidate alot of these especially if it is possible for the user to customize the ones that are relevant to him/her.

Nyn

[quote="nynaevelan"]would it be possible to have certain features turned on or off?? For instance the Ratings section are irrelevant to me [/quote]
Yes, I already though about that. I have also a plan to add some more statistics, for example all those from Magic Nodes' the Last 20... and Top 20... groups (e.g. the existing Top 10 Artists are sorted by the number of tracks and I want to add top 10 artists sorted by ratings).

Zvezdand:

If you are going to continue development on this and if it is possible to ask for features.... would it be possible to have certain features turned on or off?? For instance the Ratings section are irrelevant to me as well as the Top Artists, Albums and Genres. I only care about the Totals, Averages and Top Played sections. If not, do not worry about it, I can continue to ignore them, if so, that would be a nice feature.

Nyn

[quote="ZvezdanD"][quote="Ludek"]I believe that some of the points should be fixed before releasing MM 3.1 (e.g. items 2 & 3)[/quote]
I already planed to add all mentioned suggestions, at least a support for (real) Artist, Composer, Conductor... As I said, it could be easily resolved and almost trivial. I have also some another plans with it, e.g. to add the progress bar with a possibility to terminate its execution, the timer for indication of the elapsed time, detection of changed filter in program... Should I continue or you want to do it by yourself? Where/how I could download your modified version of the script that is not included with the program?[/quote]

For now (because MM 3.1 is in RC state and localization is closed) I am going to fix only item #2 (see: http://www.ventismedia.com/mantis/view.php?id=5489 )

The other items and any other improvements will be included in a later version (probably MM 4.0).
So fill free to improve the script yourself and then you can send it us to include it (in order to be native and bundled with MM install package) if you want.

Ok: Just to confuse everyone a little more I am going to throw in my observations...

In the Top 10 ** Played sections, the heading of "Tracks" is very misleading, it leads the user to assume it is a count of tracks not of the actual plays, so I have changed my sections (in Zvezdand's version) to have a heading of Plays instead of Tracks.

Nyn

[quote="Ludek"]I believe that some of the points should be fixed before releasing MM 3.1 (e.g. items 2 & 3)[/quote]
I already planed to add all mentioned suggestions, at least a support for (real) Artist, Composer, Conductor... As I said, it could be easily resolved and almost trivial. I have also some another plans with it, e.g. to add the progress bar with a possibility to terminate its execution, the timer for indication of the elapsed time, detection of changed filter in program... Should I continue or you want to do it by yourself? Where/how I could download your modified version of the script that is not included with the program?

Indeed you're right about it actually being updated since the time frame I gave, as now that you mention it, I seem to also recall a Bug Entry or Post on here discussing an improved Time or Size formula. So yeah, I admit to speaking wrongly about that, but the notation in the script was freshest in my mind, which only indicates it's coding between December 2004 & January 2005 and not any updates.

I think #2 is definitely a must to fix asap, because while it's fixable by experienced scripters (or people who like to toy around with things like me), the average user probably wouldn't have a clue on where to start. They're sure to scratch there head though if they look in the "Artists" section to see composers, conductors, etc since each of these are entered into separate fields in the properties. Again, that plays into the average user thing, because not everyone opens up the database and is thus aware that all of these fields are stored into one table.

Wow, it was late four hours ago... *goes away*... *for real this time*

You seem to be right.

In M 3.0 we have optimized performance of the queries in the stats.vbs, see:
http://www.ventismedia.com/mantis/view.php?id=4431

But as you indicated we should also try to improve the script somehow or at least fix the issue with PersonType which really looks like bug now.
So I have opened another issue:
http://www.ventismedia.com/mantis/view.php?id=5489
for this purpose.
I believe that some of the points should be fixed before releasing MM 3.1 (e.g. items 2 & 3)

  'Totals
  strSQL = "SELECT Count(*) AS Nombre FROM Artists WHERE ID <> 0 AND Tracks>0"     ' Track artists only
  Set qryStats = SDB.Database.OpenSQL(strSQL)
  intArtistsCount = CLng(NoNull(qryStats.ValueByName("Nombre"),0))
  
  ' process background threads
  SDB.ProcessMessages

  strSQL = "SELECT Count(Distinct Artists.ID) AS CountOfID FROM Artists WHERE Artists.ID IN ( SELECT ArtistsSongs.IDArtist FROM ArtistsSongs WHERE ArtistsSongs.IDSong IN ( SELECT Played.IDSong FROM Played))"
  Set qryStats = SDB.Database.OpenSQL(strSQL)
  intArtistsCountPlayed = CLng(NoNull(qryStats.ValueByName("CountOfID"),0))

  'Totals
  strSQL = "SELECT Count(*) AS Nombre FROM Artists WHERE ID <> 0 AND Tracks>0"     ' Track artists only
  Set qryStats = SDB.Database.OpenSQL(strSQL)
  intArtistsCount = CLng(NoNull(qryStats.ValueByName("Nombre"),0))
  
  ' process background threads
  SDB.ProcessMessages

  strSQL = "SELECT Count(Distinct Artists.ID) AS CountOfID FROM Artists WHERE Artists.ID IN ( SELECT ArtistsSongs.IDArtist FROM ArtistsSongs WHERE ArtistsSongs.IDSong IN ( SELECT Played.IDSong FROM Played) AND PersonType=1)"
  Set qryStats = SDB.Database.OpenSQL(strSQL)
  intArtistsCountPlayed = CLng(NoNull(qryStats.ValueByName("CountOfID"),0))

  strSQL = "SELECT Sum(PlayCounter) AS CountOfID, Sum(SongLength) AS TotalLength, Sum(FileLength) AS TotalFileLength, Artists.Artist "
  strSQL = strSQL &  "FROM ArtistsSongs, Songs, Artists "
  strSQL = strSQL &  "WHERE Songs.ID = ArtistsSongs.IDSong AND Songs.ID IN (SELECT Played.IDSong FROM Played) AND ArtistsSongs.IDArtist = Artists.ID "
  strSQL = strSQL &  "GROUP BY ArtistsSongs.IDArtist "
  strSQL = strSQL &  "ORDER BY Sum(PlayCounter) DESC LIMIT " & intTopCount & "" 

  Set qryStats = SDB.Database.OpenSQL(strSQL)
  While Not qryStats.EOF

  strSQL = "SELECT Sum(PlayCounter) AS CountOfID, Sum(SongLength) AS TotalLength, Sum(FileLength) AS TotalFileLength, Artists.Artist "
  strSQL = strSQL &  "FROM ArtistsSongs, Songs, Artists "
  strSQL = strSQL &  "WHERE Songs.ID = ArtistsSongs.IDSong AND Songs.ID IN (SELECT Played.IDSong FROM Played) AND ArtistsSongs.IDArtist = Artists.ID AND ArtistsSongs.PersonType=1 "
  strSQL = strSQL &  "GROUP BY ArtistsSongs.IDArtist "
  strSQL = strSQL &  "ORDER BY Sum(PlayCounter) DESC LIMIT " & intTopCount & "" 

  Set qryStats = SDB.Database.OpenSQL(strSQL)
  While Not qryStats.EOF

I got a little bored and did some digging around.

[code] 'Totals
strSQL = "SELECT Count(*) AS Nombre FROM Artists WHERE ID <> 0 AND Tracks>0" ' Track artists only
Set qryStats = SDB.Database.OpenSQL(strSQL)
intArtistsCount = CLng(NoNull(qryStats.ValueByName("Nombre"),0))

' process background threads
SDB.ProcessMessages

strSQL = "SELECT Count(Distinct Artists.ID) AS CountOfID FROM Artists WHERE Artists.ID IN ( SELECT ArtistsSongs.IDArtist FROM ArtistsSongs WHERE ArtistsSongs.IDSong IN ( SELECT Played.IDSong FROM Played))"
Set qryStats = SDB.Database.OpenSQL(strSQL)
intArtistsCountPlayed = CLng(NoNull(qryStats.ValueByName("CountOfID"),0))[/code]

There's the code snippet from the original file. Looking at the SQL that finds the number of Artists in the library, it bases it off of the Artists.Tracks column, which a Person only has a number <> 0 in this column if they are an Artist for a track and not just a conductor or composer, etc (since they have their own columns). Thus, while it's only counting artists, the other that pulls the played one is pulling any person that has an entry in the Played table, regardless if they're a Artist, Conductor, etc. Toying with it, I got this to work as expected:

[code] 'Totals
strSQL = "SELECT Count(*) AS Nombre FROM Artists WHERE ID <> 0 AND Tracks>0" ' Track artists only
Set qryStats = SDB.Database.OpenSQL(strSQL)
intArtistsCount = CLng(NoNull(qryStats.ValueByName("Nombre"),0))

' process background threads
SDB.ProcessMessages

strSQL = "SELECT Count(Distinct Artists.ID) AS CountOfID FROM Artists WHERE Artists.ID IN ( SELECT ArtistsSongs.IDArtist FROM ArtistsSongs WHERE ArtistsSongs.IDSong IN ( SELECT Played.IDSong FROM Played) AND PersonType=1)"
Set qryStats = SDB.Database.OpenSQL(strSQL)
intArtistsCountPlayed = CLng(NoNull(qryStats.ValueByName("CountOfID"),0))[/code]

As you can see, I've added a "PersonType" clause to the Played SQL, which only accounts for people that are Artists (or I believe, Album Artists), which gives me a number that matches the one from the Library query. It seems the "Top Artists" problem can be fixed with a "PersonType" clause too:

Original:
[code] strSQL = "SELECT Sum(PlayCounter) AS CountOfID, Sum(SongLength) AS TotalLength, Sum(FileLength) AS TotalFileLength, Artists.Artist "
strSQL = strSQL & "FROM ArtistsSongs, Songs, Artists "
strSQL = strSQL & "WHERE Songs.ID = ArtistsSongs.IDSong AND Songs.ID IN (SELECT Played.IDSong FROM Played) AND ArtistsSongs.IDArtist = Artists.ID "
strSQL = strSQL & "GROUP BY ArtistsSongs.IDArtist "
strSQL = strSQL & "ORDER BY Sum(PlayCounter) DESC LIMIT " & intTopCount & ""

Set qryStats = SDB.Database.OpenSQL(strSQL)
While Not qryStats.EOF
[/code]

Edit:
[code] strSQL = "SELECT Sum(PlayCounter) AS CountOfID, Sum(SongLength) AS TotalLength, Sum(FileLength) AS TotalFileLength, Artists.Artist "
strSQL = strSQL & "FROM ArtistsSongs, Songs, Artists "
strSQL = strSQL & "WHERE Songs.ID = ArtistsSongs.IDSong AND Songs.ID IN (SELECT Played.IDSong FROM Played) AND ArtistsSongs.IDArtist = Artists.ID AND ArtistsSongs.PersonType=1 "
strSQL = strSQL & "GROUP BY ArtistsSongs.IDArtist "
strSQL = strSQL & "ORDER BY Sum(PlayCounter) DESC LIMIT " & intTopCount & ""

Set qryStats = SDB.Database.OpenSQL(strSQL)
While Not qryStats.EOF
[/code]

Again, this returns expected results for me, the "Top # Artists" section now only lists Artists, so I no longer have a Top 10 where half of the entries are producers who rarely if ever appear in the Artist field. I went ahead and set up a Top 10 for my producers too, since I have them stored in the Conductor field (yeah, I know... odd place, but it works for me), with a "PersonType=4" in place of "PersonType=1", woo, go me! :P

That's really only the beginning of the problems, I think, because in running the script over and over, I began to look closer at other numbers. Some of their purposes make no sense to me at all, or aren't acting as they should be expected to. Take for instance the "Top # Genre" columns. The regular "Top # Genre" and "Top # Genre played" entries are exactly the same. With 33,534 entries in my Played table and a tendency to play my Rap files more than my others, I know Rap should show more than being played 10,003 times when, you guessed it, I have 10,003 Rap files in my Genre, all of which have been played once, and some of which have been played upwards of 30 or 40 times. This Played entry doesn't act like the Artist played entry, which isn't really expected. My Top Artist only has 722 tracks in the library, but in the played entry, shows 3,709 plays, which if it acted like the Genre entry (which I don't think it should), it would only be showing 722 plays.

Another thing I find odd is the Averages section. Since I've played each track in my library once, the Average & Average Played columns show identical information, the only thing different is the "Played Per Day" entry for obvious reasons. Not really sure what this section was going for, but I would expect Played Averages to fluctuate with what I listen to, not to become static once I've played everything once, because then it's no longer relevant information because I could then just look at the Library entry. If my Year average is 1996, I would expect that if I play everything once, then the played Year Average would be 1996, but if I go playing a lot of 2008 files, then I would expect my continued listening to have some kind of impact, such as the average sliding more-so toward what I listen to most (since the older files would have one play each, while the newer ones would have more plays and thus would be closer to the average that I listen to)

After all, if I play two files, one from 1990 and one from 2008 each one time, the average would be 1999. If I then play that second file again, then the average of what I have played would actually be 2002, no? Not still 1999. It's late, so if my math is way off... oops.

Though, it's late, and I've been staring at VBScript coding for a while now (something I barely understand, and that would be stretching it), so maybe my mind has went off into loopy-land and I'm making no sense as everything is viewed as working perfectly fine to the rest of you. *shrugs*

PS -- Rating is the exact same way as Genre down in the Top # sections.

EDIT: I told you it was late, right? Cause I just realized that I had been messing with the Stats script that comes with Monkey, not your modified version. Haha. Though, I doubt you changed much in regards to what I pointed out, since your script when unfiltered presents the same results as the MM Bundled Version.

Totals 
Type      Library    Played
Artists    2928       4103
Albums      812        812
Genres        7          7
Years        26         26
Playlists     8          8 

[quote="ZvezdanD"]but I don't know what you mean with the Played column for Albums.[/quote]
[code]Totals
Type Library Played
Artists 2928 4103
Albums 812 812
Genres 7 7
Years 26 26
Playlists 8 8
[/code]
As you can see, it first gives you a total of said item, such as I have 7 Genres in my library, then in the second column it shows you how many of them have been played. Every track in my library has been played at least once, thus it shows that all 7 genres have been played. However, as you can see, there's a difference between the total number of Artists, and the number that have been played. I've yet to figure out why these numbers are different. I guess it might have something to do with it showing Conductors and such in the Top Artists section, maybe one of those two columns only counts "Artists" and the other counts "People" (Artists + Conductors, Composers, etc.). Not really sure.

[quote="nynaevelan"]There were a couple of filters that did not complete quickly but they never finish quickly even when I use them in nodes, they are the songs in playlist/songs not in playlist filters.[/quote]
Yeah, I noticed this as well and tried to see if I could do something about it, but now I need to go to sleep, here is 2:40 AM in my time zone ;)

I will try to implement all your suggestions.

[quote="ZvezdanD"]OK, here is what you could try. Replace the line 643:
[code] strSQL = strSQL & " AND" & sMMFilter & ")) AND" & sMMFilter[/code]
with the:
[code] strSQL = strSQL & ")) AND" & sMMFilter[/code]

It would be much faster.[/quote]

Z:

This increased the speed tremendously, now it is just as quick or quicker with some filters. :D I need one more thing than I will be content. Can you make an installation package with the two fixes included and Gege's script.ini info?? While I will be using this rather than the original one which comes with MM, I would rather not have it have the same name to avoid it being overwritten everytime I update MM. And as a beta tester, I update alot.

There were a couple of filters that did not complete quickly but they never finish quickly even when I use them in nodes, they are the songs in playlist/songs not in playlist filters. If you release this publicly you might want to warn users that if they have filters that normally take a significant amount of time to complete, expect the same thing with the statistics report.

[color=#4000BF]THANK YOU FOR THIS SCRIPT AND FOR YOUR QUICK RESPONSE TO MY/GEGE'S REQUEST.[/color]

Nyn