Yes, just select the files you want to export and export (File > Export to Playlist), repeat for other types as needed.

I notice there is an option to export all as a playlist. In my library I have both audio and video, is there a way to generate all for just audio and just video - 2 separate playlist files?

Ah thats great, thanks

Use Entire Library (enable under File > Manage Collections).

Is there a way to view the entire library? Like to show both Music and Video.

This way I can generate a report showing music and videos at the same time.