Summarize:

Once you are finished transferring, you can disconnect your PSP and turn off USB mode. You'll be able to find all of your music in the "Memory Stick" section of the Music menu. If you copied folders, you'll be able to open them to find the tracks inside.
Play your copied music.