Yes, you will need to create the empty database first.
Do a fresh installation to the new server.
upload everything except the connections folder. This should prompt you to run the install wizard enter database connection details, and create the new tables in the database.
after that you can export the pcms2_contents and pcms2_history tables from the old site and import them to the new site.