Restore docs refer to tags.json but backup only contains manifest.json

[JasonSanDiego]

My backup only contained manifest.json. Is that the same as tags.json, which the docs refer to on restoring into a docker instance.

[JasonSanDiego]

When following the docs to restore using this manifest.json file, I got this series of errors. I have not yet put my docs into the consume folder - the next step in the restore process - but this doesn't exactly inspire confidence that all of my important docs are going to survive this restore.

I actually have a running instance of Paperless on another machine that I'm trying to migrate, so please let me know if there is something I need to do differently in the backup process.

Renaming of document 28 failed as file 0000028.pdf.gpg was no longer present
File of document 29 has gone and could not be recovered
File of document 29 has gone and could not be recovered
Renaming of document 29 failed as file 0000029.pdf.gpg was no longer present
File of document 29 has gone and could not be recovered
File of document 29 has gone and could not be recovered
Renaming of document 29 failed as file 0000029.pdf.gpg was no longer present
File of document 29 has gone and could not be recovered
File of document 29 has gone and could not be recovered
Renaming of document 29 failed as file 0000029.pdf.gpg was no longer present
File of document 30 has gone and could not be recovered
File of document 30 has gone and could not be recovered
Renaming of document 30 failed as file 0000030.pdf.gpg was no longer present
File of document 30 has gone and could not be recovered
File of document 30 has gone and could not be recovered
Renaming of document 30 failed as file 0000030.pdf.gpg was no longer present
File of document 30 has gone and could not be recovered
File of document 30 has gone and could not be recovered
Renaming of document 30 failed as file 0000030.pdf.gpg was no longer present
File of document 31 has gone and could not be recovered
File of document 31 has gone and could not be recovered
Renaming of document 31 failed as file 0000031.pdf.gpg was no longer present
File of document 31 has gone and could not be recovered
File of document 31 has gone and could not be recovered
Renaming of document 31 failed as file 0000031.pdf.gpg was no longer present
File of document 31 has gone and could not be recovered
File of document 31 has gone and could not be recovered
Renaming of document 31 failed as file 0000031.pdf.gpg was no longer present
File of document 577 has gone and could not be recovered
File of document 577 has gone and could not be recovered
Renaming of document 577 failed as file 0000577.pdf.gpg was no longer present
File of document 577 has gone and could not be recovered
File of document 577 has gone and could not be recovered
Renaming of document 577 failed as file 0000577.pdf.gpg was no longer present
File of document 577 has gone and could not be recovered
File of document 577 has gone and could not be recovered
Renaming of document 577 failed as file 0000577.pdf.gpg was no longer present
File of document 570 has gone and could not be recovered
File of document 570 has gone and could not be recovered
Renaming of document 570 failed as file 0000570.pdf.gpg was no longer present
File of document 570 has gone and could not be recovered
File of document 570 has gone and could not be recovered
Renaming of document 570 failed as file 0000570.pdf.gpg was no longer present
File of document 570 has gone and could not be recovered
File of document 570 has gone and could not be recovered
Renaming of document 570 failed as file 0000570.pdf.gpg was no longer present
Installed 1025 object(s) from 1 fixture(s)

[JasonSanDiego]

I powered ahead with the restore, and it didn’t go well. I ended up with twice the number of files as I originally did. It seems all the thumbnail files were imported as well. I deleted those in batches 100 at a time using search and delete. That left me with just documents named like my original ones, and all tagged properly, but they are all broken: missing thumbnails, and clicking them leads to an error about a missing .gpg file.

What am I missing about backup & restore here?

[clinis]

I had the same problem as you.

I assumed that tags.json = manifest.json and renamed the file manually and then proceeded with the process.

It seems the Restore process imports the documents metadata to the database and then goes to consume the files. It detects the originals as duplicated and skips them (probably good), but tries to process the thumbnails as new documents. In the end, the correctly imported documents don't have thumbnail.

I have tried booth the Restore process (as you did here) and the Import process (here is my issue). Neither worked. In the end there is always the error of missing .gpg files

[Tooa]

I already made a pull request to fix the documentation issue (here). The Importer and Exporter should work for the backup and restore process from my understanding.

[JasonSanDiego]

Thanks. I didn’t notice that tucked away in the utilities section of the docs. I followed those import instructions and got a very long list of messages like this:

File of document 27 has gone and could not be recovered
File of document 28 has gone and could not be recovered
File of document 29 has gone and could not be recovered
File of document 30 has gone and could not be recovered
...

But, the docs did seem to import - thumbnails appear, I can download, and the count matches my original source instance. Is the message nothing to be concerned about?

If so, I might suggest some better messaging there to make it clear all is working properly in the import.