Upload stuck on a video file

[Andream98]

Hello everybody!

I am trying to import my Google Photos takeout to immich with immich-go and the process has been stuck on a single video (which is approximately 11MB large) for over an hour, here is a screenshot

Also I noticed that the queued jobs number keeps growing while no files are being imported

Is this normal?

Thanks in advance for the help

[simulot]

The log is written with the upload is done. I suspect a problem somewhere else when stacking the photos.
You can retry with the option -create-stacks=FALSE

The number of jobs increase as long the server find more job to do. Ex: discovering a new file, the creating 23 thumbnails, search the faces, etc.. This is normal. Check this #362 (comment)

[Andream98]

I launched immich-go again now but I waited for all immich running jobs to end

This time it looks like it finished by itself but the amount of uploaded files is significantly less than the total amount of input files:

Is this a normal thing or will there be files that are not uploaded?

[simulot]

Apparently you haven't processed all parts of the takeout at the same time... orphan files are not uploaded 2928 + 1719 duplicates in the input.

Could you test with the latest version? I have corrected some counters...

[Andream98]

I updated to v 0.20 and ran it again and the numbers look about the same:

Here is my takeout files list if it can be useful:

And this is the command I have been running:

./immich-go -server={my server} -key={my key} upload -create-albums -google-photos /mnt/c/Users/Andrea\ Martella/Downloads/takeout-*.zip

[simulot]

that isn't expected. Your archive seems to be massive. I can check your logs to search where are the missing files. Could you run the command with the '-debug-counters' option. This produce a CSV file with all files found in the archive and their fate in immich-go.
You can send me the log file and the csv file on my discord account @simulot for privacy.

[Andream98]

Is this your discord user?

[Andream98]

I tried out v0.20.1 and here are the numbers I get now

There seems to be roughly a 4 thousands files difference between uploaded files and input images/videos - discarded/unsupported/duplicates

Is this calculation accurate or should i count the uploaded files differently?

[simulot]

Coud you run the same command with following option:

./immich-go -server={my server} -key={my key} upload -debug-counters -create-albums -google-photos /mnt/c/Users/Andrea\ Martella/Downloads/takeout-*.zip

You'll get a log file and a CSV files.

Also could you give list of files contained into the takeout files:

for f in takeout-*.zip; do echo "$f: "; unzip -l $f; done >list.lst

and send all to my discord account?

Then I can simulate your case and understand why the counter are messy.

Thanks for your help 🙏🏼