-
The bugImmich claims that it can't access the file (this seems to be the case for all the files that I tested from the external library)
however, when I log in to immich's shell, the file is found and the permissions look accessible The OS that Immich Server is running onLinux cf8d6f9c93d1 6.1.0-17-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.69-1 (2023-12-30) x86_64 GNU/Linux Version of Immich Serverv1.94.1 Version of Immich Mobile Appn/a Platform with the issue
Your docker-compose.yml contentversion: "3.3"
services:
immich-server:
container_name: immich_server
image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release}
command: [ "start.sh", "immich" ]
volumes:
- ${UPLOAD_LOCATION}:/usr/src/app/upload
- /mnt/nas/public/wspolne/Fotografie:/mnt/media/Fotografie:ro
env_file:
- .env
ports:
- 2283:3001
depends_on:
- redis
- database
restart: always
immich-microservices:
container_name: immich_microservices
image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release}
command: [ "start.sh", "microservices" ]
volumes:
- ${UPLOAD_LOCATION}:/usr/src/app/upload
- /mnt/nas/public/wspolne/Fotografie:/mnt/media/Fotografie:ro
env_file:
- .env
depends_on:
- redis
- database
restart: always
immich-machine-learning:
container_name: immich_machine_learning
image: ghcr.io/immich-app/immich-machine-learning:${IMMICH_VERSION:-release}
volumes:
- model-cache:/cache
env_file:
- .env
restart: always
redis:
container_name: immich_redis
image: redis:6.2-alpine@sha256:70a7a5b641117670beae0d80658430853896b5ef269ccf00d1827427e3263fa3
restart: always
database:
container_name: immich_postgres
image: tensorchord/pgvecto-rs:pg14-v0.1.11
env_file:
- .env
environment:
POSTGRES_PASSWORD: ${DB_PASSWORD}
POSTGRES_USER: ${DB_USERNAME}
POSTGRES_DB: ${DB_DATABASE_NAME}
PG_DATA: /var/lib/postgresql/data
volumes:
- pgdata:/var/lib/postgresql/data
restart: always
backup:
container_name: immich_db_dumper
image: prodrigestivill/postgres-backup-local
env_file:
- .env
environment:
POSTGRES_HOST: database
POSTGRES_DB: ${DB_DATABASE_NAME}
POSTGRES_USER: ${DB_USERNAME}
POSTGRES_PASSWORD: ${DB_PASSWORD}
SCHEDULE: "@daily"
BACKUP_NUM_KEEP: 2
BACKUP_DIR: /db_dumps
volumes:
- /mnt/newhome/unprivileged-docker/immich/db_dumps:/db_dumps
depends_on:
- database
volumes:
pgdata:
model-cache:Your .env contentDB_HOSTNAME=immich_postgres
DB_USERNAME=postgres
DB_PASSWORD=REDACTED
DB_DATABASE_NAME=immich
REDIS_HOSTNAME=immich_redis
UPLOAD_LOCATION=/mnt/nas/srv/immich/pictures
TYPESENSE_API_KEY=GiY1Up1U
PUBLIC_LOGIN_PAGE_MESSAGE=
IMMICH_WEB_URL=http://immich-web:3000
IMMICH_SERVER_URL=http://immich-server:3001
IMMICH_MACHINE_LEARNING_URL=http://immich-machine-learning:3003
IMMICH_API_URL_EXTERNAL=https://REDACTED/Reproduction steps1. go to immich web
2. find a file from the library
3. observe the red text
...Additional informationI forced-rescanned the library, it did not help Please let me know what logs I can provide to help diagnose. I looked at |
Beta Was this translation helpful? Give feedback.
Replies: 14 comments 25 replies
-
|
cc @etnoy |
Beta Was this translation helpful? Give feedback.
-
|
Inside the docker container, can you read the file? Like try to execute the file command: file /mnt/media/Fotografie/2022/2022-10-29_to_30_Yakima/Pixel5/PXL_20221029_194225561.jpg |
Beta Was this translation helpful? Give feedback.
-
( |
Beta Was this translation helpful? Give feedback.
-
reading works fine |
Beta Was this translation helpful? Give feedback.
-
|
Can you verify that both the server container and microservices containers can read the files? |
Beta Was this translation helpful? Give feedback.
-
|
The forced rescan did resolve issue. Really don't understand why it was required, but it did work. |
Beta Was this translation helpful? Give feedback.
-
|
For me, forced rescan did not resolve the issue. Trying the force rescan again. Also, doing "scan new library files" is not really finding the new files Is there a way to enable some debug/verbose logging? |
Beta Was this translation helpful? Give feedback.
-
|
So the full refresh logs this line: But it doesn't seem like it's doing much. when I run When I tried to run a storage migration, I got which I assume is unrelated, hopefully. There was never a log that refresh completed, but there are also no outstanding tasks in the jobs queue.
I am on v1.103.1 |
Beta Was this translation helpful? Give feedback.
-
|
One more observation, when I tapped "refresh metadata" and "refresh thumbnail" for such file, it gets refreshed correctly:
|
Beta Was this translation helpful? Give feedback.
-
|
I'm in the same boat, "Assets offline" when I have confirmed all the containers can see the external library. It's been this way for the last few releases, Forced Rescan doesn't appear to actually start. On the Jobs page, the Library Tasks clicks up to '1' for a very brief moment then goes back to '0'. |
Beta Was this translation helpful? Give feedback.
-
|
Same issue here. I have a lot of duplicates in my library. I believe they were created by running the Migration job, but I'm not sure about that one. Every duplicate image has the 'Asset offline' message. If there is anything I can do to test and help, I'd be happy to. |
Beta Was this translation helpful? Give feedback.
-
We may be in the same boat, but I do not have duplicates; |
Beta Was this translation helpful? Give feedback.
-
|
have the same issue "Asset offline" as well. might have been due to duplicates. rescan library , refresh metadata all doesnt work. But interactive bash to the docker was able to load and even cat out the image file. |
Beta Was this translation helpful? Give feedback.
-
|
Same issue here. 1.107.1 build.146 |
Beta Was this translation helpful? Give feedback.
-
|
Same here. Getting "asset offline" for excluded folders, as well as for duplicates that has later been removed from external library. Edit: Fixed it by clicking the "remove offline files" button |
Beta Was this translation helpful? Give feedback.
-
|
Has anyone had any luck with this? Both this and #9574 are awaiting closure before i'll consider buying a product key. |
Beta Was this translation helpful? Give feedback.
-
|
Is this an issue with the latest version? Can anybody with this issue post a log file with debug logging enabled? |
Beta Was this translation helpful? Give feedback.
-
|
I'm pretty sure that deleting import paths and re-creating is safe. It's only mapped to a specific library, not to an import path. I don't know enough about postgres to understand the quotes thing, but do try removing and adding import paths! |
Beta Was this translation helpful? Give feedback.
-
Just deleted all paths except 3; and this appeared;
I suspect there is an upper limit to how many import paths can be in an external library? |
Beta Was this translation helpful? Give feedback.
-
|
I am out of time now and must get going to work, I will do more testing tonight. I will slowly add import paths until it doesn't work again. I will report back the results. Thanks |
Beta Was this translation helpful? Give feedback.
-
|
I think I found the issue... I slowly added all paths back one by one in this process;
The issue appeared on the last folder I added; Import Path: It validated fine (when I didn't put a typo in it). Upon rescan, it made all existing Online Files, into Offline. Maybe; It appears something can't handle Single Quotation Marks in the import path? There are a few sub-directories under that one with Single Quotation Marks in them. I also tried two test folders on a new External Library;
Both Validate fine. Both have 1 image in each folder. "0 Assets when crawling...". I then tried removing just one Single Quotation Mark in the directory and import path;
Same result; "0 asset(s) when crawling..." Once I remove all Single Quotation Marks in the directories and import paths;
It works. "Found 2 asset(s) when crawling..." Summary is; a directory in the External Library, with Single Quotation Marks in it, will validate fine, but render the entire External Library offline. @etnoy do I need to raise this as a bug? (I don't know how to)(does this make me a contributor? lol I have no idea what i'm doing). |
Beta Was this translation helpful? Give feedback.
-
|
That's awesome work, I'll take care of it from here, please ping me in a few weeks if I forget it when I return from the summer holidays |
Beta Was this translation helpful? Give feedback.
-
|
Nice! This is not my problem (I don't have ' in the path), but very nice nevertheless. |
Beta Was this translation helpful? Give feedback.
-
Can you try a new library and add import paths until it won't import anything? |
Beta Was this translation helpful? Give feedback.
-
|
I do have the same issue but no single quotes anywhere. Loads of special characters in folder-names though. Commas, brackets, dots, and-signs (&) and german umlaute (ä, ö, ü). If you fix this, please check if said characters are part of the problem and can be included in the solution? Much appreciated. |
Beta Was this translation helpful? Give feedback.
-
|
I brought the containers down, added the new environment variable,
restarted the containers, and did my previous test with my import paths
with and without Single Quotation Marks.
It marked online assets as offline as soon as the Single Quotation Marks
paths were added (even though they verify).
I didn't shell into the container to check paths, because in my previous
testing, my offline assets were still offline, even when I could shell
Command into them and see them.
…On Sat, 17 Aug 2024, 23:27 Jonathan Jogenfors, ***@***.***> wrote:
I do have the same issue but no single quotes anywhere. Loads of special
characters in folder-names though. Commas, brackets, dots, and-signs (&)
and german umlaute (ä, ö, ü). If you fix this, please check if said
characters are part of the problem and can be included in the solution?
Much appreciated.
I've been doing some debugging and I might have a quick fix. Can you try
adding
LC_ALL=C.UTF-8
to your env file and rescan?
Hi, I tested with my Single Quotation Marks test import paths, both with
and without spaces (both with Single Quotation Marks).
New env file LC_ALL=C.UTF-8 didn't help with the Single Quotation Marks
issue. It still marked them as offline.
Just to verify, did you take the container down and up?
Are you able to start a shell in the container and browse the import path
and verify that non latin character paths are listed correctly? Also, what
is the output of the locale command?
—
Reply to this email directly, view it on GitHub
<#6845 (reply in thread)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/APCODKWG4D2DP7SNAZAMXALZR5FT7AVCNFSM6AAAAABEU27P6WVHI2DSMVQWIX3LMV43URDJONRXK43TNFXW4Q3PNVWWK3TUHMYTAMZWGY3DSOI>
.
You are receiving this because you are subscribed to this thread.Message
ID: ***@***.***>
|
Beta Was this translation helpful? Give feedback.
-
|
I have found the issue on my side, and it's different than the previous issue related to encoding. In my case, the problem exists between the keyboard and the screen. In other words: turns out that I am an idiot :) I challenge you to find an issue in the exclusion pattern: One thing that would have helped diagnose this issue faster is that if Immich said, instead of "asset is offline", something to the tune of "the asset's path matches an exclusion pattern, therefore it is ignored". If you can't see what's wrong with the pattern, open below:
`*(a|b)` means that the pattern should occur zero or more times. So essentially, `**/*(foo|bar)*` matches all the paths, ignoring them all.
|
Beta Was this translation helpful? Give feedback.
-
|
I've also the problem with assets shown offline, although they are not. I don't understand why. Immich acces rights checked within container
|
Beta Was this translation helpful? Give feedback.
I think I found the issue...
I slowly added all paths back one by one in this process;
DEBUG [Microservices:LibraryService] Found 127582 offline asset(s) previously marked as onlineThe issue appeared on the last folder I added;
Import Path:
/My_Photos/Wife's Photos/It validated fine (when I didn't put a typo in it).
Upon rescan, it made all existing Online Files, into Offline.
DEBUG [Microser…