HTTP cache rework and enable caching for storage assets

[silverwind]

This enabled HTTP time-based cache for storage assets, primarily avatars. I have not observed If-Modified-Since from browsers during tests but I guess it's good to support regardless.

It introduces a new generic httpcache module that can handle both time-based and etag-based caching.

Additionally, manifest.json and robots.txt are now also cachable.

[silverwind]

Working on generalizing http cache handling a bit in a separate module.

[silverwind]

httpcache module added. manifest.json and robots.txt are now also cachable. The caching is now also disabled when RUN_MODE is dev to ease development.

The only things that remain uncachable are the avatar redirects, we should get rid of them later.

[lunny]

httpcache module added. manifest.json and robots.txt are now also cacheable. The caching is now also disabled when RUN_MODE is dev to ease development.

The only things that remain uncacheable are the avatar redirects, we should get rid of them later.

Why do you think we should get rid of server redirect? If the assets are stored on a s3 compatible service, it's useful to reduce the bandwidth of the server.

[silverwind]

Why do you think we should get rid of server redirect?

It seems like a useless roundtrip that hurts performance. I don't see why it couldn't just directly output the correct URLs, especially for local storage.

302/307 redirects are by definition uncachable and must be attempted every page load. We can't use cachable permanent 301/308 redirects either because that would make avatars essentially immutable. I think it'd be best drop it and emit direct links.

[techknowlogick]

🚀