Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] List of videos on a channel page is incorrect - no pagination channel #3371

Closed
LiberteIV opened this issue Oct 30, 2022 · 37 comments · Fixed by #3374
Closed

[Bug] List of videos on a channel page is incorrect - no pagination channel #3371

LiberteIV opened this issue Oct 30, 2022 · 37 comments · Fixed by #3374
Labels
bug Something isn't working stale

Comments

@LiberteIV
Copy link

LiberteIV commented Oct 30, 2022

Summarized by @unixfox:

The list of videos on a channel page is incorrect, sometimes it returns all the correct videos, sometimes nothing or other times only old videos.

Related issue: TeamNewPipe/NewPipe#9223


Lately, since a week or so i'm having a wired issue that never happened before.
Say for example i'm opening my browser and connecting to https://yewtu.be/channel/UCgFP46yVT-GG4o1TgXn-04Q
The channel either show old content like couple of months ago, or it does not load any content at all, and sometimes it loads the latest content as expected, why does this happen?

First screenshot there are supposed to be videos between the channel name and the susbscribe button but there are none.
Second screenshot shows videos from a month ago not the latest one, i had to reload the page like four times like gabling to get it load the latest videos.

2

1

@LiberteIV LiberteIV added the bug Something isn't working label Oct 30, 2022
@unixfox unixfox changed the title [Bug] Invidious loading incorrectly either outdated content or no content [Bug] List of videos on a channel is incorrect Oct 30, 2022
@unixfox unixfox changed the title [Bug] List of videos on a channel is incorrect [Bug] List of videos on a channel page is incorrect Oct 30, 2022
@unixfox
Copy link
Member

unixfox commented Oct 30, 2022

Youtube is A/B testing a new way of delivering the list of videos for a channel, Invidious only supports the old way. That's why you randomly see old videos or nothing.

@JPcode05

This comment was marked as resolved.

@LiberteIV

This comment was marked as resolved.

@unixfox
Copy link
Member

unixfox commented Oct 31, 2022

Related issue: TeamNewPipe/NewPipe#9223

@unixfox
Copy link
Member

unixfox commented Oct 31, 2022

Interesting findings: https://www.reddit.com/r/NewPipe/comments/yie0ca/workarounds_for_the_new_youtube_channel_tabs/

@meatspinner

This comment was marked as resolved.

@seriocomedy

This comment was marked as off-topic.

@meatspinner

This comment was marked as off-topic.

@iv-org iv-org deleted a comment from garoto Nov 1, 2022
@garoto
Copy link

garoto commented Nov 1, 2022

Workaround rule for the forked redirector legacy Palemoon extension (edit: it's called URL Rewritter now), but easily adapted to the current FF one:

{
    "exampleUrl": "https://yewtu.be/channel/UCBB0oz7Yo_35gnbPYGKGJTA",
    "includePattern": "https://yewtu.be/channel/UC*",
    "excludePattern": "",
    "redirectUrl": "https://yewtu.be/playlist?list=UU$1",
    "patternType": "W",
    "disabled": false
}

@unixfox unixfox pinned this issue Nov 1, 2022
@unixfox unixfox mentioned this issue Nov 1, 2022
@tunnckoCore

This comment was marked as resolved.

@Trit34
Copy link

Trit34 commented Nov 2, 2022

Interesting findings: https://www.reddit.com/r/NewPipe/comments/yie0ca/workarounds_for_the_new_youtube_channel_tabs/

This workaround works for Invidious, too.

Example: LGR’s channel returns no video on the FDN’s instance:
https://invidious.fdn.fr/channel/UCLx053rWZxCiYWsBETgdKrQ

But showing the videos channel list as a playlist shows them all (I think):
https://invidious.fdn.fr/playlist?list=UULx053rWZxCiYWsBETgdKrQ

Just remember to replace UC… string by UU… and paste the channel identifier as a playlist URL parameter and you’re OK.

Thanks for the tip!!! o/

@unixfox
Copy link
Member

unixfox commented Nov 2, 2022

Just remember to replace UC… string by UU… and paste the channel identifier as a playlist URL parameter and you’re OK.

Works for me without replacing anything, see: https://invidious.fdn.fr/playlist?list=UCLx053rWZxCiYWsBETgdKrQ

@salfter

This comment was marked as outdated.

@FreeBornAngel

This comment was marked as resolved.

@SamantazFox SamantazFox reopened this Nov 3, 2022
@SamantazFox
Copy link
Member

Reopening because the fix isn't complete (channel paging is still broken)

@artenax
Copy link

artenax commented Nov 3, 2022

Hello. I'm using User Script in Greasemonkey in Firefox to redirect from YouTube to Invidious.
Here is the code:

// ==UserScript==
// @name               YouTube Redirect to Invidious
// @namespace          Backend
// @include            https://m.youtube.com/*
// @include            http://m.youtube.com/*
// @include            https://www.youtube.com/*
// @include            http://www.youtube.com/*
// @version            1.0
// @run-at             document-start
// @author             Denis
// @grant              none
// ==/UserScript==

var a = 0;
setInterval(function () {
 if (a === 0 && window.location.href.indexOf('watch?') > -1 && window.location.href.indexOf('list=WL') < 0) {
  a = '//yewtu.be/watch?' + window.parent.location.href.split('?')[1];
  window.location.replace(a);
 }
}, 10);

Please tell me how I can change it to also redirect from https://yewtu.be/channel/ID to https://yewtu.be/playlist?list=ID ?

There is only one page on yewtu.be with a list of videos (on the yewtu.be/channel/ID). page=2, page=3, etc. are gone! I would be very upset if page=2+ disappeared forever.
On other Invidious instances, the video list is empty everywhere.

@artenax
Copy link

artenax commented Nov 4, 2022

I set up a redirect in Firefox using the Redirector extension. Following the example of Palemoon. And it's even better than User Script in Greasemonkey, because it works instantly.

Here are my rules:
Standard redirect to yewtu.be:

Redirect: https://www.youtube.com/watch?v=*
to: https://yewtu.be/watch?v=$1
Redirect: https://m.youtube.com/watch?v=*
to: https://yewtu.be/watch?v=$1

Redirect from channel to playlist?list=:

Redirect: https://yewtu.be/channel/UC*
to: https://yewtu.be/playlist?list=UU$1

This is because the channel/ pages now don't contain all the videos the channel has. Unfortunately, I don't know if the Invidious developers will fix this (to have ?page=2, ?page=3 in the channel section as before). Maybe it's a YouTube limitation.
By the way, replacing UC with UU is not required.
It's also bad that playlist?list= page doesn't contain the release dates of the videos.

Removing &list= from watch?v=*&list=* (controversial rule):

Redirect: https://yewtu.be/watch?v=*&list=*
to: https://yewtu.be/watch?v=$1

This is because videos from the playlist?list= page work in playlist mode. And after one video ends, it goes to the next video (this is not turned off in the settings, although I've unchecked all the boxes):

@LiberteIV
Copy link
Author

Asuming the devs fixed this by now because for me invidious is working again, thank you very much, marking this as solved now!

@sonicrules1234
Copy link

sonicrules1234 commented Nov 5, 2022

They haven't finished the fix, as you can see the pull request that goes with this bug says part 1 in it. Channel paging is still broken, and livestreams do not appear yet.

@forLoop42
Copy link

Gentlemen, pleased to present you my script that solves the problem with channel view: Fix Invidious Channel View. Only two things that I can't fix is amount of views (and when video was created) and sorting. (Tampermonkey / Greasemonkey / Violentmonkey required)

@TheFrenchGhosty

This comment was marked as off-topic.

@ZackiBoiz

This comment was marked as spam.

@SamantazFox
Copy link
Member

Note: #3419 fixed the paging. It also added the "shorts", "livestream" and "channels" tabs

I'm keeping this open until the code has tests for the various channel tabs, and while we try to have the pagination with numbers back like before.

@user234683
Copy link

@SamantazFox

I'm keeping this open until the code has tests for the various channel tabs, and while we try to have the pagination with numbers back like before.

Arbitrary paging has been found to be possible, at least when sorting by newest: user234683/youtube-local#151 (comment)

@Trit34
Copy link

Trit34 commented Mar 29, 2023

It seems that this bug is back: on a channel’s videos page, the “Next page” link sometimes go back to the most recent vidéos, or does not show any video (in this case, I have to reload the page several times to make it show them again).

Tested on the FDN instance (version 2023.03.26-51085c5b @ master) with Clint Basinger’s “LGR” channel (and more, but it is the same with any channel):
https://invidious.fdn.fr/channel/UCLx053rWZxCiYWsBETgdKrQ

It seems that reloading the page circumvents the bug quite well and finally shows the expected videos.

@garoto
Copy link

garoto commented Mar 29, 2023

Tested on the FDN instance (version 2023.03.26-51085c5b @ master)

There are no commits with this 51085c5b hash on invidious/master as far as I can see.

@Trit34
Copy link

Trit34 commented Mar 31, 2023

It has worsened: Invidious’ channel page for LGR or another channel shows an error message, now:

Could not extract JSON. Youtube API returned error 500 with message:
"ExecuteQuery for ChannelMiddlewareService-GetShelves failed: RET_CHECK failure (video/youtube/channels/frontend/shared/continuations/channel_middleware_token_encoding.cc:15) absl::WebSafeBase64Unescape(web_safe_token, &unescaped_token) ; OneMustSucceed: input 'mw_shelf_source_exp_continuation_unwrapper'; OneMustSucceed: input 'mw_shelf_source_exp_subgraphs'; OneMustSucceed: input 'mw_shelf_source_exp_empty_shelf_filter'; OneMustSucceed: input 'ShelfSourceExpansion__graph'; OneMustSucceed: input 'get_shelves_shelf_candidate_rank_sorter'; OneMustSucceed: input 'wrapped_main_subgraph'; OneMustSucceed: input 'pre_decoration_subgraph'; OneMustSucceed: input 'decoration_annotator_subgraph'; OneMustSucceed: input 'post_decoration_subgraph'; PropagateAllErrors: input 'GetShelvesEndpoint__graph'; PropagateAllErrors: input 'default_filter_survivor_probe_op'; PropagateAllErrors: input 'policy_enforcement_candidate_predicate'; /ChannelMiddlewareService.GetShelves RPC failed"

@unixfox unixfox unpinned this issue Mar 31, 2023
@user234683
Copy link

Not sure if this is related, but yesterday the ctoken format for arbitrary paging was changed slightly, see this commit in youtube-local. Not sure if you guys are synthesizing the ctoken or just extracting it, either way the timing is coincidental

@unixfox
Copy link
Member

unixfox commented Mar 31, 2023

Not sure if this is related, but yesterday the ctoken format for arbitrary paging was changed slightly, see this commit in youtube-local. Not sure if you guys are synthesizing the ctoken or just extracting it, either way the timing is coincidental

you are correct, I did notice it I pushed a quick fix here: #3718
with explaining what really changed

Copy link

This issue has been automatically marked as stale and will be closed in 30 days because it has not had recent activity and is much likely outdated. If you think this issue is still relevant and applicable, you just have to post a comment and it will be unmarked.

@github-actions github-actions bot added the stale label Mar 31, 2024
@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Apr 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working stale
Projects
None yet
Development

Successfully merging a pull request may close this issue.