Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Wrong upload_date on Odysee #28386

Closed
5 tasks done
christoph-heinrich opened this issue Mar 9, 2021 · 0 comments
Closed
5 tasks done

Wrong upload_date on Odysee #28386

christoph-heinrich opened this issue Mar 9, 2021 · 0 comments

Comments

@christoph-heinrich
Copy link

christoph-heinrich commented Mar 9, 2021

Checklist

  • I'm reporting a broken site support
  • I've verified that I'm running youtube-dl version 2021.03.03
  • I've checked that all provided URLs are alive and playable in a browser
  • I've checked that all URLs and arguments with special characters are properly quoted or escaped
  • I've searched the bugtracker for similar issues including closed ones

Verbose log

[debug] System config: []
[debug] User config: ['--cookies', '~/cookies.txt', '--console-title', '--write-sub', '--embed-subs', '--embed-thumbnail', '--merge-output-format', 'mkv', '--add-metadata', '--xattrs', '--match-filter', '!is_live', '-o', '%(title)s.%(ext)s', '-f', '(bestvideo[vcodec^=av01][height>=4320][fps>30]/bestvideo[vcodec^=vp9.2][height>=4320][fps>30]/bestvideo[vcodec^=vp9][height>=4320][fps>30]/bestvideo[vcodec^=avc1][height>=4320][fps>30]/bestvideo[height>=4320][fps>30]/bestvideo[vcodec^=av01][height>=4320]/bestvideo[vcodec^=vp9.2][height>=4320]/bestvideo[vcodec^=vp9][height>=4320]/bestvideo[vcodec^=avc1][height>=4320]/bestvideo[height>=4320]/bestvideo[vcodec^=av01][height>=2880][fps>30]/bestvideo[vcodec^=vp9.2][height>=2880][fps>30]/bestvideo[vcodec^=vp9][height>=2880][fps>30]/bestvideo[vcodec^=avc1][height>=2880][fps>30]/bestvideo[height>=2880][fps>30]/bestvideo[vcodec^=av01][height>=2880]/bestvideo[vcodec^=vp9.2][height>=2880]/bestvideo[vcodec^=vp9][height>=2880]/bestvideo[vcodec^=avc1][height>=2880]/bestvideo[height>=2880]/bestvideo[vcodec^=av01][height>=2160][fps>30]/bestvideo[vcodec^=vp9.2][height>=2160][fps>30]/bestvideo[vcodec^=vp9][height>=2160][fps>30]/bestvideo[vcodec^=avc1][height>=2160][fps>30]/bestvideo[height>=2160][fps>30]/bestvideo[vcodec^=av01][height>=2160]/bestvideo[vcodec^=vp9.2][height>=2160]/bestvideo[vcodec^=vp9][height>=2160]/bestvideo[vcodec^=avc1][height>=2160]/bestvideo[height>=2160]/bestvideo[vcodec^=av01][height>=1440][fps>30]/bestvideo[vcodec^=vp9.2][height>=1440][fps>30]/bestvideo[vcodec^=vp9][height>=1440][fps>30]/bestvideo[vcodec^=avc1][height>=1440][fps>30]/bestvideo[height>=1440][fps>30]/bestvideo[vcodec^=av01][height>=1440]/bestvideo[vcodec^=vp9.2][height>=1440]/bestvideo[vcodec^=vp9][height>=1440]/bestvideo[vcodec^=avc1][height>=1440]/bestvideo[height>=1440]/bestvideo[vcodec^=av01][height>=1080][fps>30]/bestvideo[vcodec^=vp9.2][height>=1080][fps>30]/bestvideo[vcodec^=vp9][height>=1080][fps>30]/bestvideo[vcodec^=avc1][height>=1080][fps>30]/bestvideo[height>=1080][fps>30]/bestvideo[vcodec^=av01][height>=1080]/bestvideo[vcodec^=vp9.2][height>=1080]/bestvideo[vcodec^=vp9][height>=1080]/bestvideo[vcodec^=avc1][height>=1080]/bestvideo[height>=1080]/bestvideo[vcodec^=av01][height>=720][fps>30]/bestvideo[vcodec^=vp9.2][height>=720][fps>30]/bestvideo[vcodec^=vp9][height>=720][fps>30]/bestvideo[vcodec^=avc1][height>=720][fps>30]/bestvideo[height>=720][fps>30]/bestvideo[vcodec^=av01][height>=720]/bestvideo[vcodec^=vp9.2][height>=720]/bestvideo[vcodec^=vp9][height>=720]/bestvideo[vcodec^=avc1][height>=720]/bestvideo[height>=720]/bestvideo[vcodec^=av01][height>=480][fps>30]/bestvideo[vcodec^=vp9.2][height>=480][fps>30]/bestvideo[vcodec^=vp9][height>=480][fps>30]/bestvideo[vcodec^=avc1][height>=480][fps>30]/bestvideo[height>=480][fps>30]/bestvideo[vcodec^=av01][height>=480]/bestvideo[vcodec^=vp9.2][height>=480]/bestvideo[vcodec^=vp9][height>=480]/bestvideo[vcodec^=avc1][height>=480]/bestvideo[height>=480]/bestvideo[vcodec^=av01][height>=360][fps>30]/bestvideo[vcodec^=vp9.2][height>=360][fps>30]/bestvideo[vcodec^=vp9][height>=360][fps>30]/bestvideo[vcodec^=avc1][height>=360][fps>30]/bestvideo[height>=360][fps>30]/bestvideo[vcodec^=av01][height>=360]/bestvideo[vcodec^=vp9.2][height>=360]/bestvideo[vcodec^=vp9][height>=360]/bestvideo[vcodec^=avc1][height>=360]/bestvideo[height>=360]/bestvideo[vcodec^=av01][height>=240][fps>30]/bestvideo[vcodec^=vp9.2][height>=240][fps>30]/bestvideo[vcodec^=vp9][height>=240][fps>30]/bestvideo[vcodec^=avc1][height>=240][fps>30]/bestvideo[height>=240][fps>30]/bestvideo[vcodec^=av01][height>=240]/bestvideo[vcodec^=vp9.2][height>=240]/bestvideo[vcodec^=vp9][height>=240]/bestvideo[vcodec^=avc1][height>=240]/bestvideo[height>=240]/bestvideo[vcodec^=av01][height>=144][fps>30]/bestvideo[vcodec^=vp9.2][height>=144][fps>30]/bestvideo[vcodec^=vp9][height>=144][fps>30]/bestvideo[vcodec^=avc1][height>=144][fps>30]/bestvideo[height>=144][fps>30]/bestvideo[vcodec^=av01][height>=144]/bestvideo[vcodec^=vp9.2][height>=144]/bestvideo[vcodec^=vp9][height>=144]/bestvideo[vcodec^=avc1][height>=144]/bestvideo[height>=144]/bestvideo)[width<=2560][height<=1440]+(bestaudio[acodec^=opus]/bestaudio)/best']
[debug] Custom config: []
[debug] Command-line args: ['-v', '-o', '%(upload_date)s_%(title)s.%(ext)s', 'https://odysee.com/@academyofideas:3/introduction-to-nihilism:9']
[debug] Encodings: locale UTF-8, fs utf-8, out utf-8, pref UTF-8
[debug] youtube-dl version 2021.03.03
[debug] Python version 3.9.2 (CPython) - Linux-5.11.4-xanmod1-1-x86_64-with-glibc2.33
[debug] exe versions: ffmpeg 4.3.2, ffprobe 4.3.2, rtmpdump 2.4
[debug] Proxy map: {}
�[22;0t[lbry] @academyofideas#3/introduction-to-nihilism#9: Downloading stream JSON metadata
[lbry] 9f9eea3a5574f8eb27da0ec90ad5b6653dd60604: Downloading streaming url JSON metadata
[lbry] 9f9eea3a5574f8eb27da0ec90ad5b6653dd60604: Downloading thumbnail ...
[lbry] 9f9eea3a5574f8eb27da0ec90ad5b6653dd60604: Writing thumbnail to: 20201030_Introduction to Nihilism.jpg
[debug] Invoking downloader on 'https://cdn.lbryplayer.xyz/api/v4/streams/free/introduction-to-nihilism/9f9eea3a5574f8eb27da0ec90ad5b6653dd60604/94e4ba'
[download] Destination: 20201030_Introduction to Nihilism.mp4

[download]   0.0% of 25.29MiB at 538.84KiB/s ETA 00:49�]0;youtube-dl   0.0% of 25.29MiB at 538.84KiB/s ETA 00:49�
[download]   0.0% of 25.29MiB at  1.36MiB/s ETA 00:18�]0;youtube-dl   0.0% of 25.29MiB at  1.36MiB/s ETA 00:18�
[download]   0.0% of 25.29MiB at 711.05KiB/s ETA 00:36�]0;youtube-dl   0.0% of 25.29MiB at 711.05KiB/s ETA 00:36�
[download]   0.1% of 25.29MiB at 384.91KiB/s ETA 01:07�]0;youtube-dl   0.1% of 25.29MiB at 384.91KiB/s ETA 01:07�
[download]   0.1% of 25.29MiB at 548.56KiB/s ETA 00:47�]0;youtube-dl   0.1% of 25.29MiB at 548.56KiB/s ETA 00:47�
[download]   0.2% of 25.29MiB at 667.75KiB/s ETA 00:38�]0;youtube-dl   0.2% of 25.29MiB at 667.75KiB/s ETA 00:38�
[download]   0.5% of 25.29MiB at 769.35KiB/s ETA 00:33�]0;youtube-dl   0.5% of 25.29MiB at 769.35KiB/s ETA 00:33�
[download]   1.0% of 25.29MiB at 846.64KiB/s ETA 00:30�]0;youtube-dl   1.0% of 25.29MiB at 846.64KiB/s ETA 00:30�
[download]   2.0% of 25.29MiB at 884.05KiB/s ETA 00:28�]0;youtube-dl   2.0% of 25.29MiB at 884.05KiB/s ETA 00:28�
[download]   4.0% of 25.29MiB at 902.36KiB/s ETA 00:27�]0;youtube-dl   4.0% of 25.29MiB at 902.36KiB/s ETA 00:27�
[download]   7.5% of 25.29MiB at 909.31KiB/s ETA 00:26�]0;youtube-dl   7.5% of 25.29MiB at 909.31KiB/s ETA 00:26�
[download]  11.1% of 25.29MiB at 912.70KiB/s ETA 00:25�]0;youtube-dl  11.1% of 25.29MiB at 912.70KiB/s ETA 00:25�
[download]  14.6% of 25.29MiB at 914.07KiB/s ETA 00:24�]0;youtube-dl  14.6% of 25.29MiB at 914.07KiB/s ETA 00:24�
[download]  18.2% of 25.29MiB at 911.24KiB/s ETA 00:23�]0;youtube-dl  18.2% of 25.29MiB at 911.24KiB/s ETA 00:23�
[download]  21.6% of 25.29MiB at 893.93KiB/s ETA 00:22�]0;youtube-dl  21.6% of 25.29MiB at 893.93KiB/s ETA 00:22�
[download]  24.8% of 25.29MiB at 902.72KiB/s ETA 00:21�]0;youtube-dl  24.8% of 25.29MiB at 902.72KiB/s ETA 00:21�
[download]  28.5% of 25.29MiB at 904.87KiB/s ETA 00:20�]0;youtube-dl  28.5% of 25.29MiB at 904.87KiB/s ETA 00:20�
[download]  32.1% of 25.29MiB at 907.94KiB/s ETA 00:19�]0;youtube-dl  32.1% of 25.29MiB at 907.94KiB/s ETA 00:19�
[download]  35.7% of 25.29MiB at 904.97KiB/s ETA 00:18�]0;youtube-dl  35.7% of 25.29MiB at 904.97KiB/s ETA 00:18�
[download]  39.1% of 25.29MiB at 906.72KiB/s ETA 00:17�]0;youtube-dl  39.1% of 25.29MiB at 906.72KiB/s ETA 00:17�
[download]  42.6% of 25.29MiB at 909.37KiB/s ETA 00:16�]0;youtube-dl  42.6% of 25.29MiB at 909.37KiB/s ETA 00:16�
[download]  46.3% of 25.29MiB at 910.23KiB/s ETA 00:15�]0;youtube-dl  46.3% of 25.29MiB at 910.23KiB/s ETA 00:15�
[download]  49.8% of 25.29MiB at 906.54KiB/s ETA 00:14�]0;youtube-dl  49.8% of 25.29MiB at 906.54KiB/s ETA 00:14�
[download]  53.1% of 25.29MiB at 908.48KiB/s ETA 00:13�]0;youtube-dl  53.1% of 25.29MiB at 908.48KiB/s ETA 00:13�
[download]  56.8% of 25.29MiB at 909.32KiB/s ETA 00:12�]0;youtube-dl  56.8% of 25.29MiB at 909.32KiB/s ETA 00:12�
[download]  60.3% of 25.29MiB at 909.81KiB/s ETA 00:11�]0;youtube-dl  60.3% of 25.29MiB at 909.81KiB/s ETA 00:11�
[download]  63.9% of 25.29MiB at 911.05KiB/s ETA 00:10�]0;youtube-dl  63.9% of 25.29MiB at 911.05KiB/s ETA 00:10�
[download]  67.5% of 25.29MiB at 908.12KiB/s ETA 00:09�]0;youtube-dl  67.5% of 25.29MiB at 908.12KiB/s ETA 00:09�
[download]  70.8% of 25.29MiB at 903.39KiB/s ETA 00:08�]0;youtube-dl  70.8% of 25.29MiB at 903.39KiB/s ETA 00:08�
[download]  73.9% of 25.29MiB at 898.73KiB/s ETA 00:07�]0;youtube-dl  73.9% of 25.29MiB at 898.73KiB/s ETA 00:07�
[download]  77.1% of 25.29MiB at 896.73KiB/s ETA 00:06�]0;youtube-dl  77.1% of 25.29MiB at 896.73KiB/s ETA 00:06�
[download]  80.3% of 25.29MiB at 896.99KiB/s ETA 00:05�]0;youtube-dl  80.3% of 25.29MiB at 896.99KiB/s ETA 00:05�
[download]  83.8% of 25.29MiB at 898.32KiB/s ETA 00:04�]0;youtube-dl  83.8% of 25.29MiB at 898.32KiB/s ETA 00:04�
[download]  87.4% of 25.29MiB at 890.73KiB/s ETA 00:03�]0;youtube-dl  87.4% of 25.29MiB at 890.73KiB/s ETA 00:03�
[download]  90.3% of 25.29MiB at 891.48KiB/s ETA 00:02�]0;youtube-dl  90.3% of 25.29MiB at 891.48KiB/s ETA 00:02�
[download]  93.8% of 25.29MiB at 892.71KiB/s ETA 00:01�]0;youtube-dl  93.8% of 25.29MiB at 892.71KiB/s ETA 00:01�
[download]  97.4% of 25.29MiB at 893.73KiB/s ETA 00:00�]0;youtube-dl  97.4% of 25.29MiB at 893.73KiB/s ETA 00:00�
[download] 100.0% of 25.29MiB at 890.59KiB/s ETA 00:00�]0;youtube-dl 100.0% of 25.29MiB at 890.59KiB/s ETA 00:00�
[download] 100% of 25.29MiB in 00:29
�]0;youtube-dl 100% of 25.29MiB in 00:29�[ffmpeg] Adding metadata to '20201030_Introduction to Nihilism.mp4'
[debug] ffmpeg command line: ffmpeg -y -loglevel repeat+info -i 'file:20201030_Introduction to Nihilism.mp4' -c copy -metadata 'title=Introduction to Nihilism' -metadata date=20201030 -metadata 'description=Become a Supporting Member and get access to exclusive videos: https://academyofideas.com/members/
=========
Recommended Books on Nihilism:
Laughing at Nihilism - http://amzn.to/2d6Q43L (affiliate link)
The Specter of the Absurd - http://amzn.to/2cv6a6i (affiliate link)

In this introductory lecture we will look at what nihilism means, its history, and its significance in Western Civilization.
=========
Get the transcript: http://academyofideas.com/2012/08/introduction-to-nihilism/
=========
Nietzsche and Nihilism:
Lecture 1: http://youtu.be/0Ajv-RrQs4o
Lecture 2: http://youtu.be/D1MYqi3dyr0
Lecture 3: http://youtu.be/AO1igh1bQEY
Lecture 4: http://youtu.be/rFyolMWU2pY
Lecture 5: http://youtu.be/mWnmC4PaHHs
Lecture 6: http://youtu.be/-_nLCZ3LKus
=========
For more lectures visit www.academyofideas.com
...
https://www.youtube.com/watch?v=0Ajv-RrQs4o' -metadata 'comment=Become a Supporting Member and get access to exclusive videos: https://academyofideas.com/members/
=========
Recommended Books on Nihilism:
Laughing at Nihilism - http://amzn.to/2d6Q43L (affiliate link)
The Specter of the Absurd - http://amzn.to/2cv6a6i (affiliate link)

In this introductory lecture we will look at what nihilism means, its history, and its significance in Western Civilization.
=========
Get the transcript: http://academyofideas.com/2012/08/introduction-to-nihilism/
=========
Nietzsche and Nihilism:
Lecture 1: http://youtu.be/0Ajv-RrQs4o
Lecture 2: http://youtu.be/D1MYqi3dyr0
Lecture 3: http://youtu.be/AO1igh1bQEY
Lecture 4: http://youtu.be/rFyolMWU2pY
Lecture 5: http://youtu.be/mWnmC4PaHHs
Lecture 6: http://youtu.be/-_nLCZ3LKus
=========
For more lectures visit www.academyofideas.com
...
https://www.youtube.com/watch?v=0Ajv-RrQs4o' -metadata purl=https://odysee.com/@academyofideas:3/introduction-to-nihilism:9 'file:20201030_Introduction to Nihilism.temp.mp4'
[ffmpeg] There aren't any subtitles to embed
[ffmpeg] Correcting extension to webp and escaping path for thumbnail "20201030_Introduction to Nihilism.jpg"
[ffmpeg] Converting thumbnail "20201030_Introduction to Nihilism.webp" to JPEG
[debug] ffmpeg command line: ffmpeg -y -loglevel repeat+info -i 'file:20201030_Introduction to Nihilism.webp' -bsf:v mjpeg2jpeg 'file:20201030_Introduction to Nihilism.jpg'
[atomicparsley] Adding thumbnail to "20201030_Introduction to Nihilism.mp4"
[debug] AtomicParsley command line: atomicparsley '20201030_Introduction to Nihilism.mp4' --artwork '20201030_Introduction to Nihilism.jpg' -o '20201030_Introduction to Nihilism.temp.mp4'
[metadata] Writing metadata to file's xattrs
�[23;0t

Description

When downloading e.g. this video, the upload_date does not match the date shown in the browser .
While I'm not familiar with the code, it looks like the website gets it's date from a push request to https://api.lbry.tv/api/v1/proxy?m=resolve and the resulting json contains creation_timestamp, timestamp and release_time. Both creation_timestamp and timestamp are on the same day as upload_date, however release_time has the date shown in the browser.

The same problem also exists for LBRY, but since they share the same back end, I assume that they also share an extractor and that fixing one of them will also fix the other one.

Edit: while writing this issue i was not aware that youtube-dl has a release_date field, however that field does not get populated from the Odysee extractor, so populating that would also be fine instead of changing the behavior of upload_date. Although the youtube and bitchute extractors also don't populate that field, so changing upload_date might be preferable for consistency.

@dstftw dstftw closed this as completed in 15c24b0 Mar 9, 2021
github-actions bot added a commit to hellopony/youtube-dl that referenced this issue Mar 10, 2021
* https://github.com/ytdl-org/youtube-dl:
  [shahid] fix format extraction(closes ytdl-org#28383)
  [lbry] add support for channel filters(closes ytdl-org#28385)
  [bandcamp] Extract release_timestamp
  [lbry] Extract release_timestamp (closes ytdl-org#28386)
  Introduce release_timestamp meta field (refs ytdl-org#28386)
  [pornhub] Detect flagged videos
  [pornhub] Extract formats from get_media end point (ytdl-org#28395)
This was referenced Mar 15, 2021
leshasmlesha pushed a commit to leshasmlesha/youtube-dl that referenced this issue Apr 3, 2021
leshasmlesha pushed a commit to leshasmlesha/youtube-dl that referenced this issue Apr 3, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant