-
In general: Media Hoarder now supports TV Series
- configure the source paths (each directory within the source path should be a Series)
- browse series (also filter, search and sort)
- click "into" a series to browse episodes, also sort
-
All Dialogs now support Series
- expandable to see episodes
- episodes and movies can be clicked to access (and play)
-
Show IMDB Rating Heatmap by clicking the series rating
- click each episode to see details (and play)
-
Added HDR variants to the Video Quality section
- Media Hoarder now detects the following HDR variants: "HDR10", "HDR10+", "DV", "HLG"
- the HDR variants are shown in the media entries of the main list
- when clicked, you can see details about a certain HDR variant
- Filter section "Video Quality" also contains these entries
-
enhanced rescan summary
- see how many movies/series/episodes have been added/updated/removed
- click on Details: see changes on individual movies, series down to the files involved
- go to Settings and review past rescans (details on click)
- calculate collection sizes (dashboard shows the sizes)
- see how many movies/series/episodes have been added/updated/removed
-
UI: add "w2wTV" button for Series and Episodes which opens up https://whattowatchon.tv with the series pre-selected
-
Search Data Dialog (and other dialogs): show role of person/company
-
clicking a media item in one of the smaller lists, shows the item's card (and possibility to play)
-
Allow user to define audio / subtitle languages
- series: update imported_at for a series if episodes have been added
- FIX: series in dialog always only showed the start year
- UI: show media type (TV Series, Video, TV Movie) in IMDB Link Dialog
- NOT A BUG: findIMDBtconstInNFO does not search in correct sub-dir:
searching in Z:\_TESTSPACE\Media-Hoarder\Series
- not a bug: it's unlikely for a series episode that it's individual imdb tconst is included in the .nfo as in 99% of the cases, the series' IMDB tconst is included in the .nfo
- SCRAPER: Parental Guide
- use eventBus.setProgressBar on individual item rescan (also bulk)
- individual item: marquee (2)
- bulk: percent (currentIndex / numItems)
-
FIX: giving user rating stars for the series in episode view
-
cancel loading filters on series -> episodes change
-
introduce HDR (detect with color spaces, e.g. https://www.reddit.com/r/PleX/comments/7kwoy8/is_there_a_way_to_tell_if_a_file_is_hdr_from_the/)
- "HDR10", "HDR10+", "DV", "HLG"
- in sources:
#VIDEOPROPERTIES
- add them to "Video Quality" filter
- exclusively use tbl_Movies_MI_Qualities
- create migration (tbl_Movies.MI_Quality -> tbl_Movies_MI_Qualities)
- Name:
2024-06-02 migrate to tbl_Movies_MI_Qualities
- add rows for each tbl_Movies row with MI_Quality entry
- add Category_Name 'video-resolution' and Category_Sort 1 for all entries ("SD", "HD", "UHD", "4K", ...)
- ?remove MI_Quality column from tbl_Movies? -> !migration needs to check if MI_Quality column is present in tbl_Movies before!
- Name:
- everywhere in code where MI_Quality is used, use tbl_Movies_MI_Qualities (rescan, fetchMedia etc.)
- adapt mediaPropertyDialog for video quality Object containing MI_Quality, Category_Name (was string before)
- adapt videoQualityClicked for Object containing MI_Quality, Category_Name
- adapt updateSeriesVideoQualitiesFromEpisodes
- edit media dialog: adapt to handle multiple MI_Qualities
-
Bonus / Special Episodes
- season's card shows the number of bonus
- show bonus episodes in SeriesIMDBRatingDialog
-
Support Extras/Specials/Bonus General Concept:
- Media Hoarder treats dedicated episodes which can be called Extras, Specials or Bonus in one category: "Bonus Episodes"
- related ticket: #41 Series: Organization of Extras / Specials / Bonus, and Unnumbered Episodes
- Extras/Specials/Bonus are indicated by B01 or S02B02 and will be treated as bonus
- B01 will automatically go to Season 1
- S00B01 will automatically go to Season 0 (the unknown Season)
- rename all Series "Extras" to "Bonus" (at least for the UI)
- SCRAPER: When scanning series, re-rank IMDB search results so that tv-series are higher than movies when detecting the IMDB entry
- closes #61
v1.4.0-b5
- FEAT: do an update check on the beta channel if the build is a beta build
A beta build (like this one) will now do version checks against other beta builds and tell you if a newer beta build is available. The link for downloading is also pointing to the beta releases (and not the Media Hoarder website's download section).
- DB Migrations
- new table: tbl_DB_Migrations
- implement migration runner
v1.4.0-b4
- FEAT: add HDR variants to the Video Quality section
Media Hoarder now detects the following HDR variants: "HDR10", "HDR10+", "DV", "HLG".
The HDR variants are shown in the media entries of the main list:
When clicked, you can see details about a certain HDR variant:
Filter section "Video Quality" also contains these entries:
The IMDB entry detection (Media Hoarder trying to find the correct IMDB entry for a movie / tv show based on its name and release year) can fail due to different circumstances. Until now, Media Hoarder did not show errors prominently enough.
- SCRAPER: add testIMDBFindPageSearch to testset in UI
- SCRAPER: during the phase of IMDB entry detection, if something fails, the error will be stored in the scraper errors
v1.4.0-b3
- FEAT: calculate collection sizes (movies, series, total) before and after a re-scan, show current collection sizes in the home screen (which also now has a link in the navigation bar on the left)
-
FEAT: enhanced rescan summary
- related ticket: #45
- show how many movies/series/episodes have been added/updated/removed
- details dialog where the user can check individual files
- new tab in Settings where past scan sessions are listed (detail dialog on click)
- UI: add "w2wTV" button for Series and Episodes which opens up https://whattowatchon.tv with the series pre-selected
- SCRAPER: stop imdb scraping when the tconst is obviously not working
- reworked relative time and duration i18n
v1.4.0-b2
- FEAT: Search Data Dialog: show role of person/company
- UX: only load filters that are actually shown
- reload filters when "edit filters" is done (only reload those filters that have changed visibility from false to true)
- FIX: series/movies filters are not stored when switching to movies/series and back
- related bug: switching movies <> series may lead to 0 media items, even when pressing reload button
- FIX: clicking on plot keyword in "find plot keyword dialog" does nothing
- FIX: hide items in dialogs that have 0 media (e.g. plot keywords for movies that can only be found in series)
- FIX: prevent filtering and highlighting of searchText in Episodes listing
- DECISION: bring back filters for episodes?
- NOT NOW! this introduces more problems than solutions
- FIX: include description text in search space
- FIX: fast switching during trailer show lags behind
v1.4.0-b1
- FEAT: when clicking a media item in one of the smaller lists, show the item's card
- Media Property Dialog
- Trailer Show (LocalVideoPlayerDialog, VideoPlayerDialog)
- Chat GPT Dialog
- UX: MediaList: as soon as "sort by" was changed by the user, reset page to 1
v1.3.37-a8
- FIX: sort by Season and Episode didn't work anymore
- SCRAPER: Update Plotsummary IMDB Scraper Test
v1.3.37-a7
-
UX/SCRAPER: use imdb-graphql-urls.json (also try to fetch them from master in github, this way we can update the urls if imdb changes them - without creating a new release)
-
UX/SCRAPER: propagate actual errors of imdb scraping to the test result (i.e. errors in graphql querying instead of $IMDB_something is NULL)
v1.3.37-a6
- FEAT: make series clickable and expand to episodes listing for the selected series, show affected number of episodes vs. total number of episodes
- UX: remove the episodes section (in favor of episodes sections for all listed series)
- FEAT: IMDB Rating heatmap like https://whattowatchon.tv
- make medialist item card a shared component (now used in medialist as well as SeriesIMDBRatingDialog)main list "jumps" and THEN reloads with the filter applied (possibly a fix for another issue)
- prevent certain activities while in IMDB Rating Dialog mode
-
UI: fix z-index for other dialogs on top of the SeriesIMDBRatingDialog
-
UX: globally track MediaPropertyDialog's visibility in order to allow closing of SeriesIMDBRatingDialog on outside-click if MediaPropertyDialog is not open
-
UI: also provide clickable area for episodes we have but is missing an IMDB rating
- MediaList: provide Series_id_Movies_Owner explicitly to MediaPropertyDialog
- FEAT: Allow user to define audio / subtitle languages
- implement EditMediaItemDialog controls
- save on diff
- DB: tbl_Movies_MI_Qualities: also use for editing the series entry
v1.3.37-a5
- SCRAPER: imdb-graphql-urls: update seriesEpisodes (new persisted query)
- FIX: series episodes matching: don't assume E01 if neither season nor episode are set
v1.3.37-a4
- UX: MediaList: store currentPage for Movies, Series and Episodes (episodes in tbl_Movies.Series_currentPage)
- UX: MediaList: optimize fetchSortValues before fetchFilters
- SCRAPER/UX: findIMDBtconst for episodes:
- tt* override
- by season and episode numbers
v1.3.37-a3
-
UX: use tt* in the filename to override the tconst of an episode
-
UX: unlink IMDB on series: also unlink all episodes, which
- don't have the tt* as part of their file name
- haven't been user-set tt* (do we even track this?)
v1.3.37-a
- CHORE: Windows: update bundled VLC to 3.0.20
- CHORE: Windows: update bundled Mediainfo CLI to 23.11
- CHORE: refactor store.fetchMedia to only accept a single object containing the options
- CHORE: check sqlite version for json support - The JSON functions and operators are built into SQLite by default, as of SQLite version 3.38.0 (2022-02-22).
- specs see data/devdocs/series.md, docs/01-Media-Storage.md
- DB: ensure that MI Tracks table is cleaned up when a movie gets removed
- FIX: store.mergeExtraFileBased 713 TypeError: Cannot read property 'length' of undefined
- FIX: delete series actually deleted the source path
- FIX: in Series, where Video Quality filter resets from "ALL" to some being checked just by switching back and forth (series <> episodes)
- TEST: create a test set with series name and year (see: https://github.com/theMK2k/media-hoarder-testset-generator)
- enumerate series names
- enumerate episodes for each series
- benchmark series name detection (success: 98% hits on 1799 english series names)
- also benchmark the english movies test set
These items track the series feature in general.
- Remove mediaItem Dialog:
- always show the affected location full path
- differentiate Movies, Series and Episodes
- update "lastAccessAt" also for the series as well as any duplicate (and not only for the episode)
- function: updateSeriesMetadataFromEpisodes
- Audio Formats
- Release Attributes
- Audio Languages
- Subtitle Languages
- Video Encoders
- Video Qualities (multiple!)
- tbl_Movies_MI_Qualities: also use for filtering!
- Medialist: check if the image for episodes can be set to "fit height"
- Filters - the numbers should represent either movies or series
- Dialogs: most of them do not utilize mediaType
- Generalize to MediaPropertyDialog:
- provide movies and series lists (and episodes lists)? it's probably interesting to see these even if a person etc. has been opened from a series...
- act as a dialog for movies
- act as a dialog for series
- act as a dialog for episodes (of a certain series)
- debounce the init() function and call it on any property change, with 10ms debounce
- Generalize to MediaPropertyDialog:
- find IMDB tconst and provide metadata for the series and episodes
- provide series in a different route
- integrate old dialogs:
- AgeRatingDialog
- AudioFormatDialog
- CompanyDialog
- FilmingLocationDialog
- GenreDialog
- LanguageDialog -> audioLanguageDialog + subtitleLanguageDialog
- PlotKeywordDialog
- ReleaseAttributeDialog
- VideoEncoderDialog
- VideoQualityDialog
- PersonDialog
- integrate old dialogs:
- new symbol for "opening" a series and changing the screen to its eposiodes
- Series / Episode detection in directory/filenames, examples:
- "S01E01" - the default
- "Ep01" - as seen with some anime stuff
- "E01" - episode without season - assume S01
- "1x5" - same as S01E05
- "S01E01E02" - multiple episodes
- "S01E01-E03" - multiple episodes
- "S01E01E02E03" - multiple episodes
- "S01E01-03" - multiple episodes
- assign series episode imdb tconst when episode number is 0 (imdb provides null in this case)
- add "Season and Episode" sort order (only for Episodes specificMediaType)
- store filters and sort values by specificMediaType ("Movies", "Series", "Episodes")
- update Series_Num_Episodes and Series_Num_Seasons after an episode has been removed
- fix IMDB scraper (detecting genres and performing searches)
- update IMDB sources
- testIMDBreleaseinfo
- testIMDBCompaniesData
- testIMDBplotKeywords
- testIMDBFilmingLocations
- testIMDBFindPageSearch
- Link IMDB Dialog:
- with paginated search results (20 per page)
- Fix: IMDB Advanced Title Search
- Fix: IMDB Find Page Search
- updated IMDB detection
- excluded genre filters option (e.g. "not Horror")
- new list action: "Start Trailer Show"
- generate a list of distinct movies with available trailers from the current list
- show trailer dialog beginning with the first
- show [1/123]
- provide "prev", "next", "add movie to list" buttons
- implement trailer show in non-local player dialog
- load next trailer in trailer show when previous ended
- "Close and Show this Movie"
- imdb scraper fixes
- metacritic score (V2.1)
- trailer urls (V3)
- re-scrape IMDB Main Page if Trailer URL is 404
- remove rounded corners in LocalVideoPlayerDialog
- ensure both video player dialog types are closed before the next opens
- take over release attributes and description / plotSummary when moving a file
- add shared.duplicatesHandling.updateDescription
- add shared.duplicatesHandling.updateReleaseAttributes
-
#rip-rating-demographics (see https://www.imdb.com/title/tt4154796/ratings)
- remove rating demographics (also: don't utilize chosen default demographic)
- remove tests (watchdog, in-ui)
- remove during scrape
- remove on-click dialog in MediaList
- test with scan
-
imdb scraper: v3 plotkeywords
-
imdb scraper: v3 locations
-
Settings: sort list of source paths by name
- WIN: update VLC, mediainfo-cli
- The integration of ChatGPT to query AI suggestions has been significantly improved. There is no longer a dependency on IMDB IDs.
- Improved Trailer experience with embedded player
- Media List: "rescan this list" (operations on the currently shown list w/ menu)
- onListActionsRescanMetaData - show dialog before rescan
- properly handle array for the rescan (total time etc.)
- after cancel: set isScanning to false
- add $IMDB_startYear and $IMDB_endYear (we cannot provide them from /releaseinfo anymore)
- test V1, V2 and V3 mainPageData
- check calling functions!
- implement V2 (
__NEXT_DATA__
) - test V1
- we had to remove $IMDB_startYear and $IMDB_endYear, check calling functions!
- V2 (
__NEXT_DATA__
)
- implement V3 GQL-based
- dump/usedump: if filename exceeds 160 characters, make a hash of it and use this at the end of truncated filename
- AI Recommendations
- PersonDialog: add button for (re-)fetching data from web
- UI: MediaList: minor positioning correction for action icons in media items
- fix breaking IMDB captcha
- Search Data Dialog: fix numMovies
- Show IMDB and MetaCritic scores in compact movie lists (dialogs):
- Person Dialog
- Company Dialog
- Age Rating Dialog
- Audio Format Dialog
- Filming Location Dialog
- Genre Dialog
- Language Dialog
- Person Dialog
- Plot Keyword Dialog
- Release Attribute Dialog
- Video Encoding Dialog
- Video Quality Dialog
-
optimize rescan
-
make markdown links in history entries clickable
-
fix: "file created at" not always with value
-
check-package.json.sh (should prevent build)
-
delete media from main list
-
filter imdb tconst in search, so that a complete imdb.com url leads to search results
-
fix: missing metadata on scan (IMDB_runtimeMinutes, IMDB_plotSummaryFull, MI_Duration*)
-
fix: plot keyword casing ex. "New Year'S Eve"
-
fix: number of media in filters for persons, companies, keywords, filming locations
-
higher resolution for IMDB Rating filtering (0.1 steps); correct local decimal character
-
remove scanErrors when unlinking
-
in *Dialog click on "filter by this ..." should only reload the one filter and then the movies
-
Fix: MediaInfo (video): use the highest res if multiple video streams are present (also in MovieManager)
-
more MediaInfo
-
In quick info area:
- Video Encoder (x264, x265, XviD ...)
- Audio Format/Codec Example:
- current: 8K | 14-18+ | Action, Drama, Horror, Thriller | DE, EN | DE, EN, FR | BD
- new: 8K | 14-18+ | Action, Drama, Horror, Thriller | DE, EN | DE, EN, FR | x264 | EAC3, PCM | BD
- video: tbl_Movies_MI_Tracks
- Encoded_Library_Name_Trimmed (x264, x265, XviD)
- ?Format (AVC, HEVC)?
- audio: tbl_Movies_MI_Tracks.Format
- video: tbl_Movies_MI_Tracks
-
show in MediaList Quick Info Area (Video Codec/Format, Audio Codecs/Formats)
-
new Filters + Dialog:
- Video Codec
- Audio Formats
-
-
Fix: "applying MediaInfo" doesn't show countdown timer
-
introduce Audio Metadata
-
see below: use Movie Manager to mass-scan a movie folder and find out the different audio codecs
-
new table tbl_Movies_MI_Tracks
-
scan all media info data to find out which fields are populated by each track type
-
investigate how to enforce numeric values
-
does it suffice to set the fieldtype in the db? -> test with a SELECT query -> plan: mass import and analyze later
-
Integer fields:
- AlternateGroup?
- AudioCount
- BitDepth
- BitDepth_Detected
- BitRate
- BitRate_Maximum
- BitRate_Minimum
- Channels
- FileSize
- FooterSize
- FrameCount
- HeaderSize
- Height
- MenuCount
- MenuID
- MultiView_Count
- OverallBitRate
- OverallBitRate_Maximum
- Sampled_Height
- Sampled_Width
- SamplesPerFrame
- SamplingCount
- SamplingRate
- Source_FrameCount
- Source_StreamSize
- Stored_Height
- Stored_Width
- StreamOrder
- StreamSize
- TextCount
- VideoCount
- Width
-
NUMERIC fields:
- Delay
- Delay_Original
- DisplayAspectRatio
- DisplayAspectRatio_Original
- Duration
- Duration_LastFrame
- FrameRate
- FrameRate_Maximum
- FrameRate_Minimum
- FrameRate_Original
- Interleave_Duration
- Interleave_Preload
- Interleave_VideoFrames
- PixelAspectRatio
- PixelAspectRatio_Original
- Source_Duration
- Source_StreamSize_Proportion
- StreamSize_Proportion- [x] remove MediaInfoObject from tbl_Movies
-
-
-
-
defect: rescan with deselected IMDB options removes metadata (persons, companies, etc.)
-
react to userScanOptions!
-
dont merge everything directly in IMDBdata with Object.assign, instead build up: imdbData = { mainPageData: null, ratingDemographics: null, plotSummaryFull: null, plotKeywords: null, releaseinfo: null, technicalData: null, parentalguideData: null, creditsData: null, companiesData: null, filmingLocations: null, }
-
rescanMoviesMetaData_fetchIMDBMetaData_mainPageData
- scrapeIMDBmainPageData()
- imdbData.mainPageData: { $IMDB_releaseType: string; $IMDB_genres: string[]; $IMDB_rating: number; $IMDB_numVotes: number; $IMDB_metacriticScore: number; $IMDB_posterSmall_URL: string; $IMDB_posterLarge_URL: string; $IMDB_plotSummary: string; $IMDB_Trailer_URL: any; }
-
rescanMoviesMetaData_fetchIMDBMetaData_ratingDemographics
- scrapeIMDBRatingDemographics()
- imdbData.ratingDemographics:
{ $IMDB_rating_*: number; (except $IMDB_rating_imdb_users) $IMDB_numVotes_*: number; (except $IMDB_numVotes_imdb_users) }
-
rescanMoviesMetaData_fetchIMDBMetaData_plotSummary
- scrapeIMDBplotSummary()
- imdbData.plotSummaryFull:
{ $IMDB_plotSummaryFull: string; }
-
rescanMoviesMetaData_fetchIMDBMetaData_plotKeywords
- WAS: plotkeywords (param in saveIMDBData)
- NOW: imdbData.plotKeywords (only if userScanOption is set)
-
rescanMoviesMetaData_fetchIMDBMetaData_releaseinfo
- scrapeIMDBreleaseinfo()
- imdbData.releaseinfo:
{ $IMDB_originalTitle: any; $IMDB_localTitle: string; $IMDB_primaryTitle: any; $IMDB_startYear: any; $IMDB_endYear: any; }
-
rescanMoviesMetaData_fetchIMDBMetaData_technicalData
- scrapeIMDBtechnicalData()
- imdbData.technicalData: { $IMDB_runtimeMinutes }
-
rescanMoviesMetaData_fetchIMDBMetaData_parentalguideData
- scrapeIMDBParentalGuideData()
- imdbData.parentalguideData: { $IMDB_MinAge $IMDB_MaxAge $IMDB_id_AgeRating_Chosen_Country $IMDB_Parental_Advisory_Nudity $IMDB_Parental_Advisory_Violence $IMDB_Parental_Advisory_Profanity $IMDB_Parental_Advisory_Alcohol $IMDB_Parental_Advisory_Frightening }
-
rescanMoviesMetaData_fetchIMDBMetaData_creditsData
- scrapeIMDBFullCreditsData()
- imdbData.creditsData: {
topCredits: {
$IMDB_Top_Directors: string;
$IMDB_Top_Writers: string;
$IMDB_Top_Producers: string;
$IMDB_Top_Cast: string;
};
credits: {
category: string;
id: string;
name: string;
credit: any;
}[];
} - WAS: credits (param to saveIMDBdata)
- NOW: imdbData.creditsData.credits
-
rescanMoviesMetaData_fetchIMDBMetaData_companiesData
- scrapeIMDBCompaniesData()
- imdbData.companiesData: {
topProductionCompanies: {
$IMDB_Top_Production_Companies: string;
};
companies: any[];
} - WAS: companies (param to saveIMDBdata)
- NOW: imdbData.companiesData.companies
-
rescanMoviesMetaData_fetchIMDBMetaData_filmingLocations
- WAS: filmingLocations (param in saveIMDBData)
- NOW: imdbData.filmingLocations
-
-
(already fixed) companies: duplicates in topcompanies; non-dupes in companies list?
-
on forced rescan also do MediaInfo
-
highlight hidden filtered languages
- Audio Languages: color the +7 if the language is behind it
- Subtitle Languages: color the +7 if the language is behind it
-
sidebar: for each filter (where applicable) provide switchable icon with tooltip for sort mode (alphabetically or by number of movies)
- merge filterGroups after load, so that new features in code are still present
- filterSourcePaths
- filterQualities
- filterAudioLanguages
- filterSubtitleLanguages
- filterReleaseAttributes
- filterLists
- filterGenres
- filterPersons
- filterCompanies
- filterYears
- filterIMDBPlotKeywords
- filterIMDBFilmingLocations
- NOT filterRatings
- NOT filterMetacriticScore
- NOT filterIMDBRating
- NOT filterAgeRatings
- NOT filterParentalAdvisory
- NOT filterDataQuality
-
Sidebar: colorize also the caret
-
Sidebar: colorize also the spinner
-
reload the filters first that have been modified (e.g. change in genres reloads genres first)
-
calculation of numMovies for AND-connected filters should be different than OR-connected filters of the same category
- filterGenres
- filterPersons
- filterCompanies
- filterIMDBPlotKeywords
- filterIMDBFilmingLocations
- filterReleaseAttributes
- filterDataQuality
-
colored active filters on the sidebar
-
MediaList: move
*Applied
and*AppliedContains
to $shared, so that App can also use them -
shared: introduce filter*Active (true|false), reuse this info in MediaList.filtersList and App
-
highlight filtered people, companies etc. (same as search highlight)
- People
- Companies
- SourcePaths
- Video Quality
- Audio Languages
- Subtitle Languages
- Release Attributes
- defect: Lego Batman: The Movie - DC Super Heroes Unite fulfills "Director's Cut" filter
- defect: "Director's Cut" filter with "all selected must apply" only shows 1, expected: 86
- My Lists
- Genres
- Age Ratings
- Content/Parental Advisories
- Release Years
- Plot Keywords
- Filming Locations
- ALL Categories: if there is a mk-clickable expandable section title, color it if the list is non-empty
-
optimize movie credits handling (duplicate person in different roles per category, e.g. Aaron Sorkin in Few Good Men)
-
remove sqlite indexes that don't exist anymore
-
eliminate TODO/KILLME entries in code
-
store media info object as MI_Object in tbl_Movies
-
allow unlinking in relink dialog
- tbl_Movies.isUnlinkedIMDB (make use of this field, where appropriate)
- unlinked movies should not detect tconst automatically (also check handling of real duplicates!)
- on explicit rescan (at the movie): don't use it
- on fast/complete rescan of multiple movies: use it
- tbl_Movies.isUnlinkedIMDB (make use of this field, where appropriate)
-
first scanned item shows 1s of remaining time (better not show anything or guesstimate)
-
some log groups do not close before the next opens
-
write cli tests and optimize findIMDBtconst
- do a hybrid search to find imdb tconst (advanced title search, find etc.)
- it turns out that the find API suffices
- check if scrapeIMDBSuggestion is still necessary -> suggestion is not necessary anymore
- optimize scrapeIMDBFind by utilizing categories:
- Titles (movies, series, episodes): &s=tt
- optionally filter "(TV Series)": this exludes TV Series and Episodes but not TV Mini Series (which is good!)
- filter losely by year
- filter strictly by year
- take the runtime (MediaInfo vs. IMDB) into account if multiple results come up
- do a hybrid search to find imdb tconst (advanced title search, find etc.)
-
Filters: "Select All", "Clear Selection", "Search": use icons
-
Layout: delete button in sidebar filters
-
(My) List Dialog: preselection should be the last selected list
-
languages from tbl_Movies_Languages are not taken into account for the Media List
-
Fix: Scan Media: cancel in early stage leads to mass removal!
-
Bottom Bar: show marquee or steps progress
-
(electron) The remote module is deprecated. Use https://github.com/electron/remote instead.
-
update ETA in scan message every second
-
use logger.group/groupCollapsed, logger.groupEnd throughout the app
-
add IMDB ID to MediaList
-
Highlight search results (Name, Name2, IMDB_plotSummary, fullPath, IMDB_tconst)
-
"long click" checkbox filter isolation
-
Fix: Crash/White Screen on startup when malformed i18n file is present
-
"Add to list" takes considerable time to finally show the list entry in the movie's entry
-
App: filter item isolation (click a filter item where all other items are true: Select All items false but the clicked one)
-
Search Data Dialog: do in-client sort by numMovies
-
Search Data Dialog: use "*" as placeholder
-
"load animate" only the filter that is currently loading
- fetch the filter that has been modified first (added items, removed items)
- kill previously started fetching of filters (else we clash)
-
reload filters after saving user edited entry
-
LinkIMDBDialog: use Find and merge with AdvancedTitleSearch
-
implement https://github.com/mawie81/electron-window-state
- debug node_modules/electron-window-state (it's unmaintained)
-
KILLME checker script
- prevent build
-
Medialist: fix layout if movie name overflows
-
check layouts of sidebar filters
-
Drag/Drop Rearrange:
- Settings - Regions
- Settings - Languages
- Settings - Release Attributes
- App - Sidebar Filter Menu (Genres, Years ...)
- when a filter is applied, set the filterGroup visible = true
- show "RESET" and "EDIT" buttons only on hover
-
optimize text about removal of known missing file in ScanMedia Dialog (it is dependant on the setting of the source path)
-
i18n
- IMDB Scraper Test Dialog
- IMDB Options in ScanMedia Dialog
- Scan Errors (all of the keys, and the value for verifyIMDBtconst)
-
introduce a scan error (more like scan warning) when:
- actual runtime differs from imdb runtime
- release year differs from imdb year
- provide text button to explicitly clear the error message
-
placeholder icon for Person Dialog, also circular progress while scraping
-
placeholder icon for movies
-
rework video quality detection (1085p is not UHD)
-
provide VLC and MediaInfo CLI alongside the App (use ./bin/%platform%/mediainfo-cli/) - use the location as default location of mediainfo cli - currently only for Windows
-
IMDB Rating and Metacritic filters fixed
-
New Filter: Data Quality
- missing IMDB Link
- has Scan Errors
- missing Secondary Title
- missing Poster
- missing Plot Summary
- fill the asterisk in MediaList
- i18n
-
writing credits are sometimes not fetched at all, see Arlington Road
-
on Cancelling (re-scan): dont display button but show "cancelling..."
-
imdb scraper: support "new" main page
-
fix in imdb scraper where genres were duplicated
-
fix in imdb scraper where metadata was missing (poster, plot summary)
-
sort by Name as secondary criteria when sorting by anything else as first (e.g. year -> name)
-
IMDB detection
-
-> improve by utilizing year (162 of 170 matched, 2553 of 2648 matched)
-
"Browse" VLC path -> depending on OS type provide default path / default extension
-
-> provide mediainfo-rar or similar for Linux/Mac - or better yet let the user provide a path?
- -> user must provide
-
preferred Regions
-
let user define preferred (local) Regions to identify the primary title
-
-> fetch Countries from
https://www.imdb.com/search/title/
and provide as list -
-> Auto set region by user's localization setting?
- start: 2021-10-09 15:30
- end: 2021-10-11 6:30 => 39h / 7600 => 18s / Movie
-
[?] Dialog.vue
-
MediaList
-
Pagination.vue
-
Home.vue
-
VersionDialog.vue
-
Settings.vue
-
CheckIMDBScraperDialog.vue
-
AddLanguagesDialog.vue
-
AddRegionsDialog.vue
-
AddTitleTypeDialog.vue
-
AgeRatingDialog.vue
-
App.vue
-
CompanyDialog.vue
-
EditMediaItemDialog.vue
-
EditReleaseAttributeDialog.vue
-
FilmingLocationDialog.vue
-
GenreDialog.vue
-
LanguageDialog.vue
-
LinkIMDBDialog.vue
-
ListDialog.vue
-
[.] LocalVideoPlayerDialog.vue (not in use)
-
PersonDialog.vue
-
PlotKeywordDialog.vue
-
RatingDemographicsDialog.vue
-
ReleaseAttributeDialog.vue
-
ScanOptionsDialog.vue
-
SearchDataDialog.vue
-
SourcePath.vue
-
TitleType.vue
-
VideoPlayerDialog.vue
-
VideoQualityDialog.vue
-
App.vue BOTTOM BAR
- use pre-build step to set portable mode explicitly
- implement pre-build step in all build tasks
- target: RELEASE directory with media-hoarder-VERSION-... files
- create set-release-version.js which renames the media-hoarder-VERSION-... files to media-hoarder-1.2.3-... files
- Primary Title
- Secondary Title
- Year
- Description
- Genres
- Release Attributes
- on (re-)scan: don't overwrite user-defined data (see tbl_Movies.DefinedByUser field definitions)
- bigger cards
- some info (number of movies)
isBuild: use APPDIR/data !isBuild: use ~/.media-hoarder
- Linux: after .deb install, a normal user can't write to /opt/media-hoarder/...
- Windows: not so problematic, as the app is installed in a user writable location
-> use a ~/.media-hoarder directory -> this is the default location, we should be able to overwrite that via media-hoarder.json { "portable": true }
-> don't store "/data" in:
- tbl_Movies IMDB_posterSmall_URL and IMDB_posterLarge_URL
- tbl_IMDB_Persons.Photo_URLgetStaticPath
helpers:
- getStaticPath: formerly known as getPath - returns absolute path to APPDIR/data
- getDataPath: returns ~/.media-hoarder in !portable mode, else APPDIR/data
• application Linux category is set to default "Utility" reason=linux.category is not set and cannot map from macOS docs=https://www.electron.build/configuration/linux
• default Electron icon is used reason=application icon is not set
• application Linux category is set to default "Utility" reason=linux.category is not set and cannot map from macOS docs=https://www.electron.build/configuration/linux
• default Electron icon is used reason=application icon is not set
as per https://nklayman.github.io/vue-cli-plugin-electron-builder/guide/recipes.html#icons
- Linux "which"
- Windows "where" -> test in Linux (success)
tbl_Movies: Path -> RelativePath Directory -> RelativeDirectory
store.listPath now with basePath
- a movie's directory and path should always be relative to the sourcePath definition -> use path.resolve etc. to work with them -> this way, a whole sourcePath can move to another location
check:
- extras merging (by directory)
- anything else?
- we currently expect the whole movie name and release attributes being included in the filename, this is not always the case
- find a way to decide if a movie file belongs to a dir-release or is standalone
- if handling .rar files, summarize all individual filesizes
- use isDirectoryBased in findIMDBtconstIncluded (tt12345 in file- or directory name)
- use isDirectoryBased in findIMDBtconstInNFO (by .nfo file content)
- use isDirectoryBased in finding findIMDBtconstByFileOrDirname (by File/Dirname)
- use isDirectoryBased in finding Release attributes (DUBBED, BDRip etc.)
- handle extras in "Extras" directory
- check AssignIMDB (individual rescan)
- update /docs
- a media file alongside an .nfo file (scene release) -> also don't expect any other media files in the directory
- a media file inside an "extra" or "extras" directory (this is our own definition!) -> use the full filename as Extra Name
-> set isDirectoryBased = 1 -> ignore the filename and use the directory's name instead -> parse the .nfo for IMDB tconst
=> anything else: treat it as file-based media file (isDirectoryBased = 0)
- a media file inside a "sample" directory
- a media file inside a "proof" directory
- moment.humanize should also be localized (see de.json!)
- implement vue-i18n
- Add UI-Language Selection in Settings
- change static strings in components to $t('key')
src\App.vue
src\components\Settings.vue
src\components\Home.vue
src\components\MediaList.vue
src\components\shared\AddLanguagesDialog.vue
src\components\shared\AddRegionsDialog.vue
src\components\shared\AddTitleTypeDialog.vue
src\components\shared\CheckIMDBScraperDialog.vue
src\components\shared\CompanyDialog.vue
src\components\shared\Dialog.vue
src\components\shared\FilmingLocationDialog.vue
src\components\shared\LinkIMDBDialog.vue
src\components\shared\ListDialog.vue
src\components\shared\LocalVideoPlayerDialog.vue
src\components\shared\Pagination.vue
src\components\shared\PersonDialog.vue
src\components\shared\PlotKeywordDialog.vue
src\components\shared\RatingDemographicsDialog.vue
src\components\shared\ScanOptionsDialog.vue
src\components\shared\SearchDataDialog.vue
src\components\shared\SourcePath.vue
src\components\shared\TitleType.vue
src\components\shared\VersionDialog.vue
src\components\shared\VideoPlayerDialog.vue
-
create a watchdog CLI which tests imdb-scraper.js
- scrape different IMDB pages
- compare with expected result (json suffices)
- creates an error report
- sends an email on error
- start with "npm run imdb-scraper-watchdog"
-
put all IMDB scraping functions from store.js into imdb-scraper.js
-
Implement test-framework callable in app and also in imdb-scraper-watchdog
-
Implement IMDB Scraper Checks Dialog, usable from
- Settings (via Button)
- after Scan Options Dialog and before actual Scan
- EXTENDED, Director's Cut, UNRATED etc.
- -> implement in shared.releaseAttributes save as Settings.ReleaseAttributes
- -> let them be sortable
OK? => let user re-edit the entry/attributes
- Save/Load of filter
- implement Dialog incl. filtering and removal of individual release attributes
-
How should we handle ECONNRESET? maybe requestretry?
-
How can we test this?
-
investigate offline error handling
- imdb scraper test Dialog
- imdb scraping during (re-)scan
- track errors during rescan
- mark item as scanErrors, containing the log of scan errors (NULL if everything is fine)
- show this at the item in MediaList with button for direct rescan of the item and info to also perform rescan
- on rescan (quick): also take items with hasScrapeErrors being truthy into account (not only isNew = true)
- check movie identification based on name (this should also fail during scan)
- -> add movie identification on item-based rescan if no tconst is available
- imdb search/find
- imdb scraping on persons, companies etc.
- implement filter reset button in side bar menu
- add AudioLanguageDialog
- add SubtitleLanguageDialog
- -> for clicking the individual language in the MediaList
- -> allow "filter by this language"
- -> what do we do with "+3" entries?
- -> they should expand
- would it be good to have (many) icons for the sections and filters in the navbar?
- -> yes, all icons identified
- Blues Brothers
- -> mediainfo-rar
- -> link https://moviechat.org/tt0054215
- add as section in MediaLists
- add filter
- scrape
- allow the user to choose which demography to use as IMDB rating
- show demographics matrix when clicking IMDB score for an item
- include statistical infos (how many movies)
- fix resolution Detection, e.g. 4:3 HD is oftentimes detected as 720p
- use user-chosen regions (countries) as basis for the age rating shown in the main list
- allow user to deselect things for the IMDB scraper (analog to store.scanOptions)
- shown on startup
- welcome message
- latest introduced features
- history (show more..)
- info if this is the latest version (based on github releases page?)
Content:
[
{
"version": "1.0",
"description": "version-1.0.html"
},
{
"version": "0.5",
"description": "version-0.5.html"
}
]
- small backlog.json
- load version-xx.html from file or from github if not available
- render within VersionDialog
- how would SQL queries look?
- save AND filter setting alongside the filters themselves
- Bug? Age (range) isn't shown anymore
- show warning when a source path cannot be found but it is set to remove entries on re-scan
- when mouseover on items, pagination items get recalced
- reason could be usage of this.$set (it was indeed)
- "David Lynch" should have multiple hits, unfortunately only one is shown
-
an actual duplicate is the same file in another location (e.g. local copy vs. on server)
-
a meta duplicate has the same IMDB ID
-
Rescan: when a movie was moved (same filename+size just deleted at location X and added on location Y)
- -> copy over userdefined data (e.g. rating etc. also member of lists)
- => do we really want this? what are the scenarios?: a "twin" may already exist and should be updated whenever a change happens - in this case we have id_Movies from the "source file" and should all other movies with same filename and size
-
=> see shared.duplicatesHandling to check which features allow duplicate handling
Features:
-
relinkIMDB
-
addToList
-
updateRating
-
updateTitle
-
updateSubTitle
-
updateLastAccess
-
Test actual duplicates
-
also implement rescan (actualDuplicates and metaDuplicates can be found there, too)
-
provide languages management (also based on regions!)
-
-> we need them for the "preferred Languages" from MediaInfo
-
-> we need them for the Primary Title
-
-> create tbl_IMDB_Languages
-
-> create tbl_IMDB_Regions
-
-> Create tbl_IMDB"Regions"Languages (mapping)
-
-> "your chosen regions provide the following language options, please select the ones you prefer as Primary Title"
-
provide whitelist management of title types
-
-> check title types from MovieManager's mm.db
on Rescan:
- tokenize and find out if the tokens are either special title types or just language types
- -> if user has appropriate language type setting (i.e. the preferred language types accomply with the chosen regions) then filter the language types, i.e. Token = "($LANGUAGE_FULL title)"
- -> if the user has preferred title types then filter by them, else discard the title completely
- implement better pagination control (move left, move right, middle: current page / total pages -> dropdown)
- scrape plotkeywords
- show
- filter
- scrape full plot summary from /plotsummary (find the correct one using the summary text from main page)
- show full plot summary when item is selected
- Tabbed view (either sidebar or horizontal tabs)
General
- Media Player Path
- MediaInfo Path
- Last Access retention (seconds)
- Update on Twins by filename + filesize
- Update on Twins by IMDB ID
Cinema
- Source Paths
Series
- Source Paths
-
as soon as a tbl_Movies entry is written, also write Name
-
min/maxAge is false when 0 is in place
- Analyze the call App.vue -> store.rescan(onlyNew); -> node functionality without IPC or whatever
- sort by last_access faulty after introduction of 2nd sort criteria (name)
- *Dialog movie list: don't use mk-clickable on the whole list
- use " »" indicator on MediaList for expandable sections of text (e.g. plot keywords, people etc.)
- Show movie list in dialogs, e.g. PersonDialog
- remove "SEE" from attributes, check other candidates
- update 5-star rating to 5-star with half-steps rating, see also: https://www.npmjs.com/package/vue-star-rating https://jsfiddle.net/craig_h_411/992o7cq5/
- update "copy info"
- update "my ratings" filter
- calculate and show ETA during rescan
- cancel during rescan (also cancel MediaInfo activity)
- include IMDB ID in search space (i.e. you can type/copy an IMDB ID in the search field and get results)
- enhance scrapeIMDBParentalGuideData with PG-Codes (use tbl_AgeRatings)
- FullScreen toggle
- via button + tooltip
- via F11 key
- add button for Years filter "SET RANGE"
- implement store.setSetting with SQLite's
ON CONFLICT
method - use user-defined language for localized numbers
- provide scraping details in snackbar during rescan
- use markdown for history
- update preparation notes
- App: show search only when in medialist
- App: show filters only when in medialist
- App: ask before delete (mdi-delete items)
- re-browse Source Path
- calculate video resolution by multiplying width and height and use the megapixels
- review https://nklayman.github.io/vue-cli-plugin-electron-builder/guide/security.html
- re-enable websecurity
- Settings: allow writeable text fields for VLC and Mediainfo (or edit button)
- Settings: IMDB Demographics are not translated
- autodetect mediaplayer: MacOS: check if /Applications/VLC.app/Contents/MacOS/VLC exists, and use this
- investigate binary signing for MacOS release
- pin versions
- translate eventBus.scanInfoShow
- block any IMDB scan when one is already in progress
- check if built release also opens up a port (it doesn't)
- check AppImage usage (storing to ~/.media-hoarder should be possible)
- remove Series in menus and Settings (it will be implemented later)
- Settings: user-defined log level (stored in db)
- Fine-tune some text colors
- Dialogs: define v-dialog as scrollable where applicable
- Settings: provide dialog before removal for
- Regions
- Languages
- Title Types
- Release Attributes
- List Dialog layout
- Optimize Dialogs: scrollable content, fixed header and footer
- implement minimumWaitForSetAccess with a defaut value of 60 (seconds)
- mediainfo-rar not needed anymore: Mediainfo is also able to scan inside .rar files
- dont import "See full summary>>"
- implement fetchFilter IMDB/Metacritic Score
- implement Company filter by Company Name instead of ID
- -> call companyDialog via eventBus when company is clicked in searchDialog
- -> some numbers mismatch (filter and main list)
- MediaList: when changing a page, autoscroll up?
- Rescan: only 1 button on sidenav, show dialog to choose "only new" or "compete" rescan
- Trailer Player with Video.js (extract video source from imdb trailer page)
- -> MediaList showTrailerLocal
- remember "sort by" setting (same as remembering the filters)
- -> "sort by" is destroyed upon reload after adding/removing entry to a list
- remember last page (same as remembering filters)
- Remove movie from list -> Reload -> List is unchecked (why?)
- filescan new fields:
- size (display humanized e.g. 13.5 GB, 760 MB)
- creation date
- bottom bar should adjust to sidenav (we have its z-index at 100 now)
- filter by Person or Company: this should deselect all Persons and only select the one Person chosen (same with companies)
- MultiPart: interpret "1_2" as "(1/2)"
- exit menuitem
- fix Age Rating filter (undetermined yields no results -> see filterParentalAdvisory)
- fix duplication check in filescan, e.g.
Audition ~ Ôdishon (De)(Sub De)(HD)[1999][Drama, Horror, Mystery][7.2 @ 65149][tt0235198].mkv
- MediaInfo Scan: add to tbl_Movies_Languages (Audio, Subtitle)
- add Audio- and Subtitle Filters in App.vue
- add as filter
- implement "add to watchlist button"
- -> Implemented as arbitrary lists
- see data/maskPlay.pdn/png
- embedded as base64 with https://www.base64-image.de/
- add "isExtraOf" relation for tbl_Movies
- -> don't count Extras (e.g. in filters)
- -> don't show Extras in main list
- -> show Extras in expanded item
- -> implement extra detection in rescan (determine to which movie the extra must be assigned to, e.g. multiple releases of the same movie, maybe work with IMDB id but also with parts of the Name)
- in movie details
- as sortable
- set after predefined time
- Parental Guidance (Sex/Nudity, Gore etc. scores)
- Company (Search-filter)
- Person (Search-filter)
- Year
- Quality
- People (Search-filter)
- Age
- Own Rating
- IMDB Rating
- Metacritic
- Metacritic Score
Sort by:
- Name
- Own Rating
- IMDB Rating
- Metacritic Score
- Source Path dialog
- -> prefill Description with directory name?
- "loader" on SourcePath removal (it may take some time)
- sourcePath: check for removed files
- minimumWaitForSetAccess (update Access datetime after ... seconds)
- scrape from IMDB
- find out a way to display the "top 5" companies involved
- Metacritic Score
- show more information
- add Content Advisory (Sex & Nudity, Gore etc.)
- allow to re-assign new IMDB entry
- -> opens IMDB search (store/scrapeIMDBAdvancedTitleSearch)
- perform rescan after re-assign (only this movie)
- refactor rescanMoviesMetaData (we need to differentiate mediainfo metadata and imdb metadata, we don't need findIMDBtconst when id_Movies is provided)
- Enter should "OK" the dialog
- Esc should "Cancel" the dialog
Dialog.vue
OK - Enter
OK - Esc
- CompanyDialog.vue
N/A - Enter
OK - Esc
- ListDialog.vue
OK - Enter
OK - Esc
- LocalVideoPlayerDialog.vue
N/A - Enter
OK - Esc
- PersonDialog.vue
N/A - Enter
OK - Esc
- ScanOptionsDialog.vue
OK - Enter
OK - Esc
- SearchDataDialog.vue
N/A - Enter
OK - Esc
- LinkIMDBDialog.vue
N/A - Enter
OK - Esc
- VideoPlayerDialog.vue
N/A - Enter
OK - Esc
- person dialog: fix photo url
- (hot reload) search filter is active but not shown in search text box
- MediaList: disable "IMDB relink" button when scan is in progress
- IMDB Scraper: on a German IP, we still get the German title as Primary Title even though we Select All languages to English
- use "Accept-Language": "en" header on all calls to IMDB
- Linux version doesn't fetch data / endless loop? (in our test VM)
- test in livecd (successful, fetch from web is working as expected) -> we assume there is an issue with the VM
- Title determination (Regional, Primary, Secondary)
- vue-i18n: Value of key 'LanguageNames.N'Ko' is not a string!
- duplicate detection fails at special characters: e.g. "adams aebler"n
- Settings -> Languages: languages aren't translated in the list
- Settings -> Regions: regions aren't translated in the list
- Settings -> Release Attributes: don't allow sorting
- imdb scraper: make sure, all texts are treated with html2text, see "Robot & Frank"
- single-item rescan doesn't update IMDB data? -> "Robot & Frank" -> misconcenption: actually an already removed duplicate provided the false names
- complete rescan of movie with extras leads to multiple duplicates and extras added to main list
- filescan: extras naming (see: "Die Üblichen Verdächtigen", "Vertigo")
- we now derive the Extra name from the filename and assign it to the primary name
- filescan: skip IMDB metadata retrieval for Extras, i.e. filename contains " - extra"
- Remove Source Path: Do you really want to remove the source path {Path} ({MediaTypeUpper}) including all associated media? (This does not delete any actual files)
- delete entries with isRemoved = 1 after successful rescan
- i18n: mixed up languages with i18n and moment
- re-assigning IMDB doesn't clean up some metadata
- tbl_Movies_Genres
- tbl_Movies_IMDB_Companies
- tbl_Movies_IMDB_Credits
- tbl_Movies_IMDB_Filming_Locations
- tbl_Movies_IMDB_Plot_Keywords