FTP and parser errors with OpenVix #24
Comments
|
Sorry, platform: Linux Other DE (Cinnamon); Architecture: X86_64 |
|
Thank you Can you confirm that you are using version 1.5? Unfortunately the log you provided me is a very small part of the log, if you can upload it in full it would be very helpful. Those FTP errors are due to the presence of directories (from decoder) in the bouquets directory. To overcome these errors file listing with a more advanced FTP command is used. It seems that the decoder Set-Top-Box does not have the FTP listing MLSD command, the software fallback to NLST listing. As I do not have the interesting log part, I cannot know. This command was introduced in the software since version 1.1.1 Please consider that I do not have a ZGemma H7S decoder, I tested on an Edision decoder and the FTP command works. These FTP errors are - as returned - by the Curl library, used in the software:
In brief: you can ignore them, those files are not bouquets and will not be downloaded. I did not want to create a whitelist or blacklist of files to download from the decoder, there may be other settings files that can be opened by the editor in the near future. This point can be re-evaluated, for example: if there are files that are denied access by the decoder. It would be interesting to understand if your decoder supports the FTP listing MLSD command or if an error of some kind has occurred. The FTP log would be useful. If you want provide it, follow the online help to "Enable FTP debug", Troubleshooting page. If you send the log with FTP debug, please omit the connection parameters to your decoder. As for parsing errors it could be a bouquet filename error, since version 1.3, the filename should no longer be a problem. To better investigate the parsing issue it would be useful to have the list you used, if possible.
Are they public lists? Last thing, regarding the picons, currently the software does not download and upload the picons via FTP. Picons are managed by folder in the local filesystem. I am evaluating this point, considering that it is inconvenient and slow to download and load the picons file by file into the decoder, while it is more convenient and fast to upload a Zip file to decompress into the decoder. In the near future there may be an option to separately upload and download picons via FTP. |
|
Yes, I am using version 1.5 and apologies for not saying so. Thanks for the background info. I tried to upload a full log but it was too big (exceeded allowed 64k characters here) so I had to truncate it. I'll look at an FTP debug tomorrow but in case it's useful in the meantime: the ftp server is vsftpd. Here's the conf file (I don't have time to review right now) |
|
thanks You already told me version 1.5, I asked you for confirmation and it is OK. I am sorry, I may have told you something incorrect. I have the same server vsftpd on my test decoder, the difference is that my decoder software does not have sub-directories (AutoBouquetsMaker, etc.) on the bouquets directory. At the current state of version 1.5, those errors can be ignored, they are soft-errors and do not affect the download of bouquets from the decoder. I may re-evaluate the issue in future releases and ensure that those directories are excluded in any case. I agree with you that errors can bore users. The parsing issue is very important. I found the problem origin: If you want send FTP debug, you can use attachments here on GitHub: https://docs.github.com/en/get-started/writing-on-github/working-with-advanced-formatting/attaching-files Please, if you send FTP debug, omit host address, username and password. |
|
OK, that's one mistake apiece :-) Debug file attached. Any idea when the next release will be? Just wondering if you'll do a bugfix release or hold this until you have more things planned. If it's imminent I'll defer cleaning up my bouquets after an update to OpenViX I've just done unless you also assure me that there will be no negative effect on uploading to my system. Sorry I couldn't get to this earlier. |
|
Thank you very much. The problem has already been fixed in the next coming commit, it is in the works. I found info about the 519 flag, they are hidden userbouquets. It seems that there is not widespread support for this flag by decoders STB, maybe by some plugins. In any case bouquets should be parsed if there are no big incompatibilities, you have done an excellent issue reporting. The next release may take some time, in the meantime you can act in different ways:
This thing:
Side effects on your system are unlikely to occur, it is a use of software with a device. Consider that you are uploading your channel lists to a device via FTP, this may be considered an advanced use of your decoder. I do not know how the manufacturer's warranty on your decoder works. These lists of favorites are called userbouquets, there is the prefix user- because they are user lists. For example, the most negative effect could be compromised or partial lists. Favorites lists can jump either using software or using the decoder itself or a plugin or whatever. These are things can happen, acceptable side effects. It is not possible to guarantee anything, also due to the technical nature of loading channel lists to the decoder. It cannot be guaranteed by any software. In any case it is good practice to make a backup of channel lists before proceeding with changes. |
|
E-Channelizer? Hmm. I use Linux and only use one Windows app (MyLifeOrganized under WINE on a miniPC on my desk which acts as part of my local cloud). I've also downloaded and had a quick look at DemonEditor. I preferred the UI of your app and hoped to use it; haven't used any app for this so far beyond the web UI of the box, which uses OpenWebIf as do most Enigma2 STBs. The box is inexpensive and long past warranty. I can reflash it easily enough if ever necessary and, yes, of course, I can back things up. :-) I think the simplest solution will be to unhide the hidden bouquets. I suspect they're the Shopping, Children, Special Interest (religion) etc things I've hidden to declutter the screen. I'll check that and confirm just FYI. |
|
It was just an example... I really like DreamboxEdit ❤️ but it runs only on Windows. Unfortunately it takes a while to release, there are many things to check and check on each release. I hope to release soon as possible. |
|
Sharing this just in case it's useful. Suffice it to say that simply unhiding bouquets marked hidden was not enough. FYI the hidden (not displayed on screen) bouquets did, initially, appear to be things I marked "hide" -- apart from two which may be intrinsic to how channels are managed or numbered internally. That is, I presume they're not real bouquets at all userbouquet.abm.terrestrial_ie_saorview_PSB1.separator.tv userbouquet.abm.sat_282_freesat.separator.tv The bouquets with ".abm" in the name are generated by an Enigma2 extension called autobouquetsmaker (ABM) which runs at a scheduled time, usually overnight, on most boxes with it installed (picks up and handles satellite frequency shifts without user intervention). Existing hidden bouquets appeared to be zero length files corresponding to the original files (not sure about this). Just unhiding them and then running the download again didn't change anything in terms of download error messages. I deleted all "ABM" bouquets and the crossepg directory on the STB*, regenerated them and ran the download again. *CrossEPG extension is obsolete as of the upgrade of OpenViX from 6.4 to 6.6 and that will presumably apply to related Enigma2 versions (OpenATV, OpenPLI etc). INPUT: OUTPUT: The errors remained unchanged apart from the disappearance of that for crossepg. I've attached 4 screen grabs I took when trying to make sense of things using Beyond Compare The 400.tv, 500.tv and 998.tv lines correspond to bouquets for "Lifestyle", "Music" and "Freesat 4K" and what they appear to have in common, also with the separator.tv bouquets is that they contain no services. Screen grabs: directories.png comparison of saved files and those on STB I ran DemonEditor (which hung for me when I tried it at first) and compared the downloaded bouquets.tv files (png file attached). I'll try this for now but overall I still prefer e2satEditor's simpler user interface. |
|
Thanks
Yes, it could be used internally to hide them. In any case the line should be parsed by the software when it has userbouquet file. At the moment I do not know if this flag is used by decoders, plugins, scripts. I quickly searched in some forum posts, I found this issue where they talk about the flag: oe-alliance/AutoBouquetsMaker#74
This will be fixed in the next release. The error is due to the fact that listing with NLST command there are directories, this soft error is wanted with NLST, directories cannot be downloaded. Listing with MLSD command, directories are discarded but it is not supported everywhere. It show FTP error but it is negligible, a soft error that does not compromise the download. All userbouquets with flag other than 7 will not be parsed, there are parser errors and there is no userbouquet filename. This is the main issue.
Yes, from version 1.3 to version 1.5, it will not parse userbouquets marked with flag other than 7, it will only parse 1:7:X (X: 1 = TV, 2 = Radio). As I told you, version 1.2, if you want to try it, does not has this obstacle of the flag but other limitations and imperfections. Thanks for your time, much appreciated! I leave the issue open, as soon there is the new release I will let you know. |
|
Great, many thanks. |
Describe the bug
My first time running this (on Linux Mint 21.3), using OpenVix 6.4. on a ZGemma H7S: [UI looks good]
I changed the picon path to /media/hdd/picon
I don't recall where I found advice on installing picons but I did it with FTP not using an extension (didn't know it was an option).
Downloading from my system I get the following errors
Errors during FTP operations (e2SAT editor and Openix 6.4)
I don't know the significance of the first 4 yet, but the next 4 seem wrong or misleading. The "files" listed are directories and they do exist. What am I missing?
Steps to reproduce
...
Make an FTP download from OpenVix 6.4
Expected behavior
No FTP errors (I am reluctant to write data back to the box with errors on download).
I'd like to know what to do to -- if necessary -- revert to a default set of bouquets.
Software version
1.5
Download medium
GitHub Releases page
Platform running
I don't know
Architecture running
I don't know
Other (please specify)
Desktop environment is Cinnamon.
DVB-S/2 source is Astra 28.2E; DVB-T sources is Saorview
Additional context
FTP download
Contents of /etc/tuxbox
Contents of bouquets.tv
#NAME Bouquets (TV) #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.abm.terrestrial_ie_saorview_PSB1.main.tv" ORDER BY bouquet #SERVICE 1:519:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.abm.terrestrial_ie_saorview_PSB1.separator.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.abm.terrestrial_ie_saorview_PSB1.hd.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.abm.terrestrial_ie_saorview_PSB1.ftahd.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.abm.terrestrial_ie_saorview_PSB1.fta.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.abm.sat_282_freesat.main.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.abm.sat_282_freesat.101.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.abm.sat_282_freesat.200.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.abm.sat_282_freesat.300.tv" ORDER BY bouquet #SERVICE 1:519:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.abm.sat_282_freesat.400.tv" ORDER BY bouquet #SERVICE 1:519:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.abm.sat_282_freesat.500.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.abm.sat_282_freesat.600.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.abm.sat_282_freesat.650.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.abm.sat_282_freesat.700.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.abm.sat_282_freesat.800.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.abm.sat_282_freesat.949.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.abm.sat_282_freesat.970.tv" ORDER BY bouquet #SERVICE 1:519:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.abm.sat_282_freesat.998.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.abm.sat_282_freesat.999.tv" ORDER BY bouquet #SERVICE 1:519:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.abm.sat_282_freesat.separator.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.abm.sat_282_freesat.hd.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.woodlandstv__tv_.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.de00.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.de01.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.de02.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.de03.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.de04.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.de05.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.de06.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.de07.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.de08.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.de09.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.de10.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.de11.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.de12.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.de13.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.de14.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.de15.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.LastScanned.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.bskyb__tv_.tv" ORDER BY bouquetContents of bouquets.radio
#NAME Bouquets (Radio) #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.abm.terrestrial_ie_saorview_PSB1.main.radio" ORDER BY bouquet #SERVICE 1:519:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.abm.sat_282_freesat.main.radio" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.de00.radio" ORDER BY bouquet #SERVICE 1:519:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.de01.radio" ORDER BY bouquet #SERVICE 1:519:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.de02.radio" ORDER BY bouquetBouquets (*.tv)
bouquets.tv userbouquet.LastScanned.tv userbouquet.abm.sat_282_freesat.101.tv userbouquet.abm.sat_282_freesat.200.tv userbouquet.abm.sat_282_freesat.300.tv userbouquet.abm.sat_282_freesat.400.tv userbouquet.abm.sat_282_freesat.500.tv userbouquet.abm.sat_282_freesat.600.tv userbouquet.abm.sat_282_freesat.650.tv userbouquet.abm.sat_282_freesat.700.tv userbouquet.abm.sat_282_freesat.800.tv userbouquet.abm.sat_282_freesat.949.tv userbouquet.abm.sat_282_freesat.970.tv userbouquet.abm.sat_282_freesat.998.tv userbouquet.abm.sat_282_freesat.999.tv userbouquet.abm.sat_282_freesat.hd.tv userbouquet.abm.sat_282_freesat.main.tv userbouquet.abm.sat_282_freesat.separator.tv userbouquet.abm.terrestrial_ie_saorview_PSB1.fta.tv userbouquet.abm.terrestrial_ie_saorview_PSB1.ftahd.tv userbouquet.abm.terrestrial_ie_saorview_PSB1.hd.tv userbouquet.abm.terrestrial_ie_saorview_PSB1.main.tv userbouquet.abm.terrestrial_ie_saorview_PSB1.separator.tv userbouquet.bskyb__tv_.tv userbouquet.de00.tv userbouquet.de01.tv userbouquet.de02.tv userbouquet.de03.tv userbouquet.de04.tv userbouquet.de05.tv userbouquet.de06.tv userbouquet.de07.tv userbouquet.de08.tv userbouquet.de09.tv userbouquet.de10.tv userbouquet.de11.tv userbouquet.de12.tv userbouquet.de13.tv userbouquet.de14.tv userbouquet.de15.tv userbouquet.woodlandstv__tv_.tvBouquets (*.radio)
bouquets.radio
userbouquet.abm.sat_282_freesat.main.radio
userbouquet.abm.terrestrial_ie_saorview_PSB1.main.radio
userbouquet.de00.radio
userbouquet.de01.radio
userbouquet.de02.radio
Log
Screenshot
No response
The text was updated successfully, but these errors were encountered: