Hello Guest, if you are reading this it means you have not registered yet. Please take a second, Click here to register, and in a few simple steps you will be able to enjoy our community and use our OpenViX support section.

View Entry Info: Crash when folder contains filenames with Windows encoding

Category:
Possible Bug
What ViX Image build number are you using?
Please provide your ViX Team image build number. Menu > Information > About > Build number > ENTER THIS NUMBER e.g. 4.2.028
6.2.005
Have you tried a flash WITHOUT settings restore?
Have you tried this? PLEASE SELECT YES OR NO.
No
Have you tried a flash WITH settings restore?
Have you tried this? PLEASE SELECT YES OR NO.
No
Attachments
Page 2 of 2 FirstFirst 12
Results 16 to 20 of 20

Thread: Crash when folder contains filenames with Windows encoding

  1. #16
    abu baniaz's Avatar
    Title
    Moderator
    Join Date
    Sep 2010
    Location
    East London
    Posts
    22,561
    Thanks
    6,086
    Thanked 8,830 Times in 5,967 Posts
    This is how my one looks. I used your zip file.
    Attached Images Attached Images

  2. #17
    twol's Avatar
    Title
    Moderator
    Join Date
    Apr 2012
    Posts
    7,488
    Thanks
    910
    Thanked 2,604 Times in 1,997 Posts
    Quote Originally Posted by ocean View Post
    pöllö.mp4 is just empty file. Attached zipped folder. Windows is Finnish locale. I'd guess this is Python3 related issue..
    interesting in that when I unzip there are 2 files there pöllö.mp4 and a 2nd with the ö replaced by hex 94. On copying to the moves folder, both appear but the 2nd now shows as pll.mp4 with the hex characters stripped out. Both are accepted without a crash.
    Gigablue Quad 4K & UE 4K
    .........FBC Tuners:
    ------------------> DUR-Line DCR 5-1-8-L4 Multiswitch to 1.5M dish(28.2E)
    ------------------> Spaun SUS 5581/33 NFA Multiswitch to 80 cm dish(19.2E)
    .......................> FBC & DVB-S2X into 90cm dish (27.5W) Opticum robust Unicable LNB
    AX HD61, Edision Osmio 4K+, Zgemma H9Combo, Octagon SF8008 using Legacy ports on multiswitches
    Zgemma H9 C/S into Giga4K

  3. #18
    birdman's Avatar
    Title
    Moderator
    Join Date
    Sep 2014
    Location
    Hitchin, UK
    Posts
    7,255
    Thanks
    218
    Thanked 1,558 Times in 1,219 Posts
    Quote Originally Posted by ocean View Post
    pöllö.mp4 is just empty file. Attached zipped folder. Windows is Finnish locale. I'd guess this is Python3 related issue..
    Or a Windows one, since filenames are supposed to be utf-16(?).
    That filename shows up as pФllФ.mp4 on my Linux systems. (The Ф is a Cyrillic Capital Letter EF - Unicode U+0424.)

    But it is a valid utf-8 string (even if it doesn't look as you'd expect). Not sure why the ö (o with diaresis - U+00F6) should show up differently in different places, though.
    MiracleBox Prem Twin HD - 2@DVB-T2 + Xtrend et8000 - 5(incl. 2 different USBs)@DVB-T2[terrestrial - UK Freeview HD, Sandy Heath] - LAN/USB-stick/HDD

  4. #19
    birdman's Avatar
    Title
    Moderator
    Join Date
    Sep 2014
    Location
    Hitchin, UK
    Posts
    7,255
    Thanks
    218
    Thanked 1,558 Times in 1,219 Posts
    Quote Originally Posted by twol View Post
    interesting in that when I unzip there are 2 files there
    What unzip are you using?
    Mine finds one file and says so:

    Code:
    [parent]: unzip -l ../mymovies.zip  
    Archive:  ../mymovies.zip 
      Length      Date    Time    Name 
    ---------  ---------- -----   ---- 
            0  2022-06-23 16:44   mymovies/pФllФ.mp4 
    ---------                     ------- 
            0                     1 file
    And we disagree about the name which is there too.

    However, if I actually peep into the zip file the filename which is there is:
    p~ll~.mp4
    where both ~s are byte 0x94.
    Which in Unicode is a non-printable character. (CANCEL CHARACTER).
    Which might be what triggers the bugs.
    MiracleBox Prem Twin HD - 2@DVB-T2 + Xtrend et8000 - 5(incl. 2 different USBs)@DVB-T2[terrestrial - UK Freeview HD, Sandy Heath] - LAN/USB-stick/HDD

  5. #20
    birdman's Avatar
    Title
    Moderator
    Join Date
    Sep 2014
    Location
    Hitchin, UK
    Posts
    7,255
    Thanks
    218
    Thanked 1,558 Times in 1,219 Posts
    Quote Originally Posted by birdman View Post
    However, if I actually peep into the zip file the filename which is there is:
    p~ll~.mp4
    where both ~s are byte 0x94.
    Which in Unicode is a non-printable character. (CANCEL CHARACTER).
    Which might be what triggers the bugs.
    On reflexion 0x94, whilst being perfectly legal in an ext4 filename, is NOT legal utf-8.
    That should be the 2-byte sequence 0xc2 0x94.

    But ö is U+00f6 in Unicode, which is 0xc3 0xb6 in utf-8.

    Anything that looks at filesystem names (or, as in console output, might echo this back) has to be able to cater for the result being non-utf8 when decoded.
    So this might be what contributes to triggering the bugs.
    Last edited by birdman; 23-06-22 at 20:42.
    MiracleBox Prem Twin HD - 2@DVB-T2 + Xtrend et8000 - 5(incl. 2 different USBs)@DVB-T2[terrestrial - UK Freeview HD, Sandy Heath] - LAN/USB-stick/HDD

Page 2 of 2 FirstFirst 12

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
This website uses cookies
We use cookies to store session information to facilitate remembering your login information, to allow you to save website preferences, to personalise content and ads, to provide social media features and to analyse our traffic. We also share information about your use of our site with our social media, advertising and analytics partners.