region problem with AutoBouquetMaker

[Ojustaboo]

Hi all, probably me being stupid.

Using ViX on a Quad.

All I want is Freesat channels and I want the Anglia region.

Under Crossepg OpenTV providers, I have selected "Sky UK Open TV (Astra 2 on 28.2")

Under Service searching / AutoBouquetMaker I have it set as follows

CONFIGURE:
Setup mode: Expert
Scheduled Scan: yes
Time of scan to start: 01:00
Repeat how often: Daily
Keep all bouquets: no
Add provider prefix to bouquets: no
Place bouquets at: Top
Show in extensions: no

I presume by scanning daily, it will pick up any channels that have changed before my lovely wife moans that she cant find them :)

PROVIDERS:
Everything is set to "no" except the following

Freesat: yes
Freesat area: England HD - East (E) / Anglia E
Freesat generate main bouquet: yes
Freesat generate sections bouquet: yes
Freesat generate HD bouquet: yes
Freesat generate FTA bouquet: yes

However if I go into the epg (graphical or the one using the up/down cursor keys) it shows channel 101 as BBC 1 London instead of BBC 1 East

I've played around with this for months, occasionally after rebooting it does change 101 to East, but a few days later it will revert to London again.

Not a big deal of course, but would be nice to sort out.

On the same lines, the epg always seems 100% correct in the evening, however often it goes weird during the morning. For example an hour ago it was correctly telling me that "More 4 +1" had a film on called "desert Fox" however, even though this was also showing on "More 4", "more 4 "had "Father Ted" listed.

Many thanks

[abu baniaz]

Best to have separate threads for separate issues.

I have tested with a TM Nano on Zeus 007 and can confirm your issue. A bug report will be raised for the ABM issue.

section from debug log


action -> SetupActions save
unknown action SetupActions/save! typo in keymap?
KEY: 399 GREEN
action -> ColorActions green
[AutoBouquetsMaker] AutoBouquetsMaker Schedule Disabled at Fri 21 Mar 2014 15:39:52 GMT
[ePNG] couldn't open /usr/share/enigma2/skin_default/autobouquetsmaker/configure.png
[ePNG] couldn't open /usr/share/enigma2/skin_default/autobouquetsmaker/opentv.png
[ePNG] couldn't open /usr/share/enigma2/skin_default/autobouquetsmaker/reorder.png
[ePNG] couldn't open /usr/share/enigma2/skin_default/autobouquetsmaker/download.png
[ePNG] couldn't open /usr/share/enigma2/skin_default/autobouquetsmaker/dbinfo.png
[ePNG] couldn't open /usr/share/enigma2/skin_default/autobouquetsmaker/about.png
KEY: 108 DOWN
KEY: 108 DOWN
KEY: 108 DOWN
KEY: 108 DOWN
KEY: 352 OK
action -> SetupActions ok
[SKIN] Parsing embedded skin <embedded-in-'AutoBouquetsMaker'>
KEY: 352 OK
[Manager] Loading settings...
[BouquetsReader] Reading lamedb...
[BouquetsReader] Read 0 transponders and 0 services
[Manager] Done
[AutoBouquetsMaker] Search NIM for orbital position 282
opening frontend 0
[AutoBouquetsMaker] Nim found on slot id 0 with sat 28.2E Eutelsat 28A & Astra 2A/2E/2F
allocate demux
(0)tune
RotorCmd ffffffff, lastRotorCmd ffffffff
prepare_sat System 0 Freq 12207000 Pol 1 SR 27500000 INV 2 FEC 2 orbpos 282 system 0 modulation 1 pilot 2, rolloff 0
tuning to 1607 mhz
OURSTATE: tuning
[SEC] set static current limiting
[SEC] invalidate current switch params
[SEC] setVoltage 1
[AutoBouquetsMaker] TUNING
[SEC] sleep 10ms
[SEC] setTone 1
[SEC] sleep 10ms
[SEC] update current switch params
[SEC] startTuneTimeout 5000
[SEC] setFrontend 1
setting frontend 0
(0)fe event: status 0, inversion off, m_tuning 1
(0)fe event: status 19, inversion off, m_tuning 2
OURSTATE: ok
[SEC] sleep 500ms
[AutoBouquetsMaker] ACQUIRING TSID/ONID
[Manager] Reading freesat (freesat_110_13)...
[DvbScanner] Adapter 0
[DvbScanner] Demuxer 0
[DvbScanner] Frontend 0
[DvbScanner] DVBType dvbs
[DvbScanner] NIT pid: 0x10
[DvbScanner] NIT current table id: 0x40
[DvbScanner] NIT other table id: 0x41
[DvbScanner] SDT pid: 0x11
[DvbScanner] SDT current table id: 0x42
[DvbScanner] SDT other table id: 0x46
[DvbScanner] BAT pid: 0xf01
[DvbScanner] BAT table id: 0x4a
[DvbScanner] Reading transponders...
main thread is non-idle! display spinner!
[DvbScanner] Added/Updated 80 transponders with network_id = 0x20
[DvbScanner] Reading services...
[DvbScanner] Read 211 services with bouquet_id = 0x110
[DvbScanner] Reading services extra info...
[DvbScanner] Read extra info for 200 services
[Manager] Done
[SEC] set dynamic current limiting
[Manager] Saving... to keep: ['userbouquet.favourites.tv']
[Manager] Radio bouque
[Manager] Bouquets to hide: {}
[Manager] TV bouquetsts to keep: ['userbouquet.favourites.radio']
[Manager] Add provider prefix to bouqets: False
[BouquetsWriter] Writing lamedb...
[BouquetsWriter] Wrote 80 transponders and 200 services
main thread is non-idle! display spinner!
[BouquetsWriter] Writing freesat bouquet...
[BouquetsWriter] Done
[BouquetsWriter] Writing bouquets index...
[BouquetsWriter] Done
[Manager] Done


Thanks for reporting.

Thread moved to image support section.

[abu baniaz]

@Ojustaboo
Are you still having this issue?

Just tried it again, but can't reproduce the issue.

[Ojustaboo]

Yes, but it's random.

Yesterday 101 was BBC London, today it's correctly BBC East.

It's not a big problem, only when I want to watch local news. I only record off BBC HD anyway, and those few times I do want to watch local news, if it's not 101, I just scroll down and find it where all the other BBC one region channels are.,

I altered the auto scan to 6:30 am a few weekss ago to see if that helped as usually if I run a manual scan it fixes the problem for that day (but not always), hence thought maybe a later auto update might help but but it didn't

[Ojustaboo]

This morning it has reverted to BBC London (using Apollo 15 but has done it for months)

Here's the Cursor up/down EPG before I did a Autobouquetmaker scan

35924



Here's the Graphical EPG before I did the scan

35925



Here's the scan in progress (I know it says 0 found that's because it only finds things in the last bit, it did find them all)

35926



Hers the Graphical EPG after the scan now correctly showing BBC East

35927



Here's the up / down cursor epg wrongly showing BBC London after the scan

35928


I pressed "Provider" (Yellow button) on the up / down EPG and had one option, BSKYB, I selected that, I then clicked on "Favourites" (Blue Button" and selected "All Channel;s"
and it now correctly shows East. I didn't do this combination for any particular reason, just pressed a few buttons to try and get it to fix it's self as the cursor up/down EPG seems to need some sort of refresh after the graphical EPG is correct.



Now correct

35923


And it's 50/50 whether it will still be correct tomorrow or it will revert to London and I have to do the same as today. As I said in my previous post, yesterday it correctly showed BBC East, today for no reason it didn't.



Here's my Autobouquet provider screen

35929



Here's my Autobouquet setup screen

35930

[abu baniaz]

You can grab screenshots using the following address on your browser. Change IP to match your receiver.


http://192.168.x.xx/grab?format=jpg


I'll re-open the bug report, would you mind enabling debug logs. Upload them here after a "failed run"

[Ojustaboo]

Todays the first time it's done it since my previous post.


36154

Debug list attached as requested.

Note: I tried to view the log on the Quad in the Log manager screen, pressing green to view, and it rebooted, which I suspect is the "Segmentation fault" that's the last entry in the log.

I just rebooted the box

36155

Then ran the autobouquet scan

36156

And this time, after the scan it still says BBCLondon

36157

And as you can see it's correctly set in Autobouquets settings

36158

This has happened numerous times in the past, it reverts to BBCLondon and for a while wont change back, it could be that I run the Autobouquet scan in a couple of hrs and it will fix it's self. or could be a couple of days before a manual scan sorts it's self out. I've had it stay on BBCLondon for days in the past even though it auto scans every morning.

36159

I've attached the original debug log and the one since the reboot just now.

[Ojustaboo]

This mornings 6 am scheduled scan didn't fix it

36173

However I just ran autobouquet scan and it has fixed it. Weird

36174

[Peterj]

Can you download (ftp) from your box and post lamedb and autobouquets.....main.tv (zip them both) from \etc\enigma2 in both situations?
Then we can compare what is different.

[Ojustaboo]

Did it again today. Again sometime it can go days and be fine

36188

36189

I ftp's the files yesterday into a folder called "Working correct Thursday"
I ftp'd the files today when it had reverted to London (after the 6am scheduled scan) into a folder called "Not working Friday morning"
I then ran the autobouquet scan which fixed it and ftp'd the files into a directory called "Working correctly Friday after just doing a scan"

[Peterj]

I see it puts the wrong service in line 204 of the autobouquet.sat_freesat.main.tv file.
204: #SERVICE 1:0:1:189d:7fd:2:11a0000:0:0:0: (= BBC One Lon) wrong.
204: #SERVICE 1:0:1:2842:7fe:2:11a0000:0:0:0: (= BBC One East E) correct.
The rest seems to be ok.
The only thing I can think of, is that the wrong LCN is read from the stream at that moment.
We need to make a debug mod in ABM to see what is happening when ABM is reading the streams.
We let you know what's next.

[Peterj]

Copy bouquetswriter.py to /usr/lib/enigma2/python/Plugins/SystemPlugins/AutoBouquetsMaker/scanner
rename the bouquetswriter.pyo (So you can put it back later).
Restart enigma2. (the py will be compiled to a pyo)

After an ABM scan it creates 4 abm..... .log files in /tmp.
Can you post me a set when scan was ok and a set when scan was wrong?

[Ojustaboo]

It was fine today, I looked in /tmp and those files weren't there.

So I tried a manual Autobouquet scan and it causes Enigma2 to restart now, I've tried it a couple of times.

Looking at the crash and debug logs, new ones were created just after the autoscan kicked off the last two mornings, so I don't thik it's scanned at all.

some (latest) debug and all crashlogs attached

[Peterj]

Please try this one.
Are you up te date with image?

[Ojustaboo]

I should be up to date , I updated very recently. Tried updating and it says feeds are down for maintenance.

here's the info page


36249

New version works fine, just run the scan, correctly saying BBC East, 4 files created in /tmp which I've copied across. Will upload them when it next fails.

many thanks for all your halp

[Ojustaboo]

BBCLondon again this morning

36256

Yesterdays and todays files attached (tmpfiles.zip)

Edit: Just did another scan and that fixed it, also attached (tue fixed.zip)

36258

[judge]

Are you pulling the plug, getting power cuts or box crashing before saving E2 settings?

[Ojustaboo]

Not sure what you mean by before saving the settings. But no, the box is on without crashing, without rebooting for days or weeks at a time.

[Peterj]

thx, I found something.
Would like to do so more debugging.
Can you place the 2 files in the same folder. (bouquetswriter.py is now the original again)
It creates now 2 log files in tmp.

[Ojustaboo]

Did it again this morning.

Just want to clarify something. Past few days the auto scan at 6am has changed it to BBCLondon, me doing a manual scan has changed it back to BBCEast. But this doesn't always happen. Sometimes for a week or more the autoscan correctly has BBCEast, sometimes if it has BBCLondon, running a manual scan doesn't fix it.

In my first post you can see I had the autoscan set for 1am, I changed it to later as I was getting up around 6, finding it said BBCLondon, ran a manual scan and it fixed it, hence I initially thought something was wrong with wherever the data came from at 1am, but this turned out to be pure coincidence

As you can see, my post no 5 was on the 14th, the next time it happened (post no 7) was 9 days later on 23rd.

It seems to go thorough phases, sometimes it's stuck on BBCLondon for days at a time and a manual scan doesn't fix, other times it's correct for days at a time.

Today when I got up (after 6am scan)

36274


Today after manual scan

36275


I installed the files as requested yesterday and rebooted.

I copied the files across from yesterday (working fine) and both sets of files today. Please see attached.

Many thanks for all your help in this

[Peterj]

Please try this.

[Ojustaboo]

Two days it's been fine. Will let you know if the problem returns.

many many thanks for all your help in this

[Peterj]

When I did it right, it shouldn't happen again.
Can you send me the 2 log files?

[Ojustaboo]

There aren't any in /tmp ?

[Peterj]

when you run it manually?

[Ojustaboo]

Ah, sorry, I should have checked better, it's causing Enigma2 to restart, that's why there's no logs.

Crashlogs from two attempts I just did and 6am this morning attached

[Peterj]

Please try this.
Run it manually.
When it does run, you should have 2 log files and there must be some lines in the ABM log starting with:
[DvbScanner]PJE.......

[Ojustaboo]

Hmm, it's created two files but I cant find the lines you were looking for, see attached

Thanks

[Ojustaboo]

Today it's back to BBCLondon but when I woke up, the LCD just had a line through it rather than the clock, and I powered off to reset it without thinking, hence lost those /tmp files

However after a manual scan it still says BBCLondon, /tmp files attached

After autoscan

36369

After manual scan

36370


EDIT: Just ran another manual scan and this time its worked (/tmp files attached)

36372

[Peterj]

Try these both again.
Before scanning delete the freesat all channels bouquets manualy.
It makes now 6 logs.

[Ojustaboo]

I presume you mean remove all the autobouquet.sat_freesat... files in /etc/enigma2 ?

[Peterj]

It can be done in normal screen favorites.
Navigation up,
blue button favorites,
highlight the bouquets you want to delete,
menu button,
choose delete bouquets.

Only all channels is necessary.

[Ojustaboo]

As requested

Thanks

[Ojustaboo]

oh, the above scan correctly had BBCEast

[abu baniaz]

@Ojustaboo
Is everything working fine now? Reason for asking is that if yes, the changes that @PeterJ has made can be made permanent.

Thanks.

[Ojustaboo]

So far yes it's been 100% fine thanks.

Hopefully it's permanently fixed, in the past sometimes it would work for a week or two before reverting.

ps, the changes place a few files in /tmp, not sure if you want to make that permanent or not.

many thanks for al the help

[Peterj]

Here are the 2 files without creating the debug logfiles.
Also fixed a small issue I found.
Let's try it for 2 weeks.

Copy bouquetswriter.py which must be chmod 755 to /usr/lib/enigma2/python/Plugins/SystemPlugins/AutoBouquetsMaker/scanner
rename the bouquetswriter.pyo (So you can put it back later).
Restart enigma2. (the py will be compiled to a pyo)

[Ojustaboo]

Not sure if the small issue is related to my problem, but I haven't installed the above yet and my problems back :(

36487

But it does mean I also have the log files, see attached

Do you want me to go ahead and install the files from yesterday?

Many thanks

[Peterj]

Do you want me to go ahead and install the files from yesterday?

Many thanks

yes, please.

[Ojustaboo]

So far it's working, but I've noticed one small issue.

If you look at any of my above pics regardless of whether BBCLondon or BBCEast, the bottom channel on the first page is always BBCHD.

This works great as I watch BBCHD all the time when it's not things like the news.

Since the latest file, that's changed to BBC Alba

36505

and BBCHD is now right at the end in amongst all the various other regions

36506

36507

[Peterj]

That's possible
The issue is that somehow 5 channels gets 2 channel numbers reading the provider's stream.
BBC One East E 953, 101
BBC One HD 108, 972
BBC One Lon 101, 950
Channel 4 +1 121, 975
Channel 4 104, 974
The result was double records in the bouquets and/or random overwritten records.

I made a mod that it only uses 1 of the channels numbers.
Because you said 'BBC One East E' should be on position 1, I choose the last of the 2 values.
The result is 'BBC One HD' is not on position 108 and 972 anymore, but only on 972.

If you want to swap channels, you can do it in the sat_freesat.xml file.
(for example look into the sat_sky_england.xml file.)

[Ojustaboo]

13 days and totally fine :)