Hello Guest, if you are reading this it means you have not registered yet. Please take a second, Click here to register, and in a few simple steps you will be able to enjoy our community and use our OpenViX support section.
Page 23 of 45 FirstFirst ... 13212223242533 ... LastLast
Results 331 to 345 of 667

Thread: Build my own Vix image

  1. #331
    Willo3092's Avatar
    Title
    ViX Beta Tester
    Join Date
    Oct 2016
    Location
    East Midlands
    Posts
    1,065
    Thanks
    752
    Thanked 403 Times in 303 Posts
    Finally building again after starting from scratch and altering a few things.
    Does anyone know what the optimum settings are for the following in site.conf? I'm assuming that they're dependent on your PC?

    BB_NUMBER_THREADS = "8"
    PARALLEL_MAKE = "-j 8"

    I have 2 PC's and it seems to be the lower spec one that I always seem to have issues with and wondered if it is the site.conf settings?

    System 9020.png System 7010.png

    Both are using SSD's.

  2. #332
    Huevos's Avatar
    Title
    Administrator
    Join Date
    Jun 2010
    Location
    38.5N, 0.5W
    Posts
    13,614
    Thanks
    2,006
    Thanked 4,947 Times in 3,269 Posts
    I'm guessing you want 16 threads.

    Here is mine...
    Code:
    BB_NUMBER_THREADS = "32"
    PARALLEL_MAKE = "-j 16"
    And the machine...
    Code:
    openvix@ubuntu01:~$ sudo lshw
    [sudo] password for openvix:
    ubuntu01
        description: Rack Mount Chassis
        product: System x3650 M3 -[7945D2G]- (XxXxXxX)
        vendor: IBM
        version: 00
        serial: KD89BA0
        width: 64 bits
        capabilities: smbios-2.5 dmi-2.5 vsyscall32
        configuration: boot=normal chassis=rackmount family=System x sku=XxXxXxX uuid=FD2801FA-2563-3F04-A0A2-360294A58D8F
      *-core
           description: Motherboard
           product: 90Y4784
           vendor: IBM
           physical id: 0
           version: (none)
           serial: 1550UR
           slot: Rear Bottom
         *-cpu:0
              description: CPU
              product: Intel(R) Xeon(R) CPU           E5620  @ 2.40GHz
              vendor: Intel Corp.
              physical id: 1
              bus info: cpu@0
              version: Intel(R) Xeon(R) CPU           E5620  @ 2.40GHz
              slot: Node 1 Socket 1
              size: 1596MHz
              capacity: 2394MHz
              width: 64 bits
              clock: 1571MHz
              capabilities: x86-64 fpu fpu_exception wp vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp kaiser tpr_shadow vnmi flexpriority ept vpid dtherm arat flush_l1d cpufreq
              configuration: cores=4 enabledcores=4 threads=8
            *-cache:0
                 description: L1 cache
                 physical id: 2
                 slot: Internal Cache Level 1
                 size: 32KiB
                 capacity: 32KiB
                 capabilities: asynchronous internal write-back data
                 configuration: level=1
            *-cache:1
                 description: L2 cache
                 physical id: 3
                 slot: Internal Cache Level 2
                 size: 256KiB
                 capacity: 256KiB
                 capabilities: asynchronous internal write-back unified
                 configuration: level=2
            *-cache:2
                 description: L3 cache
                 physical id: 4
                 slot: Internal Cache Level 3
                 size: 12MiB
                 capacity: 12MiB
                 capabilities: asynchronous internal write-back unified
                 configuration: level=3
         *-cpu:1
              description: CPU
              product: Intel(R) Xeon(R) CPU           E5620  @ 2.40GHz
              vendor: Intel Corp.
              physical id: 5
              bus info: cpu@1
              version: Intel(R) Xeon(R) CPU           E5620  @ 2.40GHz
              slot: Node 1 Socket 2
              size: 1862MHz
              capacity: 2394MHz
              width: 64 bits
              clock: 1571MHz
              capabilities: x86-64 fpu fpu_exception wp vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp kaiser tpr_shadow vnmi flexpriority ept vpid dtherm arat flush_l1d cpufreq
              configuration: cores=4 enabledcores=4 threads=8
            *-cache:0
                 description: L1 cache
                 physical id: 6
                 slot: Internal Cache Level 1
                 size: 32KiB
                 capacity: 32KiB
                 capabilities: asynchronous internal write-back data
                 configuration: level=1
            *-cache:1
                 description: L2 cache
                 physical id: 7
                 slot: Internal Cache Level 2
                 size: 256KiB
                 capacity: 256KiB
                 capabilities: asynchronous internal write-back unified
                 configuration: level=2
            *-cache:2
                 description: L3 cache
                 physical id: 8
                 slot: Internal Cache Level 3
                 size: 12MiB
                 capacity: 12MiB
                 capabilities: asynchronous internal write-back unified
                 configuration: level=3
         *-memory
              description: System Memory
              physical id: 9
              slot: System board or motherboard
              size: 8GiB
            *-bank:0
                 description: [empty]
                 physical id: 0
                 slot: DIMM01
            *-bank:1
                 description: [empty]
                 physical id: 1
                 slot: DIMM02
            *-bank:2
                 description: DIMM 1067 MHz (0.9 ns)
                 product: M393B5170FH0-CH9
                 vendor: Samsung
                 physical id: 2
                 serial: 51D47383
                 slot: DIMM03
                 size: 4GiB
                 width: 64 bits
                 clock: 1067MHz (0.9ns)
            *-bank:3
                 description: [empty]
                 physical id: 3
                 slot: DIMM04
            *-bank:4
                 description: [empty]
                 physical id: 4
                 slot: DIMM05
            *-bank:5
                 description: [empty]
                 physical id: 5
                 slot: DIMM06
            *-bank:6
                 description: [empty]
                 physical id: 6
                 slot: DIMM07
            *-bank:7
                 description: [empty]
                 physical id: 7
                 slot: DIMM08
            *-bank:8
                 description: [empty]
                 physical id: 8
                 slot: DIMM09
            *-bank:9
                 description: [empty]
                 physical id: 9
                 slot: DIMM10
            *-bank:10
                 description: [empty]
                 physical id: a
                 slot: DIMM11
            *-bank:11
                 description: DIMM 1067 MHz (0.9 ns)
                 product: M393B5170FH0-CH9
                 vendor: Samsung
                 physical id: b
                 serial: 65DE7E85
                 slot: DIMM12
                 size: 4GiB
                 width: 64 bits
                 clock: 1067MHz (0.9ns)
            *-bank:12
                 description: [empty]
                 physical id: c
                 slot: DIMM13
            *-bank:13
                 description: [empty]
                 physical id: d
                 slot: DIMM14
            *-bank:14
                 description: [empty]
                 physical id: e
                 slot: DIMM15
            *-bank:15
                 description: [empty]
                 physical id: f
                 slot: DIMM16
            *-bank:16
                 description: [empty]
                 physical id: 10
                 slot: DIMM17
            *-bank:17
                 description: [empty]
                 physical id: 11
                 slot: DIMM18
         *-firmware
              description: BIOS
              vendor: IBM Corp.
              physical id: 2f
              version: -[D6E150CUS-1.11]-
              date: 02/08/2011
              size: 128KiB
              capacity: 4032KiB
              capabilities: pci pnp upgrade shadowing cdboot bootselect edd int13floppy2880 int5printscreen int9keyboard int14serial int10video acpi usb ls120boot zipboot netboot
         *-pci:0
              description: Host bridge
              product: 5520 I/O Hub to ESI Port
              vendor: Intel Corporation
              physical id: 100
              bus info: pci@0000:00:00.0
              version: 22
              width: 32 bits
              clock: 33MHz
            *-pci:0
                 description: PCI bridge
                 product: 5520/5500/X58 I/O Hub PCI Express Root Port 1
                 vendor: Intel Corporation
                 physical id: 1
                 bus info: pci@0000:00:01.0
                 version: 22
                 width: 32 bits
                 clock: 33MHz
                 capabilities: pci msi pciexpress pm normal_decode bus_master cap_list
                 configuration: driver=pcieport
                 resources: irq:24 memory:96000000-99ffffff
               *-network:0
                    description: Ethernet interface
                    product: NetXtreme II BCM5709 Gigabit Ethernet
                    vendor: Broadcom Corporation
                    physical id: 0
                    bus info: pci@0000:0b:00.0
                    logical name: eth0
                    version: 20
                    serial: 5c:f3:fc:4d:11:14
                    size: 1Gbit/s
                    capacity: 1Gbit/s
                    width: 64 bits
                    clock: 33MHz
                    capabilities: pm vpd msi msix pciexpress bus_master cap_list ethernet physical tp 10bt 10bt-fd 100bt 100bt-fd 1000bt-fd autonegotiation
                    configuration: autonegotiation=on broadcast=yes driver=bnx2 driverversion=2.2.6 duplex=full firmware=bc 5.2.3 NCSI 2.0.10 ip=213.109.127.84 latency=0 link=yes multicast=yes port=twisted pair speed=1Gbit/s
                    resources: irq:24 memory:96000000-97ffffff
               *-network:1
                    description: Ethernet interface
                    product: NetXtreme II BCM5709 Gigabit Ethernet
                    vendor: Broadcom Corporation
                    physical id: 0.1
                    bus info: pci@0000:0b:00.1
                    logical name: eth1
                    version: 20
                    serial: 5c:f3:fc:4d:11:16
                    size: 1Gbit/s
                    capacity: 1Gbit/s
                    width: 64 bits
                    clock: 33MHz
                    capabilities: pm vpd msi msix pciexpress bus_master cap_list ethernet physical tp 10bt 10bt-fd 100bt 100bt-fd 1000bt-fd autonegotiation
                    configuration: autonegotiation=on broadcast=yes driver=bnx2 driverversion=2.2.6 duplex=full firmware=bc 5.2.3 NCSI 2.0.10 ip=192.168.0.20 latency=0 link=yes multicast=yes port=twisted pair speed=1Gbit/s
                    resources: irq:32 memory:98000000-99ffffff
            *-pci:1
                 description: PCI bridge
                 product: 5520/5500/X58 I/O Hub PCI Express Root Port 2
                 vendor: Intel Corporation
                 physical id: 2
                 bus info: pci@0000:00:02.0
                 version: 22
                 width: 32 bits
                 clock: 33MHz
                 capabilities: pci msi pciexpress pm normal_decode bus_master cap_list
                 configuration: driver=pcieport
                 resources: irq:25 memory:92000000-95ffffff
               *-network:0 DISABLED
                    description: Ethernet interface
                    product: NetXtreme II BCM5709 Gigabit Ethernet
                    vendor: Broadcom Corporation
                    physical id: 0
                    bus info: pci@0000:10:00.0
                    logical name: eth2
                    version: 20
                    serial: 5c:f3:fc:3a:38:b0
                    capacity: 1Gbit/s
                    width: 64 bits
                    clock: 33MHz
                    capabilities: pm vpd msi msix pciexpress bus_master cap_list ethernet physical tp 10bt 10bt-fd 100bt 100bt-fd 1000bt-fd autonegotiation
                    configuration: autonegotiation=on broadcast=yes driver=bnx2 driverversion=2.2.6 duplex=half firmware=bc 4.6.4 NCSI 1.0.3 latency=0 link=no multicast=yes port=twisted pair
                    resources: irq:25 memory:92000000-93ffffff
               *-network:1 DISABLED
                    description: Ethernet interface
                    product: NetXtreme II BCM5709 Gigabit Ethernet
                    vendor: Broadcom Corporation
                    physical id: 0.1
                    bus info: pci@0000:10:00.1
                    logical name: eth3
                    version: 20
                    serial: 5c:f3:fc:3a:38:b2
                    capacity: 1Gbit/s
                    width: 64 bits
                    clock: 33MHz
                    capabilities: pm vpd msi msix pciexpress bus_master cap_list ethernet physical tp 10bt 10bt-fd 100bt 100bt-fd 1000bt-fd autonegotiation
                    configuration: autonegotiation=on broadcast=yes driver=bnx2 driverversion=2.2.6 duplex=half firmware=bc 4.6.4 NCSI 1.0.3 latency=0 link=no multicast=yes port=twisted pair
                    resources: irq:33 memory:94000000-95ffffff
            *-pci:2
                 description: PCI bridge
                 product: 5520/5500/X58 I/O Hub PCI Express Root Port 3
                 vendor: Intel Corporation
                 physical id: 3
                 bus info: pci@0000:00:03.0
                 version: 22
                 width: 32 bits
                 clock: 33MHz
                 capabilities: pci msi pciexpress pm normal_decode cap_list
                 configuration: driver=pcieport
                 resources: irq:26
            *-pci:3
                 description: PCI bridge
                 product: 5520/X58 I/O Hub PCI Express Root Port 5
                 vendor: Intel Corporation
                 physical id: 5
                 bus info: pci@0000:00:05.0
                 version: 22
                 width: 32 bits
                 clock: 33MHz
                 capabilities: pci msi pciexpress pm normal_decode bus_master cap_list
                 configuration: driver=pcieport
                 resources: irq:27 memory:9ba00000-9bbfffff
               *-network:0 DISABLED
                    description: Ethernet interface
                    product: 82580 Gigabit Network Connection
                    vendor: Intel Corporation
                    physical id: 0
                    bus info: pci@0000:1a:00.0
                    logical name: eth4
                    version: 01
                    serial: 00:1b:21:a6:87:8e
                    capacity: 1Gbit/s
                    width: 32 bits
                    clock: 33MHz
                    capabilities: pm msi msix pciexpress bus_master cap_list rom ethernet physical tp 10bt 10bt-fd 100bt 100bt-fd 1000bt-fd autonegotiation
                    configuration: autonegotiation=on broadcast=yes driver=igb driverversion=5.3.0-k firmware=3.18.0 latency=0 link=no multicast=yes port=twisted pair
                    resources: irq:27 memory:9ba80000-9bafffff memory:9bb04000-9bb07fff memory:9bb80000-9bbfffff
               *-network:1 DISABLED
                    description: Ethernet interface
                    product: 82580 Gigabit Network Connection
                    vendor: Intel Corporation
                    physical id: 0.1
                    bus info: pci@0000:1a:00.1
                    logical name: eth5
                    version: 01
                    serial: 00:1b:21:a6:87:8f
                    capacity: 1Gbit/s
                    width: 32 bits
                    clock: 33MHz
                    capabilities: pm msi msix pciexpress bus_master cap_list ethernet physical tp 10bt 10bt-fd 100bt 100bt-fd 1000bt-fd autonegotiation
                    configuration: autonegotiation=on broadcast=yes driver=igb driverversion=5.3.0-k firmware=3.18.0 latency=0 link=no multicast=yes port=twisted pair
                    resources: irq:44 memory:9ba00000-9ba7ffff memory:9bb00000-9bb03fff
    Help keep OpenViX servers online.Please donate!

  3. The Following User Says Thank You to Huevos For This Useful Post:

    Willo3092 (18-11-20)

  4. #333
    Huevos's Avatar
    Title
    Administrator
    Join Date
    Jun 2010
    Location
    38.5N, 0.5W
    Posts
    13,614
    Thanks
    2,006
    Thanked 4,947 Times in 3,269 Posts
    Code:
           *-pci:4
                 description: PCI bridge
                 product: 5520/5500/X58 I/O Hub PCI Express Root Port 7
                 vendor: Intel Corporation
                 physical id: 7
                 bus info: pci@0000:00:07.0
                 version: 22
                 width: 32 bits
                 clock: 33MHz
                 capabilities: pci msi pciexpress pm normal_decode cap_list
                 configuration: driver=pcieport
                 resources: irq:28
            *-pci:5
                 description: PCI bridge
                 product: 7500/5520/5500/X58 I/O Hub PCI Express Root Port 9
                 vendor: Intel Corporation
                 physical id: 9
                 bus info: pci@0000:00:09.0
                 version: 22
                 width: 32 bits
                 clock: 33MHz
                 capabilities: pci msi pciexpress pm normal_decode cap_list
                 configuration: driver=pcieport
                 resources: irq:29
            *-generic:0 UNCLAIMED
                 description: PIC
                 product: 7500/5520/5500/X58 Physical and Link Layer Registers Port 0
                 vendor: Intel Corporation
                 physical id: 10
                 bus info: pci@0000:00:10.0
                 version: 22
                 width: 32 bits
                 clock: 33MHz
                 capabilities: 8259 cap_list
                 configuration: latency=0
            *-generic:1 UNCLAIMED
                 description: PIC
                 product: 7500/5520/5500/X58 Routing and Protocol Layer Registers Port 0
                 vendor: Intel Corporation
                 physical id: 10.1
                 bus info: pci@0000:00:10.1
                 version: 22
                 width: 32 bits
                 clock: 33MHz
                 capabilities: 8259
                 configuration: latency=0
            *-generic:2 UNCLAIMED
                 description: PIC
                 product: 7500/5520/5500 Physical and Link Layer Registers Port 1
                 vendor: Intel Corporation
                 physical id: 11
                 bus info: pci@0000:00:11.0
                 version: 22
                 width: 32 bits
                 clock: 33MHz
                 capabilities: 8259 cap_list
                 configuration: latency=0
            *-generic:3 UNCLAIMED
                 description: PIC
                 product: 7500/5520/5500 Routing & Protocol Layer Register Port 1
                 vendor: Intel Corporation
                 physical id: 11.1
                 bus info: pci@0000:00:11.1
                 version: 22
                 width: 32 bits
                 clock: 33MHz
                 capabilities: 8259
                 configuration: latency=0
            *-generic:4
                 description: PIC
                 product: 7500/5520/5500/X58 I/O Hub System Management Registers
                 vendor: Intel Corporation
                 physical id: 14
                 bus info: pci@0000:00:14.0
                 version: 22
                 width: 32 bits
                 clock: 33MHz
                 capabilities: pciexpress 8259 cap_list
                 configuration: driver=i7core_edac latency=0
                 resources: irq:0
            *-generic:5 UNCLAIMED
                 description: PIC
                 product: 7500/5520/5500/X58 I/O Hub GPIO and Scratch Pad Registers
                 vendor: Intel Corporation
                 physical id: 14.1
                 bus info: pci@0000:00:14.1
                 version: 22
                 width: 32 bits
                 clock: 33MHz
                 capabilities: pciexpress 8259 cap_list
                 configuration: latency=0
            *-generic:6 UNCLAIMED
                 description: PIC
                 product: 7500/5520/5500/X58 I/O Hub Control Status and RAS Registers
                 vendor: Intel Corporation
                 physical id: 14.2
                 bus info: pci@0000:00:14.2
                 version: 22
                 width: 32 bits
                 clock: 33MHz
                 capabilities: pciexpress 8259 cap_list
                 configuration: latency=0
            *-generic:7
                 description: PIC
                 product: 7500/5520/5500/X58 I/O Hub Throttle Registers
                 vendor: Intel Corporation
                 physical id: 14.3
                 bus info: pci@0000:00:14.3
                 version: 22
                 width: 32 bits
                 clock: 33MHz
                 capabilities: 8259
                 configuration: driver=i5500_temp latency=0
                 resources: irq:0
            *-generic:8 UNCLAIMED
                 description: PIC
                 product: 7500/5520/5500/X58 Trusted Execution Technology Registers
                 vendor: Intel Corporation
                 physical id: 15
                 bus info: pci@0000:00:15.0
                 version: 22
                 width: 32 bits
                 clock: 33MHz
                 capabilities: io_x_-apic
                 configuration: latency=0
            *-generic:9
                 description: System peripheral
                 product: 5520/5500/X58 Chipset QuickData Technology Device
                 vendor: Intel Corporation
                 physical id: 16
                 bus info: pci@0000:00:16.0
                 version: 22
                 width: 64 bits
                 clock: 33MHz
                 capabilities: msix pciexpress pm bus_master cap_list
                 configuration: driver=ioatdma latency=0
                 resources: irq:16 memory:9bc00000-9bc03fff
            *-generic:10
                 description: System peripheral
                 product: 5520/5500/X58 Chipset QuickData Technology Device
                 vendor: Intel Corporation
                 physical id: 16.1
                 bus info: pci@0000:00:16.1
                 version: 22
                 width: 64 bits
                 clock: 33MHz
                 capabilities: msix pciexpress pm bus_master cap_list
                 configuration: driver=ioatdma latency=0
                 resources: irq:17 memory:9bc04000-9bc07fff
            *-generic:11
                 description: System peripheral
                 product: 5520/5500/X58 Chipset QuickData Technology Device
                 vendor: Intel Corporation
                 physical id: 16.2
                 bus info: pci@0000:00:16.2
                 version: 22
                 width: 64 bits
                 clock: 33MHz
                 capabilities: msix pciexpress pm bus_master cap_list
                 configuration: driver=ioatdma latency=0
                 resources: irq:18 memory:9bc08000-9bc0bfff
            *-generic:12
                 description: System peripheral
                 product: 5520/5500/X58 Chipset QuickData Technology Device
                 vendor: Intel Corporation
                 physical id: 16.3
                 bus info: pci@0000:00:16.3
                 version: 22
                 width: 64 bits
                 clock: 33MHz
                 capabilities: msix pciexpress pm bus_master cap_list
                 configuration: driver=ioatdma latency=0
                 resources: irq:19 memory:9bc0c000-9bc0ffff
            *-generic:13
                 description: System peripheral
                 product: 5520/5500/X58 Chipset QuickData Technology Device
                 vendor: Intel Corporation
                 physical id: 16.4
                 bus info: pci@0000:00:16.4
                 version: 22
                 width: 64 bits
                 clock: 33MHz
                 capabilities: msix pciexpress pm bus_master cap_list
                 configuration: driver=ioatdma latency=0
                 resources: irq:16 memory:9bc10000-9bc13fff
            *-generic:14
                 description: System peripheral
                 product: 5520/5500/X58 Chipset QuickData Technology Device
                 vendor: Intel Corporation
                 physical id: 16.5
                 bus info: pci@0000:00:16.5
                 version: 22
                 width: 64 bits
                 clock: 33MHz
                 capabilities: msix pciexpress pm bus_master cap_list
                 configuration: driver=ioatdma latency=0
                 resources: irq:17 memory:9bc14000-9bc17fff
            *-generic:15
                 description: System peripheral
                 product: 5520/5500/X58 Chipset QuickData Technology Device
                 vendor: Intel Corporation
                 physical id: 16.6
                 bus info: pci@0000:00:16.6
                 version: 22
                 width: 64 bits
                 clock: 33MHz
                 capabilities: msix pciexpress pm bus_master cap_list
                 configuration: driver=ioatdma latency=0
                 resources: irq:18 memory:9bc18000-9bc1bfff
            *-generic:16
                 description: System peripheral
                 product: 5520/5500/X58 Chipset QuickData Technology Device
                 vendor: Intel Corporation
                 physical id: 16.7
                 bus info: pci@0000:00:16.7
                 version: 22
                 width: 64 bits
                 clock: 33MHz
                 capabilities: msix pciexpress pm bus_master cap_list
                 configuration: driver=ioatdma latency=0
                 resources: irq:19 memory:9bc1c000-9bc1ffff
    From the above:
    Code:
    configuration: cores=4 enabledcores=4 threads=8
    I've got 2 CPUs, 8 threads each, and I don't have any trouble running 32 BB threads. And it builds quicker than 16 threads. Maybe I should try 64 and see what happens.
    Help keep OpenViX servers online.Please donate!

  5. The Following User Says Thank You to Huevos For This Useful Post:

    Willo3092 (18-11-20)

  6. #334
    Willo3092's Avatar
    Title
    ViX Beta Tester
    Join Date
    Oct 2016
    Location
    East Midlands
    Posts
    1,065
    Thanks
    752
    Thanked 403 Times in 303 Posts
    I'll give 16 a try and see how it goes.
    I was getting build errors but decided to start again and also changed both site.conf setting to 4.
    Now I don't know if it was starting from scratch or changing the site.conf settings that got me up and running again

  7. #335
    birdman's Avatar
    Title
    Moderator
    Join Date
    Sep 2014
    Location
    Hitchin, UK
    Posts
    7,777
    Thanks
    237
    Thanked 1,656 Times in 1,305 Posts
    Quote Originally Posted by Willo3092 View Post
    Finally building again after starting from scratch and altering a few things.
    Does anyone know what the optimum settings are for the following in site.conf? I'm assuming that they're dependent on your PC?

    BB_NUMBER_THREADS = "8"
    PARALLEL_MAKE = "-j 8"
    The build sets this for you on its own (it sets it to the number of processors you have).*
    This does mean that if the build gets to a stage where 8 compiles are going on at the same time you may be using 64 processes, but most of the time it's beneficial.
    I'd just use the default setting.

    *There is a "bug" here as this gets set at configuration (first run) time rather than at each run, so if you have your set-up on an external drive (as I do) and move it between systems with differing numbers of processors (as I do) it will run with 8 threads on a 4 thread system (or vice versa). But it still works....
    MiracleBox Prem Twin HD - 2@DVB-T2 + Xtrend et8000 - 5(incl. 2 different USBs)@DVB-T2[terrestrial - UK Freeview HD, Sandy Heath] - LAN/USB-stick/HDD

  8. The Following User Says Thank You to birdman For This Useful Post:

    Willo3092 (18-11-20)

  9. #336
    Willo3092's Avatar
    Title
    ViX Beta Tester
    Join Date
    Oct 2016
    Location
    East Midlands
    Posts
    1,065
    Thanks
    752
    Thanked 403 Times in 303 Posts
    Quote Originally Posted by birdman View Post
    if you have your set-up on an external drive (as I do) and move it between systems with differing numbers of processors (as I do) it will run with 8 threads on a 4 thread system (or vice versa). But it still works....
    Now this has piqued my interest! I've got a spare 240gb ssd in the drawer so can be another little project for me

  10. #337
    Huevos's Avatar
    Title
    Administrator
    Join Date
    Jun 2010
    Location
    38.5N, 0.5W
    Posts
    13,614
    Thanks
    2,006
    Thanked 4,947 Times in 3,269 Posts
    Why are we confusing BB threads with processors? I.e. if you had 128 threads you could do 128 simultaneous fetches. Having only 16 processor threads does not inhibit this.
    Help keep OpenViX servers online.Please donate!

  11. #338
    birdman's Avatar
    Title
    Moderator
    Join Date
    Sep 2014
    Location
    Hitchin, UK
    Posts
    7,777
    Thanks
    237
    Thanked 1,656 Times in 1,305 Posts
    Quote Originally Posted by Huevos View Post
    Why are we confusing BB threads with processors? I.e. if you had 128 threads you could do 128 simultaneous fetches. Having only 16 processor threads does not inhibit this.
    Ideally after a few fetches you'll be doing builds in parallel for them.
    Given that EACH of those builds will be running with as many threads as you have processors, you are then trying to use far more processors than you actually have, which will increase process switching and decrease cache hits.
    MiracleBox Prem Twin HD - 2@DVB-T2 + Xtrend et8000 - 5(incl. 2 different USBs)@DVB-T2[terrestrial - UK Freeview HD, Sandy Heath] - LAN/USB-stick/HDD

  12. #339
    birdman's Avatar
    Title
    Moderator
    Join Date
    Sep 2014
    Location
    Hitchin, UK
    Posts
    7,777
    Thanks
    237
    Thanked 1,656 Times in 1,305 Posts
    Quote Originally Posted by Willo3092 View Post
    Now this has piqued my interest! I've got a spare 240gb ssd in the drawer so can be another little project for me
    That's what I have.
    Just stuck a btrfs partition on it so that I can snapshot previous builds.
    MiracleBox Prem Twin HD - 2@DVB-T2 + Xtrend et8000 - 5(incl. 2 different USBs)@DVB-T2[terrestrial - UK Freeview HD, Sandy Heath] - LAN/USB-stick/HDD

  13. #340
    Huevos's Avatar
    Title
    Administrator
    Join Date
    Jun 2010
    Location
    38.5N, 0.5W
    Posts
    13,614
    Thanks
    2,006
    Thanked 4,947 Times in 3,269 Posts
    Quote Originally Posted by birdman View Post
    Ideally after a few fetches you'll be doing builds in parallel for them.
    Given that EACH of those builds will be running with as many threads as you have processors, you are then trying to use far more processors than you actually have, which will increase process switching and decrease cache hits.
    I think raise it until it either loses stability or doesn't improve build time.
    Help keep OpenViX servers online.Please donate!

  14. #341
    Willo3092's Avatar
    Title
    ViX Beta Tester
    Join Date
    Oct 2016
    Location
    East Midlands
    Posts
    1,065
    Thanks
    752
    Thanked 403 Times in 303 Posts
    Well I followed birdman's example and have eventually added a spare m2 drive in a usb caddy and everything seems to be working fine
    I've built 3 images on the usb drive and all succeeded.

    Just one query though, I noticed the following warnings during the dinobot build. Anyone know what they mean and is it something I've done wrong?

    WARNING: enigma2-plugin-skincomponents-kiddac-shared-skin-1.01+gitAUTOINC+12fe907be3-r1 do_package_qa: QA Issue: enigma2-plugin-skincomponents-kiddac-shared-skin: /usr/lib/enigma2/python/Components/Converter/Slyk18ClockToText.py is owned by uid 1000, which is the same as the user running bitbake. This may be due to host contamination
    enigma2-plugin-skincomponents-kiddac-shared-skin: /usr/lib/enigma2/python/Components/Converter/Slyk18MovieInfo.py is owned by uid 1000, which is the same as the user running bitbake. This may be due to host contamination
    enigma2-plugin-skincomponents-kiddac-shared-skin: /usr/lib/enigma2/python/Components/Converter/Slyk18RemainingToText.py is owned by uid 1000, which is the same as the user running bitbake. This may be due to host contamination
    enigma2-plugin-skincomponents-kiddac-shared-skin: /usr/lib/enigma2/python/Components/Converter/Slyk18ServicePosition.py is owned by uid 1000, which is the same as the user running bitbake. This may be due to host contamination
    enigma2-plugin-skincomponents-kiddac-shared-skin: /usr/lib/enigma2/python/Components/Converter/SlykServiceInfo.py is owned by uid 1000, which is the same as the user running bitbake. This may be due to host contamination
    enigma2-plugin-skincomponents-kiddac-shared-skin: /usr/lib/enigma2/python/Components/Renderer/OnyxNextEvents.py is owned by uid 1000, which is the same as the user running bitbake. This may be due to host contamination
    enigma2-plugin-skincomponents-kiddac-shared-skin: /usr/lib/enigma2/python/Components/Renderer/OnyxNextEvents2.py is owned by uid 1000, which is the same as the user running bitbake. This may be due to host contamination
    enigma2-plugin-skincomponents-kiddac-shared-skin: /usr/lib/enigma2/python/Components/Renderer/Slyk18Picon.py is owned by uid 1000, which is the same as the user running bitbake. This may be due to host contamination
    enigma2-plugin-skincomponents-kiddac-shared-skin: /usr/lib/enigma2/python/Components/Renderer/Slyk18XPicon.py is owned by uid 1000, which is the same as the user running bitbake. This may be due to host contamination
    enigma2-plugin-skincomponents-kiddac-shared-skin: /usr/lib/enigma2/python/Components/Renderer/SlykNextEvents.py is owned by uid 1000, which is the same as the user running bitbake. This may be due to host contamination
    enigma2-plugin-skincomponents-kiddac-shared-skin: /usr/lib/enigma2/python/Components/Renderer/SlykNextEventsTime.py is owned by uid 1000, which is the same as the user running bitbake. This may be due to host contamination [host-user-contaminated]
    WARNING: enigma2-plugin-skincomponents-kiddac-shared-skin-1.01+gitAUTOINC+12fe907be3-r1 do_package_qa: QA Issue: enigma2-plugin-skincomponents-kiddac-shared-skin: /usr/share/enigma2/slyk-common/timeformat.txt is owned by uid 1000, which is the same as the user running bitbake. This may be due to host contamination [host-user-contaminated]

  15. #342
    ccs's Avatar
    Title
    ViX Beta Tester
    Join Date
    Sep 2014
    Posts
    5,836
    Thanks
    554
    Thanked 1,277 Times in 1,089 Posts
    I seem to remember those Kiddac warnings ages ago, I don't think you need to worry about them, but Kiddac needs to sort them out sometime.

  16. The Following User Says Thank You to ccs For This Useful Post:

    Willo3092 (23-11-20)

  17. #343
    abu baniaz's Avatar
    Title
    Moderator
    Join Date
    Sep 2010
    Location
    East London
    Posts
    23,360
    Thanks
    6,440
    Thanked 9,160 Times in 6,235 Posts
    Kiddac did not create the bitbake files, so nothing to do with him.

    You have skins building at the same time that depend on the same shared component. If someone knows how to tweak them, we can improve the bitbake files to remove the notification.

  18. The Following User Says Thank You to abu baniaz For This Useful Post:

    Willo3092 (24-11-20)

  19. #344
    birdman's Avatar
    Title
    Moderator
    Join Date
    Sep 2014
    Location
    Hitchin, UK
    Posts
    7,777
    Thanks
    237
    Thanked 1,656 Times in 1,305 Posts
    Quote Originally Posted by Willo3092 View Post
    Just one query though, I noticed the following warnings during the dinobot build. Anyone know what they mean and is it something I've done wrong?
    No.
    It's the way the enigma2-plugin-skincomponents-kiddac-shared-skin_1.*.ipk file has been packaged.
    The files in it should be owned by root, but are actually owned by the producing id.
    So there's a bug somewhere in the packaging code.

    EDIT:
    And I suspect it is kiddac's "fault".

    His do_install() macro includes:
    Code:
        cp -rp ${S}${libdir}/* ${D}${libdir}/ 
        cp -rp ${S}${datadir}/* ${D}${datadir}/
    so the files get copied in under their original id, which will be the running user.

    Might need something like:

    Code:
    cp -R --no-dereference --preserve=mode,timestamps,links,xattr ......
    which is used elsewhere.
    Mind you, none of this should be running as root, so this could well be wrong.
    Last edited by birdman; 24-11-20 at 03:04.
    MiracleBox Prem Twin HD - 2@DVB-T2 + Xtrend et8000 - 5(incl. 2 different USBs)@DVB-T2[terrestrial - UK Freeview HD, Sandy Heath] - LAN/USB-stick/HDD

  20. The Following 2 Users Say Thank You to birdman For This Useful Post:

    Andy_Hazza (24-11-20),Willo3092 (24-11-20)

  21. #345
    birdman's Avatar
    Title
    Moderator
    Join Date
    Sep 2014
    Location
    Hitchin, UK
    Posts
    7,777
    Thanks
    237
    Thanked 1,656 Times in 1,305 Posts
    Quote Originally Posted by birdman View Post
    And I suspect it is kiddac's "fault".

    His do_install() macro includes:
    Code:
        cp -rp ${S}${libdir}/* ${D}${libdir}/ 
        cp -rp ${S}${datadir}/* ${D}${datadir}/
    so the files get copied in under their original id, which will be the running user.
    I was right.
    If you remove the -p option to the cp commands the warnings go away.
    And checking the uid/gid set in the .ipk file shows that it is now root.
    (His other 3 skin bb files all use cp -rf, not cp -rp.)
    There's not much point trying to preserve timestamps, as the files have just come out of git, so will be set to "now" anyway.
    MiracleBox Prem Twin HD - 2@DVB-T2 + Xtrend et8000 - 5(incl. 2 different USBs)@DVB-T2[terrestrial - UK Freeview HD, Sandy Heath] - LAN/USB-stick/HDD

  22. The Following 4 Users Say Thank You to birdman For This Useful Post:

    Andy_Hazza (24-11-20),ccs (24-11-20),Joe_90 (24-11-20),Willo3092 (24-11-20)

Page 23 of 45 FirstFirst ... 13212223242533 ... LastLast

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
This website uses cookies
We use cookies to store session information to facilitate remembering your login information, to allow you to save website preferences, to personalise content and ads, to provide social media features and to analyse our traffic. We also share information about your use of our site with our social media, advertising and analytics partners.