How to build packages on PBP ?

[KIRIYAMA Kazuhiko]

Hi, all

I'm tring to build packages for my desktop use on pineboookpro (PBP),
but suddenly crashed during compiled devel/llvm10 and failed to build
llvm10-10.0.1_5.txz. The reason why I guess was for too heavy to process
to compile llvm10 because it's load average was over 6.0 !

My building environments on PBP are as follows :

***@kazu:~ # uname -a
FreeBSD kazu.tfc 14.0-CURRENT FreeBSD 14.0-CURRENT #0 n245456-9db44a8e5da9: Thu Mar 18 15:31:29 JST 2021 ***@tbedfc:/usr/obj/usr/src/arm64.aarch64/sys/GENERIC arm64
***@kazu:~ # df -h
Filesystem Size Used Avail Capacity Mounted on
/dev/mmcsd0p3 105G 3.9G 93G 4% /
devfs 1.0K 1.0K 0B 100% /dev
tmpfs 11G 4.0K 11G 0% /compat/linux/dev/shm
linprocfs 4.0K 4.0K 0B 100% /compat/linux/proc
devfs 1.0K 1.0K 0B 100% /compat/linux/dev
fdescfs 1.0K 1.0K 0B 100% /compat/linux/dev/fd
tmpfs 11G 4.0K 11G 0% /compat/linux/dev/shm
vm.tfc:/.dake 12T 920G 11T 8% /.dake
vm.tfc:/ds/src/freebsd/current/14.0/9db44a8e5da9 11T 59G 11T 1% /usr/src
vm.tfc:/ds/obj/freebsd/current/14.0/9db44a8e5da9 11T 419G 11T 4% /usr/obj
vm.tfc:/ds/ports/freebsd/ce3df03f4223 11T 88G 11T 1% /usr/ports
vm.tfc:/ds/distfiles 11T 43G 11T 0% /var/ports/distfiles
vm.tfc:/ds/packages/freebsd/arm64/aarch64/14.0C/9db44a8e5da9/ce3df03f4223 11T 92G 11T 1% /var/ports/packages
***@kazu:~ # cat /etc/make.conf
PORTSDIR= /var/ports/lpbpkx
INDEXDIR= /var/ports/lpbpkx
WRKDIRPREFIX= /var/ports/work
PACKAGES= /var/ports/packages
DISTDIR= /var/ports/distfiles
BATCH= yes
DEFAULT_VERSIONS= perl5=5.32 ruby=2.7
COMPILER_TYPE= clang
USE_PACKAGE_DEPENDS= yes
DISABLE_VULNERABILITIES=yes
***@kazu:~ # git -C /usr/ports rev-parse --verify --short HEAD
ce3df03f4223
***@kazu:~ # ifconfig
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
options=680003<RXCSUM,TXCSUM,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
inet6 ::1 prefixlen 128
inet6 fe80::1%lo0 prefixlen 64 scopeid 0x1
inet 127.0.0.1 netmask 0xff000000
groups: lo
nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
ue0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=80008<VLAN_MTU,LINKSTATE>
ether 00:24:a5:9b:81:97
inet 192.168.1.65 netmask 0xffffff00 broadcast 192.168.1.255
media: Ethernet autoselect (100baseTX <full-duplex>)
status: active
nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
***@kazu:~ # cat /etc/rc.conf
defaultrouter="192.168.1.254"
hostname="kazu.tfc"
ifconfig_ue0="inet 192.168.1.65 netmask 255.255.255.0"
nfs_client_enable="YES"
rpc_lockd_enable="YES"
rpc_statd_enable="YES"
saver="logo"
sendmail_enable="YES"
sshd_enable="YES"
ntpd_enable="YES"
usbd_enable="YES"
usb_load="YES"
#keymap="jp.106"
moused_enable="YES"
powerd_enable="YES"
dumpdev="AUTO"
linux_enable="YES"
***@kazu:~ # kldstat
Id Refs Address Size Name
1 49 0xffff000000000000 1286280 kernel
2 1 0xffff000001287000 26ed8 ums.ko
3 1 0xffff0000012af000 25138 uhid.ko
4 1 0xffff0000012d5000 25c78 wmt.ko
5 1 0xffff0000e5400000 29000 linprocfs.ko
6 1 0xffff0000e5429000 38000 linux_common.ko
7 1 0xffff0000e5461000 22000 dwwdt.ko
8 1 0xffff0000e5483000 23000 mx25l.ko
9 1 0xffff0000e54a6000 21000 fdt_slicer.ko
10 1 0xffff0000e54c7000 22000 pwm_backlight.ko
11 1 0xffff0000e54e9000 22000 backlight.ko
12 1 0xffff0000e550b000 27000 if_axe.ko
13 1 0xffff0000e5532000 22000 pty.ko
14 1 0xffff0000e5554000 24000 fdescfs.ko
15 1 0xffff0000e5578000 22000 mac_ntpd.ko
***@kazu:~ #


Is there any suggestions ?

Best regards
---
Kazuhiko Kiriyama <***@truefc.org>

[Steve O'Hara-Smith]

On Thu, 22 Apr 2021 10:08:39 +0900

Post by KIRIYAMA Kazuhiko
I'm tring to build packages for my desktop use on pineboookpro (PBP),
but suddenly crashed during compiled devel/llvm10 and failed to build
llvm10-10.0.1_5.txz. The reason why I guess was for too heavy to process
to compile llvm10 because it's load average was over 6.0 !

It probably ran out of memory, try setting NO_PARALLEL=1 in the
environment and/or add some swap and try again.

[KIRIYAMA Kazuhiko]

On Thu, 22 Apr 2021 15:05:56 +0900,

Post by Steve O'Hara-Smith
On Thu, 22 Apr 2021 10:08:39 +0900

Post by KIRIYAMA Kazuhiko
I'm tring to build packages for my desktop use on pineboookpro (PBP),
but suddenly crashed during compiled devel/llvm10 and failed to build
llvm10-10.0.1_5.txz. The reason why I guess was for too heavy to process
to compile llvm10 because it's load average was over 6.0 !

It probably ran out of memory, try setting NO_PARALLEL=1 in the
environment and/or add some swap and try again.

Unfortunately also crashed with:

***@kazu:/var/ports/lpbpkx/devel/llvm90 # env NO_PARALLEL=1 make package-recursive

Swap is ready by 8GB:

***@kazu:~ # swapinfo -h
Device Size Used Avail Capacity
/dev/mmcsd0p2 8.0G 0B 8.0G 0%
***@kazu:~ #

The situation before crash is like [1].

[1] Loading Image...

Regards
---

Post by Steve O'Hara-Smith
--
_______________________________________________
https://lists.freebsd.org/mailman/listinfo/freebsd-arm

[Mark Millard via freebsd-arm]

Post by KIRIYAMA Kazuhiko
On Thu, 22 Apr 2021 15:05:56 +0900,

Post by Steve O'Hara-Smith
On Thu, 22 Apr 2021 10:08:39 +0900

Post by KIRIYAMA Kazuhiko
I'm tring to build packages for my desktop use on pineboookpro (PBP),
but suddenly crashed during compiled devel/llvm10 and failed to build
llvm10-10.0.1_5.txz. The reason why I guess was for too heavy to process
to compile llvm10 because it's load average was over 6.0 !

It probably ran out of memory, try setting NO_PARALLEL=1 in the
environment and/or add some swap and try again.

Device Size Used Avail Capacity
/dev/mmcsd0p2 8.0G 0B 8.0G 0%
The situation before crash is like [1].
[1] http://www.truefc.org/~kiri/freebsd/pbp/IMG_1417.jpeg

I recommend trying the following in, say, /boot/loader.conf
and booting with the settings before attempting another
build:

#
# Delay when persistent low free RAM leads to
# Out Of Memory killing of processes:
vm.pageout_oom_seq=120
#
# For plunty of swap/paging space (will not
# run out), avoid pageout delays leading to
# Out Of Memory killing of processes:
vm.pfault_oom_attempts=-1
#
# For possibly insufficient swap/paging space
# (might run out), increase the pageout delay
# that leads to Out Of Memory killing of
# processes (showing defaults at the time):
#vm.pfault_oom_attempts= 3
#vm.pfault_oom_wait= 10
# (The multiplication is the total but there
# are other potential tradoffs in the factors
# multiplied, even for nearly the same total.)

Notes:

While I've never done anything that required it,
vm.pageout_oom_seq could be set even bigger.
Someone once reported using a figure like 1200
instead. No setting gives an unbounded delay.

If you decide to not use vm.pfault_oom_attempts=-1 :

For that last you would want to increase one or both
of: vm.pfault_oom_attempts and/or vm.pfault_oom_wait
instead of using 3 and 10 as the values.

If you do got (or get) one or more "was killed: out of swap
space" messages on the console: Be warned that the "out of
swap space" part can be a misnomer. Only if you also see
message(s) with text of the form
"swap_pager_getswapspace(...): failed" is the swap space
part of the notice the actual cause as far as I know. Other
causes include:

Sustained low free RAM (via stays-runnable processes).
A sufficiently delayed pageout.
The swap blk uma zone was exhausted.
The swap pctrie uma zone was exhausted.

The earlier tuning attempts to deal with the first two of
those, not the last two.

The 2 or 3 tunables above can instead be placed in
/etc/sysctl.conf if desired.

===
Mark Millard
marklmi at yahoo.com
( dsl-only.net went
away in early 2018-Mar)