Commit Graph

862 Commits

Author SHA1 Message Date
Franco Fichtner c6c8ee933e build/audit: fix typo
Note to self: while some packages report "vulnerable" they may
only run on vulnerable dependencies.
2021-08-09 13:29:25 +02:00
Franco Fichtner 8429da1ecd build/ports: not a make invoke :D 2021-08-09 09:53:08 +02:00
Franco Fichtner 2709d6e4ef build: too much logging in nightly run 2021-08-09 08:03:52 +02:00
Franco Fichtner ac8fd59651 build/ports: small bug, move to debug ports install target 2021-08-08 09:22:30 +02:00
Franco Fichtner 75e664118f build/ports: previous change did not work
Suspicously this seems to be caused by the ports tree now and
our previous code was working fine.  The change is fine too,
but now we need to see which make target triggers this...
2021-08-06 08:53:55 +02:00
Franco Fichtner 79ba9ca822 build/ports: it seems that pkg -N sometimes wants to bootstrap
The /usr/sbin/pkg supports -N in the right way, but /usr/local/sbin/pkg -N
which is being invoked if /usr/local/sbin/pkg exists has other semantics
that sometimes makes this work and sometimes it doesn't.  The manual page
mentions a weird workaround, but in the end if we assume that base pkg
execs local pkg we can almost certainly assume that it is bootstrapped and
usable.
2021-08-05 09:12:08 +02:00
Franco Fichtner 6a04fbb4ca build: switch to FreeBSD ports tree 2021-08-02 10:51:18 +02:00
Franco Fichtner feab3fbeaf build/vm: fix bugs in previous and flatten mkimg invoke 2021-07-26 13:51:23 +02:00
Christopher SHEN 91757dae56
Working aarch64 configs for 21.1 (#222) 2021-07-26 13:04:14 +02:00
Franco Fichtner 574258684d build: fix typo in distfiles handling 2021-07-13 15:26:14 +02:00
Franco Fichtner 3e3621cdec build: similar approach for find_images(), now values PRODUCT_FLAVOUR 2021-07-08 12:43:04 +02:00
Franco Fichtner f7ed343a6f build: move set load to common code, rename vars for consistent style 2021-07-08 12:05:40 +02:00
Franco Fichtner d8b0f605d3 build/audit: print all audit targets for better visibility 2021-07-08 11:01:27 +02:00
Franco Fichtner cd0fdba4b0 build/ports: allow to override BATCH run with developer shell on failure 2021-07-06 08:56:02 +02:00
Franco Fichtner 31d406fc5c build/boot: uncompress if needed, update README 2021-07-05 10:26:52 +02:00
Franco Fichtner 8ba6951dd4 build/release: do not checksum the checksum file in the checksum file 2021-07-01 13:30:32 +02:00
Franco Fichtner b1b52c4631 build: document PORTSLIST and PLUGINSLIST 2021-06-24 09:04:48 +02:00
Franco Fichtner 99996adef8 build/plugins: avoid underscore here as well 2021-06-24 08:57:52 +02:00
Franco Fichtner 813e9cbc18 build/skim: avoid underscore in vars for consistency 2021-06-24 08:56:29 +02:00
Franco Fichtner f1b1f75f90 build: support plugin variants much like port flavors
Use it on zabbix4-proxy although the resulting package is the same
as before (plus some new features previously not available there).
2021-06-01 10:08:13 +02:00
Franco Fichtner bde1931536 build/boot: bring up network, allow ISO boot and add separate HD; closes #227 2021-04-19 10:41:20 +02:00
Franco Fichtner 36b1f402ff build|composite: use -x grep 2021-04-18 15:05:04 +02:00
Franco Fichtner 2920f45a47 build/boot: increase memory to 2GB 2021-04-16 10:41:17 +02:00
Franco Fichtner 4a8970cbf8 build: ABI hint is not needed on extract 2021-04-15 08:59:41 +02:00
Franco Fichtner 10d94fc215 composite/distribution: proper release build top target; closes #216 2021-04-09 13:33:54 +02:00
Franco Fichtner 752e2b545b build: let compress sign images and add new list helper; closes #223 2021-04-09 11:18:05 +02:00
Franco Fichtner 316eb45bd7 build: device configuration can use SRCREVISION and SRCABI now 2021-04-08 08:41:39 +02:00
Franco Fichtner 4ed9cc53f1 build/common: show passed arguments to step 2021-04-06 14:23:08 +02:00
Franco Fichtner 3c3330f385 build: pass port options as PORTSENV
This way we can hook it into build configuration and also it
looks final enough to document it soon.
2021-04-06 09:02:35 +02:00
Franco Fichtner 8c18ee7ccd build/ports: add "depend" option to avoid rebuilds of reverse dependencies 2021-04-06 08:04:24 +02:00
Franco Fichtner 17b3822f99 build/release: align public key with image naming 2021-04-01 14:36:12 +02:00
Franco Fichtner bf47a6ce42 build/plugins: only enforce mandatory plugin list for main branch
When not using EXTRABRANCH this is the same behaviour as before.
2021-03-31 14:03:02 +02:00
Franco Fichtner a5903066c0 build/clean: try harder to find actual STAGEDIR 2021-03-31 13:19:05 +02:00
Franco Fichtner e50e67ef40 build/ports: add overrides for silent and prune modes
No documentation for this as this is going to be reworked again.
Currenty though, during build tests editing these lines constantly
is not the best approach so at least now it works from the command
line.
2021-03-26 10:55:36 +01:00
Franco Fichtner 6e89e3a718 build: prefer -v over -V 2021-02-24 10:33:10 +01:00
Franco Fichtner 0f46176f1a build: replacement with vars just needs quotes
Simplify the code a little by using the SELF var instead
of hardcoding the type again.  This way some day the code
could be moved to common and reduce duplication further.
2021-02-23 11:30:48 +01:00
Franco Fichtner 5e28a3aa48 build/skim: last bits in skim update; closes #217 2021-02-23 11:16:03 +01:00
Franco Fichtner a29b57561c build/skim: simplify lookup #217 2021-02-22 14:57:09 +01:00
Franco Fichtner bf1da3f4d8 build/audit: allow PORTS_LIST override 2021-02-22 12:08:01 +01:00
Franco Fichtner a4daeb64db build/skim: speed up dependency creation #217 2021-02-19 08:59:20 +01:00
Franco Fichtner 6c7ef34634 build/skim: simplify unused sync a little #217 2021-02-18 16:27:59 +01:00
Franco Fichtner bc91f00cd5 build/audit: fail on vulnerabilities, but continue on nightly 2021-02-17 11:58:48 +01:00
Franco Fichtner b9b435215a build/skim: use -N for diff, easier to see added/removed file changes 2021-02-16 20:46:44 +01:00
Franco Fichtner a927e81e30 build: make sure the build can cope with SUFFIX=-business
We do not want to install globs as the matching is very fuzzy and
also we no longer do.  To make sure prevent use of globs in
install_packages so we can catch this in nightly builds if it
ever happens.

While here, allow to set a VERSION for core builds which ignores
the tag-version-derivation.  It is useful for prerelease building.

Last but not least ADDITIONS should no longer look for SUFFIX so
if you want to build an image with SUFFIX=-devel and use a development
plugin overwrite ADDITIONS accordingly, e.g. ADDTIONS=os-dyndns-devel
2021-02-10 11:13:50 +01:00
Franco Fichtner cf3f923da2 build: while here make COMPORT configurable and rename SPEED to COMSPEED 2021-02-02 13:38:01 +01:00
Franco Fichtner 679f0cc68e build/plugins: provide local override here as well 2021-02-02 09:36:33 +01:00
Franco Fichtner 808649f0ed build: fold CONFIGDIRPREFIX into CONFIGDIR, derive (PRODUCT_)SETTINGS
So now we either set SETTINGS or CONFIGDIR and if the latter is used
SETTINGS variable is populated from the basename of CONFIGDIR to avoid
having to set two overrides at the same time.

Also add a build.conf.local optional build configuration to make
adjustments beyond our own scope feasible.
2021-02-02 09:24:34 +01:00
Franco Fichtner ba3d075c6e build: change CONFIG to CONFIGDIR/CONFIGDIRPREFIX approach
Always require build.conf since /dev/null does not work anymore
due to omission of embedded language versions.

The top view CONFIGDIR is not the low level CONFIGDIR in the
build scripts, but for lack of refactoring noise and a catchy
naming scheme let's just leave it where it is.
2021-02-01 16:44:55 +01:00
Franco Fichtner 99863e1653 build/audit: remove indent from report 2021-01-28 08:41:06 +01:00
Franco Fichtner fbac38f495 build/audit: run vulnerability check on ports 2021-01-27 16:22:47 +01:00
Franco Fichtner 6254b6215f build: ok, FreeBSD bootstraps /usr/src directory 2021-01-27 11:34:15 +01:00
Franco Fichtner b7d7342ee6 build: do not read SRCREVISION without SRCDIR 2021-01-27 11:32:47 +01:00
Franco Fichtner 91eab2adcf build: use new make.conf target to simplify patches; closes #210 2021-01-26 20:26:50 +01:00
Franco Fichtner 89d9d02ca4 build/make.conf: apparently it is today #210 2021-01-26 20:26:38 +01:00
Franco Fichtner 42e6909107 build: soft-fail for missing arguments here 2021-01-26 16:39:48 +01:00
Franco Fichtner 3b8dad95d2 build: pass more vars for new make.conf
It might make more sense to move make.conf target lower and
use it from the build scripts as well.  Not for today.
2021-01-26 15:54:12 +01:00
Franco Fichtner a4fe2066c8 build/clone: fix typo 2021-01-22 23:46:17 +01:00
Franco Fichtner 1b61f199e8 build: rename DEVELBRANCH to EXTRABRANCH
We can switch it to any other branch depending on requirements.
2021-01-22 13:37:46 +01:00
Franco Fichtner a90907a94e build: make PRODUCT_REBUILD a globally accessible variable 2021-01-21 09:47:59 +01:00
Franco Fichtner 38ee2fa1d4 config: untangle SETTINGS and ABI
In case we want a custom config directory but a matching ABI.
2021-01-20 16:51:37 +01:00
Franco Fichtner d6111ee42a build/ports: do not overwrite global SELF and IMAGE
While here cleanup_packages is highly ambiguous.  Use
prune_packages instead as we remove stale or incompatible
packages from the set.
2021-01-20 16:25:45 +01:00
Franco Fichtner 8742d7295d build/ports: continue faulty builds unless rebuilding
Add a bit of reporting glue to get better visibility of
ports doing rebuild bouncing.
2021-01-20 15:22:07 +01:00
Franco Fichtner 494aec7ce5 build: stop phalcon4 from rebuild bouncing
PHP default changed upstream and here deal with this with
a mininal fix passing our PHP version along.
2021-01-20 14:17:30 +01:00
Franco Fichtner 9779a6ab51 build/skim: condense print to categories 2021-01-20 12:43:03 +01:00
Franco Fichtner 7375a65098 build/ports: reverse logic 2021-01-19 13:39:21 +01:00
Franco Fichtner 6f544155a4 build/sign: do not add a marker, there is no reader 2021-01-18 17:29:17 +01:00
Franco Fichtner 6aa26b27d6 build/ports: SELF is actually ports, no need to list twice 2021-01-18 17:27:12 +01:00
Franco Fichtner 553bf8a787 build/ports: only add aux.conf if packages step has not been executed
For hotfixes it will start to build go and rust even if it does not
need it.

For the cases where e.g. suricata rebuild requires rust use the
non-packaged packages set or let rust build during dependecy build.
2021-01-18 17:22:38 +01:00
Franco Fichtner c3f66077b4 build/clone: add new helper 2021-01-18 11:50:37 +01:00
Franco Fichtner 3bc587dcb8 build/prefech: use PRODUCT_ABI when no manual version was set
Makes prefetch work out of the box. The initial version is very
likely capable of building packages for the whole series.
2021-01-13 11:15:18 +01:00
Franco Fichtner ba273a9f49 build/serial: remove debug output 2021-01-11 14:02:44 +01:00
Franco Fichtner c68563ca3e config: expose PRODUCT_ABI to ports
Fixup PRODUCT_LUA replacement while here.
2021-01-11 11:46:02 +01:00
Franco Fichtner 84aefa59b0 config: support UEFI in serial images, off by default for now; closes #138
While here switch images to UFS2.
2021-01-07 15:58:47 +01:00
Franco Fichtner 7a7afca2f7 build: unify generation message 2020-12-14 12:40:13 +01:00
Franco Fichtner 88b4152696 build: small typo that made .abi_hint file reappear in mtree db 2020-12-04 14:50:12 +01:00
Franco Fichtner 123b8977cf build: test pkg and git binaries; closes #197 2020-09-12 17:04:30 +02:00
René Bayer e760f313b7
Fixed object paths for cross compiling (#194) 2020-08-21 09:52:23 +02:00
Franco Fichtner b3195a89c7 build/tools: we only support 12.1 now 2020-07-26 06:00:37 +02:00
Franco Fichtner db2421cfb3 Revert "build: do not enter 20.7.r description territory on 20.1"
This reverts commit 84e5ec467a.
core doesn't actually use "git_describe" so we are fine here.
Added a similar commit in the core repository that actually works. ;)
2020-07-23 12:30:09 +02:00
Franco Fichtner 35d1e1138f build/boot: "we can be errors, just for one day" 2020-07-21 17:50:04 +02:00
Franco Fichtner 460071a688 build/boot: make boot script run on 12.1 2020-07-21 09:11:32 +02:00
Franco Fichtner 84e5ec467a build: do not enter 20.7.r description territory on 20.1
Due to an issue with pkg upgrade -f[1] and lack of a better approach
we will avoid version parity beween 20.1 and 20.7 development branches
by omitting 20.1 from using the RC tag for versioning.

This allows us to force an upgrade always even though the actual
version is going backwards.  It doesn't really matter then because
we seek full transition into the new packages that have been published
and not try to outsmart the upstream repo's efforts to keep everything
in sync.

[1] https://github.com/freebsd/pkg/issues/1806
2020-07-19 20:27:27 +02:00
Franco Fichtner ea8344b0b8 build: only fetch "origin" as some remotes may not respond 2020-07-16 08:41:22 +02:00
Franco Fichtner 3a3d35f3ed build: new branches not being fetched at first try 2020-07-16 08:29:14 +02:00
Franco Fichtner d33488bb0c build/base: fixup FreeBSD 12.1 build issue with missing host file 2020-07-15 18:21:31 +02:00
Franco Fichtner c37230a777 build/rebase: .abi_hint file has no relevance here 2020-07-15 03:34:13 +02:00
Franco Fichtner 9b0ad3a4bf Revert "build/kernel: kldxref fixup, build host seems to be used"
This reverts commit 62e5d79c80.

It doesn't work still.
2020-06-07 11:55:31 +02:00
Franco Fichtner 96427357f4 build: add SRCABI usage and shared .abi_hint file; closes #179 2020-06-04 07:32:28 +02:00
Franco Fichtner e624dea4c2 build: add ABI hint to packages set 2020-06-04 05:46:36 +02:00
Franco Fichtner 62e5d79c80 build/kernel: kldxref fixup, build host seems to be used 2020-05-27 04:15:05 +02:00
Franco Fichtner e96cf8a95c build: support macOS for "make update" purposes 2020-05-17 10:26:30 +02:00
Franco Fichtner 145cad9e0b build/test: pass correct environment to tests
Avoids breakage of inline checks during test step.
2020-04-02 08:24:18 +02:00
Franco Fichtner 378b321ef2 build/nano: noatime as per forum mention 2020-03-17 08:50:14 +01:00
Franco Fichtner 9746b57855 build: pass FLAVOUR instead of poisoning the variable via env 2020-03-06 08:57:40 +01:00
Franco Fichtner bcfcd1c0ad build: fix typo 2020-02-24 09:17:23 +01:00
Franco Fichtner 603330a8f6 config: remove notion of version "3" Python, it's the default 2020-02-18 10:15:34 +01:00
Franco Fichtner 1f00c8b677 build: remove PYTHON2 selector, no longer used 2020-02-18 08:25:11 +01:00
Franco Fichtner dd5878fc78 build: print error when we hit this code branch 2020-02-09 08:51:55 +01:00
Franco Fichtner a34ba52382 build/ports: check here as well, no package at build start 2020-02-09 08:46:52 +01:00
Franco Fichtner f7213f9431 build/clean: core,plugins only makes sense if packages are there 2020-02-08 19:02:01 +01:00
Franco Fichtner a32ec5c46b build/sign: use args and regenerate mtree signature as well 2020-01-22 22:20:54 +01:00
Franco Fichtner f40de61925 build: we've use the term "base" for ages now 2020-01-22 15:47:26 +01:00
Franco Fichtner 379bf96c4a build: fix issue with "make update-portsref"
... which is only used with "make skim".  Since HBSD moves to another
git server soon this seems like a good idea to fix.
2019-12-23 07:32:23 +01:00
Franco Fichtner ba113bc6db config: should fix nightly test run on 20.1 development 2019-12-23 06:54:54 +01:00
Franco Fichtner 7043f012fe build/prefetch: correct branch required for SRCREVISION 2019-12-12 14:38:55 +01:00
Franco Fichtner 3c9c9219a5 build/upload: why not both 2019-12-12 14:26:32 +01:00
Franco Fichtner 6f4ce3c69a build/download: whoops :) 2019-12-12 14:20:57 +01:00
Franco Fichtner df6a9a0da0 build/download: support distfiles fetch 2019-12-12 14:19:38 +01:00
Franco Fichtner a60abeddae build: fix xtools on 12.1
While here allow SRCREVISION to be read everywhere.  The prefetch
script appreciates the additional info so it doesn't have to guess
anymore.  :)
2019-10-30 14:22:14 +01:00
Franco Fichtner b053261a9c build: pkg should be picked up instantly nowadays 2019-10-13 15:46:07 +02:00
Franco Fichtner e50d175fe7 build: add a real "package" target and aux.conf trickery
aux.conf harbours ports that are needed for the build and intermediate
package sets for testing and rebuilding, but that will ultimately be
removed from the sets when they are supposed to be uploaded to the mirror.
2019-10-13 15:46:07 +02:00
Franco Fichtner 1ea79d4de0 build: actually tell which argument is missing 2019-09-26 07:34:33 +02:00
Franco Fichtner 644f4a8e4e build: small tweaks here, 600 on both files 2019-09-25 13:16:18 +02:00
Franco Fichtner 1be9ee13c0 build: sign our mtree set files for later verification
Right now we trust the mtree file since we can't guarantee
consistency after unpack.  This way we will be able to warn
on unsigned mtree file or when the signature is wrong meaning
somebody meddled with the mtree file.

Should work for both base and kernel.

PR: https://github.com/opnsense/core/issues/3473
2019-09-25 13:15:26 +02:00
Franco Fichtner e6a5db5dd8 build: cope with new reality of pkg 1.11 2019-08-01 10:38:11 +02:00
Franco Fichtner b22e911fab build: add `fingerprint' target 2019-07-02 08:26:40 +02:00
Franco Fichtner 9f82a73dda build: force umount, busy error doesn't mean much in disposable chroot 2019-06-19 08:46:29 +02:00
Franco Fichtner 5ecee3f3c1 composite: allow access to all FLAVOUR settings
Makes it easier to modify stuff.  First one is mandatory, the rest is
eaten up by scripts to be passed down as required.
2019-06-10 17:55:58 +02:00
Franco Fichtner 9d77c902e3 build: remove QUICK support, rarely useful and undocumented 2019-06-03 08:25:26 +02:00
Franco Fichtner 820ab1fb81 build: use cp -R as -cp -r is actually -RL
And this is being disliked by a dangling python3 -> python3.6 link.
2019-05-19 13:31:33 +02:00
Franco Fichtner af7a5ac7cc nano: well, these go to 400000 2019-05-16 14:50:45 +02:00
Franco Fichtner 0657a0ae47 build/nano: increase free inode count by 250k
PR: https://forum.opnsense.org/index.php?topic=12639.0
2019-05-13 05:58:04 +02:00
Franco Fichtner 50533be115 build: we try to be too clever, need a shadow var for recursion 2019-05-08 06:49:45 +02:00
Franco Fichtner 44f4417854 build/download: this one as well 2019-05-08 06:33:34 +02:00
Franco Fichtner ed3c99c909 build/upload: sftp hurts my brain...
... but @adschellevis will be happier.  ;)
2019-05-08 06:22:54 +02:00
Franco Fichtner ada4a2bc4b device: finally only extrapolate the kernel config 2019-05-08 05:59:35 +02:00
Franco Fichtner dfefa3379f device: no ODROID and ORANGEPI for now #137 2019-05-07 13:57:59 +02:00
Franco Fichtner 24bf4e00c0 build/upload: fix this too 2019-05-07 13:46:09 +02:00
Franco Fichtner 1b6b45a72e build/base: typo 2019-05-07 13:03:04 +02:00
Franco Fichtner a7d78fcb79 build: always require device config 2019-05-07 12:22:34 +02:00
Franco Fichtner fd9e920b21 build: we need device in base set too 2019-05-07 12:10:31 +02:00
Franco Fichtner ea5155836e device: there is no RPI3 support in 11.2
Add it later when we have it, because if we keep it there will
only be questions why it doesn't work.
2019-05-07 13:48:49 +02:00
Franco Fichtner 6e54f6037a device: work on RPI2 image 2019-05-07 13:43:51 +02:00
Franco Fichtner 91d4ca4f62 build/arm: this works out of the box nowadays 2019-05-07 09:55:40 +02:00
Franco Fichtner 99beda883a build/arm: more changes 2019-05-07 07:12:26 +02:00
Franco Fichtner 415af5a2b6 build/arm: more on bananapi 2019-05-07 08:27:44 +02:00
Franco Fichtner 5dfee1c041 build: kernel set device name if device config does not unset 2019-05-06 19:49:31 +02:00
Franco Fichtner bb1b755b09 config: use "bananapi" as FreeBSD calls it, proper image 2019-05-06 19:41:34 +02:00
Franco Fichtner c2723e52b9 build: load DEVICE earlier for automatic ARCH change 2019-04-26 10:45:05 +02:00
Franco Fichtner 3924c19ba8 build: implement PRODUCT_WANTS, always check for git 2019-04-28 11:55:48 +02:00
Neko Prog 5f42f73c9e build arm: fix bananapi.dtb file name
Need to test bananapi image first from https://drive.google.com/drive/folders/1bAWuECNJwu0LdJOpaIn-2MrTKZ8evGNY. If it boots, this should be safe to merge. Else need to rename the copied bananapi.dtb too.
2019-04-24 23:55:39 +02:00
Franco Fichtner f309f0b269 build: adapt clean and rename to arm image naming change 2019-04-17 07:16:25 +02:00
Neko Prog e9877277cc arm: more device configs (#130)
* Add Orange Pi PC2 device config
* Add Odroid XU3/XU4 device config and update several arm configs
* Update odroid-xu3.conf
2019-04-03 20:21:00 +02:00
Neko Prog ef08bdeed8 Add RPI 2/3 Firmwares (#128) 2019-03-26 16:01:48 +01:00
Franco Fichtner 3cfaeed996 build/rename: typo in vm rename 2019-03-21 09:50:38 +01:00
Franco Fichtner 298118bb94 build/arm: small style fix 2019-03-17 13:03:51 +01:00
Neko Prog 9dcd73e003 Add cross build support for aarch64 and RPI3 config (#120) 2019-03-17 13:01:50 +01:00
Franco Fichtner 456a4c9fdc build/plugins: fix PLUGINSENV propagation 2019-03-14 11:27:15 +01:00
Franco Fichtner a26d020043 config: use RUST in amd64 only 2019-03-08 14:14:29 +01:00
Franco Fichtner d2d93e7285 build/dvd: subtle breakage in UEFI write for DVD on FreeBSD 11.2 2019-03-08 09:47:28 +01:00
Franco Fichtner 6b510f0b21 build: remove -dbg handling specialty
Prefetch should use VERSION=dbg-19.1 and rename will detect if it is
a debug set and keep the name in place.
2019-02-24 20:28:08 +01:00
Franco Fichtner 268c3e023c build/update: typo 2019-02-24 01:10:12 +01:00
Franco Fichtner c9125cd700 build/arm: whitespace cleanup 2019-02-24 18:36:02 +01:00
Franco Fichtner 563165ede2 build: make DEVELBRANCH optional; closes #117 2019-02-24 18:33:44 +01:00
Neko Prog 4355c16fa5 Kernel and Device config for Raspberry Pi 2 (#119) 2019-02-24 18:20:56 +01:00
Franco Fichtner 0eb37037bb build/kernel: need kernel-toolchain for build #113 2019-02-14 09:30:19 +01:00
Franco Fichtner a999844f36 device: bpi.conf and cross-build docs #113 2019-02-13 21:39:48 +01:00
Franco Fichtner c058582d0c config: switch to Banana Pi 2019-02-11 17:39:43 +01:00
Franco Fichtner e46b40bf5d build/distfiles: fetch actual port's distfile
This bug exists since December 2017 where we had to side-step
fetch-recursive because FLAVOUR git in the way...
2019-01-21 07:10:12 +01:00
Franco Fichtner 3657c59694 build: remove mixed version-arch marker
This has been obsoleted in opnsense-update and shall be removed
for our 19.1 builds.  Hooray for progress.
2019-01-12 14:35:55 +01:00
Franco Fichtner a8c8a0cf57 build: finish stopping to use the obsolete set 2019-01-09 07:44:48 +01:00
Franco Fichtner 1ef27c249b build: start to stop handling "obsolete" set which is obsolete 2019-01-09 08:10:17 +01:00
Franco Fichtner 2eeb64271e build: only set marker if there's no '.pkg-err' file
Build steps for packages predate the .pkg-err file so we had no
way of knowning about the integrity of a build.  Now we can
directly check the status of the build.

The side effect is that "make plugins" and "make core" will run
"make ports" if that failed and fail there.  While there's a
little overhead in automated scripts this is more consistent with
build flow as we do not start higher targets that depend on broken
dependencies that look correct.  This was reported a few times
over the years.
2019-01-02 15:20:22 +01:00
Franco Fichtner afdaf2e32d build: add architecture to sets as well 2018-11-28 11:44:49 +01:00
Franco Fichtner 2299aca0ed build: offset issue with wc(1) 2018-11-28 10:50:35 +01:00
Franco Fichtner 314878d80f build: support ".size" versioning extention for sets 2018-11-28 06:47:16 +01:00
Franco Fichtner bbd3e45d62 build: exclude /var from mtree file
/var MFS kills all of the files and it's extremely difficult to
construct a safe health check around the fact that they can be
missing.
2018-11-21 08:24:48 +01:00
Franco Fichtner 3c8edd00fe build: remove spurious WRKDIR change
It was needed at some point in the past but hasn't been useful
for a good while now.  Recently it broke because the plist test
is now run prior to 'package' target and while it may be fixed
there by creating the directory this code using a custom WRKDIR
is the bigger bug so good-bye. :)
2018-11-04 16:46:40 +01:00
Franco Fichtner 7070e7a06e build: only show generated sets 2018-11-04 12:51:31 +01:00
Franco Fichtner 6c3af6aed8 build/info: zap useless feature 2018-11-02 08:49:52 +01:00
Franco Fichtner 94acdfd303 build/rename: allow to rename compressed images as well 2018-11-02 03:49:21 +01:00
Franco Fichtner 474e3188b7 build: add disabled lock set for testing 2018-11-02 02:40:05 +01:00
Franco Fichtner 578adffefe build: show package set file size after completion 2018-11-02 07:18:34 +01:00
Franco Fichtner 4f5a745c52 config: more changes for Pyhton split
ansible and py-boto3 are missing for now.
2018-10-28 08:34:44 +01:00
Franco Fichtner 7852203f79 build/ports: copy wanted packages instead of recreate 2018-10-25 09:34:57 +02:00
Franco Fichtner 2d3f285bcc build/ports: rewrite caching; closes #101
At the price of more temporary build storage and initial double-
creation of packages this avoids all duplicated builds of build-
time dependencies and automatically discards them at the end.
2018-10-25 07:55:19 +02:00
Franco Fichtner b2ba62c97f build/rebase: small anotation for the future 2018-10-16 05:51:46 +02:00
Franco Fichtner 63ad5534f7 build: inject obsolete set into base set 2018-10-15 16:04:08 +02:00
Franco Fichtner 68e33100d4 build: unify a few moving parts before obsolete rework 2018-10-15 07:48:05 +02:00
Franco Fichtner b79da85b72 build: signature doesn't have to be there 2018-10-13 14:11:24 +02:00
Franco Fichtner da742c492e build: two small changes
* Always purge signatures when we can't generate new ones.
* Instead of testing who called us see if config files are there.
2018-10-14 12:53:28 +02:00
Franco Fichtner 5cf68c1729 build/base: repack set for mtree inclusion as well 2018-10-13 10:23:34 +02:00
Franco Fichtner f90365b32b build/kernel: (re)generate mtree file for later use 2018-10-13 09:50:32 +02:00
Franco Fichtner 1ca88f0d6c kernel: always repack kernel set like rename step does 2018-10-12 18:41:12 +02:00
Franco Fichtner 145bbf1904 build/ports: timestamp ports framework messages 2018-10-09 15:54:25 +02:00
Franco Fichtner a6f43962a2 build: do not start configd on image builds; closes #93 2018-10-09 15:34:50 +02:00
Franco Fichtner 6c6463722f build/kernel: 11.2 does not write empty debug set 2018-10-07 06:57:47 +02:00
Franco Fichtner d163224a84 build/ports: correct origin for deps locking, add log line
While here, move cleanup_packages to common for the sake of making
it easier to comment out for testing / development purposes.
2018-09-30 20:29:04 +02:00
Franco Fichtner 08e8cb2edd build/ports: log removal of a cached package
While here, cache py-sphinx package pulled in twice.
2018-09-30 05:09:14 +02:00
Franco Fichtner 52fa145122 build/ports: cache temporary packages for reuse 2018-09-29 08:19:28 +02:00
Franco Fichtner 0df1a58e3e build/download: add log target as well 2018-09-20 08:49:47 +02:00
Franco Fichtner 3f6a1c5265 scripts/nightly: only upload the current log set 2018-09-20 07:44:58 +02:00
Franco Fichtner deada0aa82 scripts/nightly: improve logs set directory structure 2018-09-18 22:51:28 +02:00
Franco Fichtner 30a58b3582 build/rewind: idea for development package issues 2018-09-18 21:46:59 +02:00
Franco Fichtner 29c2abe2b0 build/rewind: finish tag matching, add experimental rewind target; closes #71
For now this goes undocumented.  The trouble with rewind is:

1. To rewind we need to reset all repositories.  That only really
   works on top of the current branch.  Possible solution: only
   allow rewind for the currently up-to-date version.

2. The master branch development version is in the way and will
   probably prevent people from building older versions because
   of this or that mismatch.  Possible solution: allow a build
   without development packages included and maybe default to it.
2018-09-17 22:08:35 +02:00
Franco Fichtner 418b0eec9a build/confirm: simple but effective confirmation dialog 2018-09-17 02:26:49 +02:00
Franco Fichtner b1de3b4919 build/upload: simplify, we upload this as is 2018-09-16 00:21:51 +02:00
Franco Fichtner a7e5ac519b build/upload: more output for logs upload/unpack 2018-09-13 21:56:46 +02:00
Franco Fichtner 7315cf2f78 build: logs upload for nightly
Logs still have issues due to their incredible length, but
for now this makes daily checks easier than ever in any case.
2018-09-13 21:25:10 +02:00
Franco Fichtner 87c3dbc9c6 build/rename: VERSION -> PRODUCT_VERSION 2018-09-12 04:50:43 +02:00