Commit Graph

862 Commits

Author SHA1 Message Date
Franco Fichtner 6254b6215f build: ok, FreeBSD bootstraps /usr/src directory 2021-01-27 11:34:15 +01:00
Franco Fichtner b7d7342ee6 build: do not read SRCREVISION without SRCDIR 2021-01-27 11:32:47 +01:00
Franco Fichtner 91eab2adcf build: use new make.conf target to simplify patches; closes #210 2021-01-26 20:26:50 +01:00
Franco Fichtner 89d9d02ca4 build/make.conf: apparently it is today #210 2021-01-26 20:26:38 +01:00
Franco Fichtner 42e6909107 build: soft-fail for missing arguments here 2021-01-26 16:39:48 +01:00
Franco Fichtner 3b8dad95d2 build: pass more vars for new make.conf
It might make more sense to move make.conf target lower and
use it from the build scripts as well.  Not for today.
2021-01-26 15:54:12 +01:00
Franco Fichtner a4fe2066c8 build/clone: fix typo 2021-01-22 23:46:17 +01:00
Franco Fichtner 1b61f199e8 build: rename DEVELBRANCH to EXTRABRANCH
We can switch it to any other branch depending on requirements.
2021-01-22 13:37:46 +01:00
Franco Fichtner a90907a94e build: make PRODUCT_REBUILD a globally accessible variable 2021-01-21 09:47:59 +01:00
Franco Fichtner 38ee2fa1d4 config: untangle SETTINGS and ABI
In case we want a custom config directory but a matching ABI.
2021-01-20 16:51:37 +01:00
Franco Fichtner d6111ee42a build/ports: do not overwrite global SELF and IMAGE
While here cleanup_packages is highly ambiguous.  Use
prune_packages instead as we remove stale or incompatible
packages from the set.
2021-01-20 16:25:45 +01:00
Franco Fichtner 8742d7295d build/ports: continue faulty builds unless rebuilding
Add a bit of reporting glue to get better visibility of
ports doing rebuild bouncing.
2021-01-20 15:22:07 +01:00
Franco Fichtner 494aec7ce5 build: stop phalcon4 from rebuild bouncing
PHP default changed upstream and here deal with this with
a mininal fix passing our PHP version along.
2021-01-20 14:17:30 +01:00
Franco Fichtner 9779a6ab51 build/skim: condense print to categories 2021-01-20 12:43:03 +01:00
Franco Fichtner 7375a65098 build/ports: reverse logic 2021-01-19 13:39:21 +01:00
Franco Fichtner 6f544155a4 build/sign: do not add a marker, there is no reader 2021-01-18 17:29:17 +01:00
Franco Fichtner 6aa26b27d6 build/ports: SELF is actually ports, no need to list twice 2021-01-18 17:27:12 +01:00
Franco Fichtner 553bf8a787 build/ports: only add aux.conf if packages step has not been executed
For hotfixes it will start to build go and rust even if it does not
need it.

For the cases where e.g. suricata rebuild requires rust use the
non-packaged packages set or let rust build during dependecy build.
2021-01-18 17:22:38 +01:00
Franco Fichtner c3f66077b4 build/clone: add new helper 2021-01-18 11:50:37 +01:00
Franco Fichtner 3bc587dcb8 build/prefech: use PRODUCT_ABI when no manual version was set
Makes prefetch work out of the box. The initial version is very
likely capable of building packages for the whole series.
2021-01-13 11:15:18 +01:00
Franco Fichtner ba273a9f49 build/serial: remove debug output 2021-01-11 14:02:44 +01:00
Franco Fichtner c68563ca3e config: expose PRODUCT_ABI to ports
Fixup PRODUCT_LUA replacement while here.
2021-01-11 11:46:02 +01:00
Franco Fichtner 84aefa59b0 config: support UEFI in serial images, off by default for now; closes #138
While here switch images to UFS2.
2021-01-07 15:58:47 +01:00
Franco Fichtner 7a7afca2f7 build: unify generation message 2020-12-14 12:40:13 +01:00
Franco Fichtner 88b4152696 build: small typo that made .abi_hint file reappear in mtree db 2020-12-04 14:50:12 +01:00
Franco Fichtner 123b8977cf build: test pkg and git binaries; closes #197 2020-09-12 17:04:30 +02:00
René Bayer e760f313b7
Fixed object paths for cross compiling (#194) 2020-08-21 09:52:23 +02:00
Franco Fichtner b3195a89c7 build/tools: we only support 12.1 now 2020-07-26 06:00:37 +02:00
Franco Fichtner db2421cfb3 Revert "build: do not enter 20.7.r description territory on 20.1"
This reverts commit 84e5ec467a.
core doesn't actually use "git_describe" so we are fine here.
Added a similar commit in the core repository that actually works. ;)
2020-07-23 12:30:09 +02:00
Franco Fichtner 35d1e1138f build/boot: "we can be errors, just for one day" 2020-07-21 17:50:04 +02:00
Franco Fichtner 460071a688 build/boot: make boot script run on 12.1 2020-07-21 09:11:32 +02:00
Franco Fichtner 84e5ec467a build: do not enter 20.7.r description territory on 20.1
Due to an issue with pkg upgrade -f[1] and lack of a better approach
we will avoid version parity beween 20.1 and 20.7 development branches
by omitting 20.1 from using the RC tag for versioning.

This allows us to force an upgrade always even though the actual
version is going backwards.  It doesn't really matter then because
we seek full transition into the new packages that have been published
and not try to outsmart the upstream repo's efforts to keep everything
in sync.

[1] https://github.com/freebsd/pkg/issues/1806
2020-07-19 20:27:27 +02:00
Franco Fichtner ea8344b0b8 build: only fetch "origin" as some remotes may not respond 2020-07-16 08:41:22 +02:00
Franco Fichtner 3a3d35f3ed build: new branches not being fetched at first try 2020-07-16 08:29:14 +02:00
Franco Fichtner d33488bb0c build/base: fixup FreeBSD 12.1 build issue with missing host file 2020-07-15 18:21:31 +02:00
Franco Fichtner c37230a777 build/rebase: .abi_hint file has no relevance here 2020-07-15 03:34:13 +02:00
Franco Fichtner 9b0ad3a4bf Revert "build/kernel: kldxref fixup, build host seems to be used"
This reverts commit 62e5d79c80.

It doesn't work still.
2020-06-07 11:55:31 +02:00
Franco Fichtner 96427357f4 build: add SRCABI usage and shared .abi_hint file; closes #179 2020-06-04 07:32:28 +02:00
Franco Fichtner e624dea4c2 build: add ABI hint to packages set 2020-06-04 05:46:36 +02:00
Franco Fichtner 62e5d79c80 build/kernel: kldxref fixup, build host seems to be used 2020-05-27 04:15:05 +02:00
Franco Fichtner e96cf8a95c build: support macOS for "make update" purposes 2020-05-17 10:26:30 +02:00
Franco Fichtner 145cad9e0b build/test: pass correct environment to tests
Avoids breakage of inline checks during test step.
2020-04-02 08:24:18 +02:00
Franco Fichtner 378b321ef2 build/nano: noatime as per forum mention 2020-03-17 08:50:14 +01:00
Franco Fichtner 9746b57855 build: pass FLAVOUR instead of poisoning the variable via env 2020-03-06 08:57:40 +01:00
Franco Fichtner bcfcd1c0ad build: fix typo 2020-02-24 09:17:23 +01:00
Franco Fichtner 603330a8f6 config: remove notion of version "3" Python, it's the default 2020-02-18 10:15:34 +01:00
Franco Fichtner 1f00c8b677 build: remove PYTHON2 selector, no longer used 2020-02-18 08:25:11 +01:00
Franco Fichtner dd5878fc78 build: print error when we hit this code branch 2020-02-09 08:51:55 +01:00
Franco Fichtner a34ba52382 build/ports: check here as well, no package at build start 2020-02-09 08:46:52 +01:00
Franco Fichtner f7213f9431 build/clean: core,plugins only makes sense if packages are there 2020-02-08 19:02:01 +01:00
Franco Fichtner a32ec5c46b build/sign: use args and regenerate mtree signature as well 2020-01-22 22:20:54 +01:00
Franco Fichtner f40de61925 build: we've use the term "base" for ages now 2020-01-22 15:47:26 +01:00
Franco Fichtner 379bf96c4a build: fix issue with "make update-portsref"
... which is only used with "make skim".  Since HBSD moves to another
git server soon this seems like a good idea to fix.
2019-12-23 07:32:23 +01:00
Franco Fichtner ba113bc6db config: should fix nightly test run on 20.1 development 2019-12-23 06:54:54 +01:00
Franco Fichtner 7043f012fe build/prefetch: correct branch required for SRCREVISION 2019-12-12 14:38:55 +01:00
Franco Fichtner 3c9c9219a5 build/upload: why not both 2019-12-12 14:26:32 +01:00
Franco Fichtner 6f4ce3c69a build/download: whoops :) 2019-12-12 14:20:57 +01:00
Franco Fichtner df6a9a0da0 build/download: support distfiles fetch 2019-12-12 14:19:38 +01:00
Franco Fichtner a60abeddae build: fix xtools on 12.1
While here allow SRCREVISION to be read everywhere.  The prefetch
script appreciates the additional info so it doesn't have to guess
anymore.  :)
2019-10-30 14:22:14 +01:00
Franco Fichtner b053261a9c build: pkg should be picked up instantly nowadays 2019-10-13 15:46:07 +02:00
Franco Fichtner e50d175fe7 build: add a real "package" target and aux.conf trickery
aux.conf harbours ports that are needed for the build and intermediate
package sets for testing and rebuilding, but that will ultimately be
removed from the sets when they are supposed to be uploaded to the mirror.
2019-10-13 15:46:07 +02:00
Franco Fichtner 1ea79d4de0 build: actually tell which argument is missing 2019-09-26 07:34:33 +02:00
Franco Fichtner 644f4a8e4e build: small tweaks here, 600 on both files 2019-09-25 13:16:18 +02:00
Franco Fichtner 1be9ee13c0 build: sign our mtree set files for later verification
Right now we trust the mtree file since we can't guarantee
consistency after unpack.  This way we will be able to warn
on unsigned mtree file or when the signature is wrong meaning
somebody meddled with the mtree file.

Should work for both base and kernel.

PR: https://github.com/opnsense/core/issues/3473
2019-09-25 13:15:26 +02:00
Franco Fichtner e6a5db5dd8 build: cope with new reality of pkg 1.11 2019-08-01 10:38:11 +02:00
Franco Fichtner b22e911fab build: add `fingerprint' target 2019-07-02 08:26:40 +02:00
Franco Fichtner 9f82a73dda build: force umount, busy error doesn't mean much in disposable chroot 2019-06-19 08:46:29 +02:00
Franco Fichtner 5ecee3f3c1 composite: allow access to all FLAVOUR settings
Makes it easier to modify stuff.  First one is mandatory, the rest is
eaten up by scripts to be passed down as required.
2019-06-10 17:55:58 +02:00
Franco Fichtner 9d77c902e3 build: remove QUICK support, rarely useful and undocumented 2019-06-03 08:25:26 +02:00
Franco Fichtner 820ab1fb81 build: use cp -R as -cp -r is actually -RL
And this is being disliked by a dangling python3 -> python3.6 link.
2019-05-19 13:31:33 +02:00
Franco Fichtner af7a5ac7cc nano: well, these go to 400000 2019-05-16 14:50:45 +02:00
Franco Fichtner 0657a0ae47 build/nano: increase free inode count by 250k
PR: https://forum.opnsense.org/index.php?topic=12639.0
2019-05-13 05:58:04 +02:00
Franco Fichtner 50533be115 build: we try to be too clever, need a shadow var for recursion 2019-05-08 06:49:45 +02:00
Franco Fichtner 44f4417854 build/download: this one as well 2019-05-08 06:33:34 +02:00
Franco Fichtner ed3c99c909 build/upload: sftp hurts my brain...
... but @adschellevis will be happier.  ;)
2019-05-08 06:22:54 +02:00
Franco Fichtner ada4a2bc4b device: finally only extrapolate the kernel config 2019-05-08 05:59:35 +02:00
Franco Fichtner dfefa3379f device: no ODROID and ORANGEPI for now #137 2019-05-07 13:57:59 +02:00
Franco Fichtner 24bf4e00c0 build/upload: fix this too 2019-05-07 13:46:09 +02:00
Franco Fichtner 1b6b45a72e build/base: typo 2019-05-07 13:03:04 +02:00
Franco Fichtner a7d78fcb79 build: always require device config 2019-05-07 12:22:34 +02:00
Franco Fichtner fd9e920b21 build: we need device in base set too 2019-05-07 12:10:31 +02:00
Franco Fichtner ea5155836e device: there is no RPI3 support in 11.2
Add it later when we have it, because if we keep it there will
only be questions why it doesn't work.
2019-05-07 13:48:49 +02:00
Franco Fichtner 6e54f6037a device: work on RPI2 image 2019-05-07 13:43:51 +02:00
Franco Fichtner 91d4ca4f62 build/arm: this works out of the box nowadays 2019-05-07 09:55:40 +02:00
Franco Fichtner 99beda883a build/arm: more changes 2019-05-07 07:12:26 +02:00
Franco Fichtner 415af5a2b6 build/arm: more on bananapi 2019-05-07 08:27:44 +02:00
Franco Fichtner 5dfee1c041 build: kernel set device name if device config does not unset 2019-05-06 19:49:31 +02:00
Franco Fichtner bb1b755b09 config: use "bananapi" as FreeBSD calls it, proper image 2019-05-06 19:41:34 +02:00
Franco Fichtner c2723e52b9 build: load DEVICE earlier for automatic ARCH change 2019-04-26 10:45:05 +02:00
Franco Fichtner 3924c19ba8 build: implement PRODUCT_WANTS, always check for git 2019-04-28 11:55:48 +02:00
Neko Prog 5f42f73c9e build arm: fix bananapi.dtb file name
Need to test bananapi image first from https://drive.google.com/drive/folders/1bAWuECNJwu0LdJOpaIn-2MrTKZ8evGNY. If it boots, this should be safe to merge. Else need to rename the copied bananapi.dtb too.
2019-04-24 23:55:39 +02:00
Franco Fichtner f309f0b269 build: adapt clean and rename to arm image naming change 2019-04-17 07:16:25 +02:00
Neko Prog e9877277cc arm: more device configs (#130)
* Add Orange Pi PC2 device config
* Add Odroid XU3/XU4 device config and update several arm configs
* Update odroid-xu3.conf
2019-04-03 20:21:00 +02:00
Neko Prog ef08bdeed8 Add RPI 2/3 Firmwares (#128) 2019-03-26 16:01:48 +01:00
Franco Fichtner 3cfaeed996 build/rename: typo in vm rename 2019-03-21 09:50:38 +01:00
Franco Fichtner 298118bb94 build/arm: small style fix 2019-03-17 13:03:51 +01:00
Neko Prog 9dcd73e003 Add cross build support for aarch64 and RPI3 config (#120) 2019-03-17 13:01:50 +01:00
Franco Fichtner 456a4c9fdc build/plugins: fix PLUGINSENV propagation 2019-03-14 11:27:15 +01:00
Franco Fichtner a26d020043 config: use RUST in amd64 only 2019-03-08 14:14:29 +01:00
Franco Fichtner d2d93e7285 build/dvd: subtle breakage in UEFI write for DVD on FreeBSD 11.2 2019-03-08 09:47:28 +01:00
Franco Fichtner 6b510f0b21 build: remove -dbg handling specialty
Prefetch should use VERSION=dbg-19.1 and rename will detect if it is
a debug set and keep the name in place.
2019-02-24 20:28:08 +01:00
Franco Fichtner 268c3e023c build/update: typo 2019-02-24 01:10:12 +01:00
Franco Fichtner c9125cd700 build/arm: whitespace cleanup 2019-02-24 18:36:02 +01:00
Franco Fichtner 563165ede2 build: make DEVELBRANCH optional; closes #117 2019-02-24 18:33:44 +01:00
Neko Prog 4355c16fa5 Kernel and Device config for Raspberry Pi 2 (#119) 2019-02-24 18:20:56 +01:00
Franco Fichtner 0eb37037bb build/kernel: need kernel-toolchain for build #113 2019-02-14 09:30:19 +01:00
Franco Fichtner a999844f36 device: bpi.conf and cross-build docs #113 2019-02-13 21:39:48 +01:00
Franco Fichtner c058582d0c config: switch to Banana Pi 2019-02-11 17:39:43 +01:00
Franco Fichtner e46b40bf5d build/distfiles: fetch actual port's distfile
This bug exists since December 2017 where we had to side-step
fetch-recursive because FLAVOUR git in the way...
2019-01-21 07:10:12 +01:00
Franco Fichtner 3657c59694 build: remove mixed version-arch marker
This has been obsoleted in opnsense-update and shall be removed
for our 19.1 builds.  Hooray for progress.
2019-01-12 14:35:55 +01:00
Franco Fichtner a8c8a0cf57 build: finish stopping to use the obsolete set 2019-01-09 07:44:48 +01:00
Franco Fichtner 1ef27c249b build: start to stop handling "obsolete" set which is obsolete 2019-01-09 08:10:17 +01:00
Franco Fichtner 2eeb64271e build: only set marker if there's no '.pkg-err' file
Build steps for packages predate the .pkg-err file so we had no
way of knowning about the integrity of a build.  Now we can
directly check the status of the build.

The side effect is that "make plugins" and "make core" will run
"make ports" if that failed and fail there.  While there's a
little overhead in automated scripts this is more consistent with
build flow as we do not start higher targets that depend on broken
dependencies that look correct.  This was reported a few times
over the years.
2019-01-02 15:20:22 +01:00
Franco Fichtner afdaf2e32d build: add architecture to sets as well 2018-11-28 11:44:49 +01:00
Franco Fichtner 2299aca0ed build: offset issue with wc(1) 2018-11-28 10:50:35 +01:00
Franco Fichtner 314878d80f build: support ".size" versioning extention for sets 2018-11-28 06:47:16 +01:00
Franco Fichtner bbd3e45d62 build: exclude /var from mtree file
/var MFS kills all of the files and it's extremely difficult to
construct a safe health check around the fact that they can be
missing.
2018-11-21 08:24:48 +01:00
Franco Fichtner 3c8edd00fe build: remove spurious WRKDIR change
It was needed at some point in the past but hasn't been useful
for a good while now.  Recently it broke because the plist test
is now run prior to 'package' target and while it may be fixed
there by creating the directory this code using a custom WRKDIR
is the bigger bug so good-bye. :)
2018-11-04 16:46:40 +01:00
Franco Fichtner 7070e7a06e build: only show generated sets 2018-11-04 12:51:31 +01:00
Franco Fichtner 6c3af6aed8 build/info: zap useless feature 2018-11-02 08:49:52 +01:00
Franco Fichtner 94acdfd303 build/rename: allow to rename compressed images as well 2018-11-02 03:49:21 +01:00
Franco Fichtner 474e3188b7 build: add disabled lock set for testing 2018-11-02 02:40:05 +01:00
Franco Fichtner 578adffefe build: show package set file size after completion 2018-11-02 07:18:34 +01:00
Franco Fichtner 4f5a745c52 config: more changes for Pyhton split
ansible and py-boto3 are missing for now.
2018-10-28 08:34:44 +01:00
Franco Fichtner 7852203f79 build/ports: copy wanted packages instead of recreate 2018-10-25 09:34:57 +02:00
Franco Fichtner 2d3f285bcc build/ports: rewrite caching; closes #101
At the price of more temporary build storage and initial double-
creation of packages this avoids all duplicated builds of build-
time dependencies and automatically discards them at the end.
2018-10-25 07:55:19 +02:00
Franco Fichtner b2ba62c97f build/rebase: small anotation for the future 2018-10-16 05:51:46 +02:00
Franco Fichtner 63ad5534f7 build: inject obsolete set into base set 2018-10-15 16:04:08 +02:00
Franco Fichtner 68e33100d4 build: unify a few moving parts before obsolete rework 2018-10-15 07:48:05 +02:00
Franco Fichtner b79da85b72 build: signature doesn't have to be there 2018-10-13 14:11:24 +02:00
Franco Fichtner da742c492e build: two small changes
* Always purge signatures when we can't generate new ones.
* Instead of testing who called us see if config files are there.
2018-10-14 12:53:28 +02:00
Franco Fichtner 5cf68c1729 build/base: repack set for mtree inclusion as well 2018-10-13 10:23:34 +02:00
Franco Fichtner f90365b32b build/kernel: (re)generate mtree file for later use 2018-10-13 09:50:32 +02:00
Franco Fichtner 1ca88f0d6c kernel: always repack kernel set like rename step does 2018-10-12 18:41:12 +02:00
Franco Fichtner 145bbf1904 build/ports: timestamp ports framework messages 2018-10-09 15:54:25 +02:00
Franco Fichtner a6f43962a2 build: do not start configd on image builds; closes #93 2018-10-09 15:34:50 +02:00
Franco Fichtner 6c6463722f build/kernel: 11.2 does not write empty debug set 2018-10-07 06:57:47 +02:00
Franco Fichtner d163224a84 build/ports: correct origin for deps locking, add log line
While here, move cleanup_packages to common for the sake of making
it easier to comment out for testing / development purposes.
2018-09-30 20:29:04 +02:00
Franco Fichtner 08e8cb2edd build/ports: log removal of a cached package
While here, cache py-sphinx package pulled in twice.
2018-09-30 05:09:14 +02:00
Franco Fichtner 52fa145122 build/ports: cache temporary packages for reuse 2018-09-29 08:19:28 +02:00
Franco Fichtner 0df1a58e3e build/download: add log target as well 2018-09-20 08:49:47 +02:00
Franco Fichtner 3f6a1c5265 scripts/nightly: only upload the current log set 2018-09-20 07:44:58 +02:00
Franco Fichtner deada0aa82 scripts/nightly: improve logs set directory structure 2018-09-18 22:51:28 +02:00
Franco Fichtner 30a58b3582 build/rewind: idea for development package issues 2018-09-18 21:46:59 +02:00
Franco Fichtner 29c2abe2b0 build/rewind: finish tag matching, add experimental rewind target; closes #71
For now this goes undocumented.  The trouble with rewind is:

1. To rewind we need to reset all repositories.  That only really
   works on top of the current branch.  Possible solution: only
   allow rewind for the currently up-to-date version.

2. The master branch development version is in the way and will
   probably prevent people from building older versions because
   of this or that mismatch.  Possible solution: allow a build
   without development packages included and maybe default to it.
2018-09-17 22:08:35 +02:00
Franco Fichtner 418b0eec9a build/confirm: simple but effective confirmation dialog 2018-09-17 02:26:49 +02:00
Franco Fichtner b1de3b4919 build/upload: simplify, we upload this as is 2018-09-16 00:21:51 +02:00
Franco Fichtner a7e5ac519b build/upload: more output for logs upload/unpack 2018-09-13 21:56:46 +02:00
Franco Fichtner 7315cf2f78 build: logs upload for nightly
Logs still have issues due to their incredible length, but
for now this makes daily checks easier than ever in any case.
2018-09-13 21:25:10 +02:00
Franco Fichtner 87c3dbc9c6 build/rename: VERSION -> PRODUCT_VERSION 2018-09-12 04:50:43 +02:00
Franco Fichtner 627b0be6ef build/clean: also clean compressed images 2018-07-04 15:22:19 +02:00
Franco Fichtner 8f1ba252e4 build/compress: one more tweak 2018-06-28 18:33:31 +02:00
Franco Fichtner c2ec836005 build/compress: compression stage; closes #56 2018-06-28 18:30:10 +02:00
Franco Fichtner 29d0b629c9 build: make some noise on stale PID
This should be fixed in ports now, but let's not gamble too much.
2018-06-28 07:47:48 +02:00
Franco Fichtner 1693cf43c3 build/distfiles: fix typo after last refactor; closes #81 2018-06-20 12:23:56 +02:00
Franco Fichtner bce2142f2e build/rename: needs manual adjustment for suffix 2018-05-28 08:12:04 +02:00
Franco Fichtner 488a87f9ac build: image names inherit suffix, easier to tell images apart 2018-05-28 08:07:10 +02:00
Franco Fichtner b4a8424107 build/ports: register build errors and version
Eventually the nightly build should continue and log failures
at the very bottom where they are easiest to review.  For now
start with logging the port build that caused the error and
then we'll work our way up to build continuation.
2018-05-07 18:07:00 +02:00
Franco Fichtner 5c79c07ad1 build/test: one bug fixed, another surfaced 2018-04-29 16:20:14 +02:00
Franco Fichtner bd75b54236 build: install additions before core to avoid spurious errors 2018-04-29 16:10:17 +02:00
Franco Fichtner 2873c9803c build/test: changes for tighter testing needed 2018-04-29 03:55:40 +02:00
Franco Fichtner 2fb26bf14e build/nano: disable TRIM by default
PR: https://github.com/opnsense/core/issues/2357
2018-04-14 19:05:42 +02:00
Franco Fichtner 95cff08473 build: do not overwrite version tag 2018-04-08 13:35:21 +02:00
Franco Fichtner 2e59e74cfb build: use the new defaults correctly 2018-04-01 10:04:43 +02:00
Franco Fichtner ac27bedd2d config: register all languages as modifiable versions 2018-04-01 08:34:46 +02:00
Franco Fichtner 21d3bae84e build: correct image download / upload 2018-03-23 05:44:47 +01:00
Franco Fichtner 2884a5fc8e build: add SERVER knob and PLUGINSENV 2018-03-17 09:13:29 +01:00
Franco Fichtner f630892161 build/download: also means we can end up copying directories 2018-03-15 09:03:09 +01:00
Franco Fichtner 7d73b4814b scripts/nightly: compress logs after run, leave latest/ open 2018-03-15 08:56:49 +01:00
Franco Fichtner d5319cc130 build/download: another new helper
Also fetch logs from a remote build server, but skip all uncompressed
directories because it slows down the download.

Next are two minor modications for nightly logging that reduce the
size of the log history and should compress the logs right after
the build is done.
2018-03-15 08:46:57 +01:00
Franco Fichtner e865e6f2e7 build/upload: new helper 2018-03-14 10:06:45 +01:00
Franco Fichtner 3e2b6c9594 build/release: small print issue 2018-01-23 22:51:40 +01:00
Franco Fichtner 084da75236 build/test: install the test tools at least 2018-01-15 20:11:35 +01:00
Franco Fichtner 7cc4ee4001 build/release: the signing key does not change 2018-01-11 09:12:21 +01:00
Franco Fichtner cdd79deaba build/test: solve plugin conflict differently for now 2018-01-08 22:43:50 +01:00
Franco Fichtner 74dbbf4b6f build: that particular time of the year... 2018-01-05 09:23:13 +01:00
Franco Fichtner 9007dc7064 build/ports: same fix as previous, FLAVOR cannot be empty 2018-01-05 09:21:11 +01:00
Franco Fichtner 2cf9b2820b build/skim: fix necessary after last ports skim 2018-01-05 09:13:41 +01:00
Franco Fichtner 5e3c643ea2 build/ports: smaller changes
* Directly bounce all packages after verify stage
* Weave pkg into the normal port build process
2017-12-10 08:22:43 +01:00
Franco Fichtner eea860cadf build/plugins: fix typo in manual plugins list 2017-12-09 11:58:08 +01:00
Franco Fichtner e50148a8a5 build/distfiles: fix fetch-recursive + FLAVOR fail
FreeBSD says "don't do that", but it's clearly an error on the
framework part.  To make the code more robust, kill the usage
of the fetch-recursive target and just do what we do in skim by
using all-depends-list.

When we have that list, we iterate over it with a small caveat:

We strip the flavor again to avoid breakage in the future which
could be pretty likely given that the functionality is very new
and not yet found to be used in its full potential.
2017-12-03 10:35:41 +01:00
Franco Fichtner 3b4c96ec17 build: more on FLAVOR support, small tweaks in reading 2017-12-01 06:44:31 +01:00
Franco Fichtner 2f9806ca7a build: mostly FLAVOR support, some bug in fetch-recursive 2017-11-30 20:35:59 +01:00
Franco Fichtner 044618e7dd build: proper PHP version propagation, src.conf for kernel build 2017-11-28 07:19:23 +01:00
Franco Fichtner 042334ef50 build: make PHP version selectable from the top 2017-11-27 21:33:27 +01:00
Franco Fichtner 411addae4d build/update: allow pulling portsref, mostly working 2017-11-24 08:17:18 +01:00
Franco Fichtner 58e1c6e0c0 build: change paths to build directories
Discussed with: @adschellevis
2017-10-23 09:55:24 +02:00
Franco Fichtner 71fe06f98c build: fix PORTS_LIST / PLUGINS_LIST usage 2017-10-17 17:18:40 +02:00
Franco Fichtner 9f2aaaaa6d build: better ignore in distfile fetch 2017-10-16 22:27:17 +02:00
Franco Fichtner 971ffdb957 build/release: remove MD5 sums from release builds for 18.1
Discussed with: @lattera
2017-10-11 18:36:20 +02:00
Franco Fichtner 73087ffce2 build: revert some changes to serial/nano 2017-10-10 15:55:35 +02:00
Franco Fichtner 34cd5f0be9 build: flip args
PR: 3f85f895e3 (commitcomment-24399640)
2017-09-19 11:48:22 +02:00
Franco Fichtner b03f76d500 build/ports: clarify warning at the end 2017-09-13 05:13:53 +02:00
Franco Fichtner e5c81f8e1a build: create all required dirs on clone 2017-09-05 07:34:59 +02:00
Franco Fichtner 350fab299c build: remove by pkg glob alone, mixed port and plugins origin is tricky 2017-09-05 06:22:39 +02:00
Franco Fichtner 3f85f895e3 build/arm: sensible changes, some consolidation in other images 2017-09-05 06:14:01 +02:00
Franco Fichtner de69db6994 build/arm: we overwrote core hooks, more cautious approach 2017-09-03 14:46:46 +02:00
Franco Fichtner c56ebd53c9 build/arm: finish cross-building image, assorted cleanups 2017-09-03 12:36:50 +02:00
Franco Fichtner 66f5ef1d6e build/arm: add arm-based image generation code
This doesn't fully work yet, the +POST_INSTALL of core and
possibly plugins does not like the cross-build env yet.
2017-09-03 11:13:17 +02:00
Franco Fichtner 3db22a1241 build/base: temporary location for armv6 boot loader hints
Doesn't affect any other architecture so hardcoding for now is
ok.  Keep in mind this is RPI2 specific.
2017-09-03 08:38:54 +02:00
Franco Fichtner 4f9acbcb12 build/ports: bounce packages one by one
Cross-build will go OOM on i386 if we do a batch create.  This
seems to help.
2017-09-02 16:43:36 +02:00
Franco Fichtner 03062992c7 build/ports: txz is the package default 2017-09-02 15:00:15 +02:00
Franco Fichtner b721d322ab build: write nano like serial, refactor LABEL handling 2017-08-31 07:55:35 +02:00
Franco Fichtner a7860ec944 config: modifications for upcoming PRI2 test build 2017-08-29 09:24:46 +02:00
Franco Fichtner 2cedba570a build/kernel: always creates debug set, check if empty instead 2017-08-26 09:42:20 +02:00
Franco Fichtner 837c52fa54 build/test: repair os-* globbing
We can't install both types of plugins, so when SUFFIX= we need to
exclude "-devel".  Not the prettiest approach, but should do it in
99% of cases.
2017-08-26 08:27:08 +02:00
Franco Fichtner 30e0693df0 build/test: restrucure a tiny bit
The migrations don't run because PHP isn't active.  That's an issue
of configd never being initialised, which we came to before so we
may need a bootstrap template for both php.ini files just in case.
2017-08-21 09:55:31 +02:00
Franco Fichtner e571bac057 build/test: install globs as well
Still stalls in template regeneration, needs some thinking.
2017-08-21 09:35:06 +02:00
Franco Fichtner 71e7eca89d build: prevent start of configd during build runs 2017-08-21 09:16:23 +02:00
Franco Fichtner 0798736ee8 build/nano: small tweaks, label with "_" doesn't work here 2017-08-21 08:57:28 +02:00
Franco Fichtner 7217b3e952 build: REFTYPE is no longer used 2017-08-17 10:42:43 +02:00
Franco Fichtner fc0ad4d26c build/prefetch: always clear kernel, but allow kernel-dbg download 2017-08-17 10:16:26 +02:00
Franco Fichtner 8b2469f596 build/core: verify the COREDIR here as well 2017-08-17 09:38:46 +02:00
Franco Fichtner 43909930b1 build/plugins: mostly added during the 17.1 / 17.7 flip-flopping...
... it masks the fact that we have a plugin in our config that does
not exist on all trees yet.  That shouldn't happen.
2017-08-10 13:19:33 +02:00
Franco Fichtner 7d92b4de66 build/kernel: add debug set support 2017-08-07 08:45:06 +02:00
Franco Fichtner 281a3cd478 build: tell user about removal of non-git repo 2017-08-05 13:41:37 +02:00
Franco Fichtner c7758a578c scripts/nightly: another try in redirect 2017-08-05 13:34:20 +02:00
Franco Fichtner dec5379405 build: at least allow to clean the log directory 2017-08-05 13:18:52 +02:00
Franco Fichtner 12717fff77 scripts: add nightly script with basic logging support 2017-08-05 13:07:27 +02:00
Franco Fichtner a7112fd3e4 build: simplify the setup / update of repos
The `update' target has made several advances in the last months,
so that it can be used to collect new changes, switch to the correct
branch and also clone repositories as needed.
2017-08-05 12:45:13 +02:00
Franco Fichtner 3bf08a3cef build/nano: annotate Nano variety in root label 2017-07-29 21:11:11 +02:00
Franco Fichtner 8551e7359b build/skim: clear the buffer before going into the diff 2017-07-28 07:01:07 +02:00
Franco Fichtner 3454045c6a build: when signing, let it be know what we sign for 2017-07-26 15:25:36 +02:00
Franco Fichtner a2907560f3 build: speed up package search by simplifying+limiting glob pattern 2017-07-26 15:12:20 +02:00
Franco Fichtner 10be93bdab build/release: improve release script a bit more 2017-07-25 14:36:40 +02:00
Franco Fichtner d78e69138a build: add image signatures via openssl digest 2017-07-24 09:07:23 +02:00
Franco Fichtner 099c84312a build/skim: small tweaks here 2017-07-19 06:19:15 +02:00
Franco Fichtner 761f84e19a build/skim: patch in optional colordiff support 2017-07-18 07:52:15 +02:00
Franco Fichtner 0d8d31308a build: add a GITBASE option to pass through, clone if necessary
This makes "make update" update all and clone if necessary, this
will hopefully help people running into out-of-sync issues between
repositories.
2017-07-16 04:57:46 +02:00
Franco Fichtner 2b93218c0c build/update: update all if no argument given 2017-07-16 04:47:07 +02:00
Franco Fichtner fe20330d05 build/ports: use -s to hide trivia like done in base and kernel stage 2017-07-13 13:39:17 +02:00
Franco Fichtner 6ee7188ebe build: the new vmware tools have weird behaviour... 2017-07-12 08:37:39 +02:00
Franco Fichtner 15963da55b build: provide overrides for PLUGINS_LIST and PORTS_LIST
Makes it easier to run test builds without editing the respective
config file, e.g.

    # make ports-phalcon PORTS_LIST="www/phalcon"
2017-07-07 05:46:21 +02:00
Franco Fichtner 405a7e18d8 build: add QUICK mode, skipping optional things 2017-06-26 09:11:14 +02:00
Franco Fichtner a91453f371 config: add COREENV override for differing setups 2017-06-26 00:47:16 +02:00
Franco Fichtner 44b205efcd build: switch ports sync to HardenedBSD 2017-06-13 06:41:04 +02:00
Franco Fichtner 75a41f9c18 build/ports: fix premature exit when rebuilding 2017-06-11 20:19:23 +02:00
Franco Fichtner cccd73b433 build: always create 4 partitions instead of 3, Windows likes that
PR: https://forum.opnsense.org/index.php?topic=5121.0
2017-05-25 11:48:57 +02:00
Franco Fichtner f874ad8446 build/ports: print warnings at the end if we get there 2017-05-09 13:11:15 +02:00
Franco Fichtner 9ba857bfc0 build/ports: check integrity of a rerun, warn... 2017-05-08 16:44:18 +02:00
Franco Fichtner 5ac89b1ddd build/test: moving to phpunit6 2017-05-05 04:47:15 +02:00
Franco Fichtner ed2e6966b3 build/test: remove cruft, run unittests from here 2017-05-04 17:04:04 +02:00
Franco Fichtner df43aa9126 build: fix argument scrubbing, remove obsolete gettext-tools from core 2017-04-27 19:14:36 +02:00
Franco Fichtner 1a6b8e9de7 build/skim: fix copy+paste fail 2017-04-25 09:03:40 +02:00
Franco Fichtner 2a509bae72 build/rename: add support for image types, clean up clean 2017-04-24 06:43:10 +02:00
Franco Fichtner fa79c8592c build/ports: query via origin as name is not always stable 2017-04-21 09:00:57 +02:00
Franco Fichtner 0dfeef2bec build/ports: use internal plumbing instead of globbing for files 2017-04-21 09:00:57 +02:00
Franco Fichtner 6786d4d7ec build: don't error when Latest has two versions, we don't care which 2017-04-21 08:23:39 +02:00
Franco Fichtner 1b48bc4aaf build: delete packages by origin as well 2017-04-21 08:16:40 +02:00
Franco Fichtner 9b492b90c2 build/ports: more improvements on previous
* Package files before cleaning the ports directories
* Properly package pkg when starting a new build
* Deal with conflicts in the pre-build sanity phase
2017-04-20 10:35:40 +02:00