Commit graph

127 commits

Author SHA1 Message Date
Pedro Algarvio
d0630ae7af Move the check-changelog-entries pre-commit local hook to tools.
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-17 05:28:37 +00:00
Pedro Algarvio
315e1c437d Drop Ubuntu 18.04
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-17 05:24:32 +00:00
Pedro Algarvio
e4f4993fda A little logic change
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-15 07:11:45 +00:00
Pedro Algarvio
704e31ef31 We now also create a repository for the source tarballs.
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-15 07:11:45 +00:00
Pedro Algarvio
a37102e15e I think I finally nailed the onedir repo structure and repo.json generation
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-15 07:11:45 +00:00
Pedro Algarvio
99ddf1ac76 Add some output about collected versions
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-15 07:11:45 +00:00
Pedro Algarvio
f02ee2de98 Properly define os for the onedir repository
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-15 07:11:45 +00:00
Pedro Algarvio
da775a337a Fix yet another issue with onedir based repositories.
When there are two major release remotely, say 3006 and 3007, and we
released 3007.1, both major and latest symlinks would be created
properly.
If however we released 3006.3, the latest in the 3006 range versions, we
would not update the matching major.

Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-15 07:11:45 +00:00
Pedro Algarvio
8a4034c6d9 Fix major and latest handling for deb/rpm
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-15 07:11:45 +00:00
Pedro Algarvio
4c9269fc97 Fix the rpm .repo generation pointing to the old key names.
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-15 07:11:45 +00:00
Pedro Algarvio
4c8cc60629 Add tools/utils.py and move some common functionality there.
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-15 07:11:45 +00:00
Pedro Algarvio
f57bf390a3 Hopefully the final fix for the repo.json creation
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-15 07:11:45 +00:00
Pedro Algarvio
90b3f06625 Another fix to the repo.json generation
The top level `repo.json` should only include `latest` and Salt's major version.
The minor `repo.json` should include the minor version, and as a bonus, latest too.

Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-15 07:11:45 +00:00
Pedro Algarvio
ac22f0836d Factor out the gpg key export
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-15 07:11:45 +00:00
Pedro Algarvio
2c59d2d3d5 Factor out getting repo.json from the buckets
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-15 07:11:45 +00:00
Pedro Algarvio
6f4115919f Minor cosmetic change to the output written to GH Actions
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-15 07:11:45 +00:00
Pedro Algarvio
a52652201f Export the GnuPG key instead of copying it over
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-09 05:37:59 +00:00
Pedro Algarvio
3630ebf110 Also use boto3 to download repo.json
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-09 05:37:59 +00:00
Pedro Algarvio
115ba148b3 Fix JSON loading
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-09 05:37:59 +00:00
Pedro Algarvio
7650854d12 Factor out the create repo path calculation.
It now also includes the initial path for the folders in the actual S3 buckets.

Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-09 05:37:59 +00:00
Pedro Algarvio
e8c7bee17e We need to delete all local symlinks in the remote S3 bucket.
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-09 05:37:59 +00:00
Pedro Algarvio
9eda9161ce Add code to upload to S3 buckets
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-09 05:37:59 +00:00
Pedro Algarvio
4270c816c4 Make pkg-repo a repo sub-command for pkg
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-09 05:37:59 +00:00
Pedro Algarvio
292248f812 Be more explicit about using Jinja for templates
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-09 05:37:59 +00:00
Pedro Algarvio
e597888a2c Fix UnboundLocalError for out of scope variable
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-07 21:54:59 +00:00
Pedro Algarvio
bc45a639d6 Strip white-space from included changelog
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-07 21:54:59 +00:00
Pedro Algarvio
0e65d2f106 Only update latest on the repo.json file if we're actually processing the latest version
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-07 21:54:59 +00:00
Pedro Algarvio
0362de7bce Add one more file extension which should not be copied over to pkg repos
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-07 21:54:59 +00:00
Pedro Algarvio
8a8ac0683b Always run the full test suite if the GitHub event is not pull_request
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-07 21:54:59 +00:00
Pedro Algarvio
dea4aa62b9 Validate, and normalize, the passed Salt Versions.
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-07 21:54:59 +00:00
Pedro Algarvio
03478f3eba Add a check workflow run workflow
This allows failed workflows to be restarted two more times, automatically,
if less than half of the jobs failed.

This workflow should be removed as soon as we can have a more stable
test suite by removing flaky test failures.

Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-05 18:10:30 +00:00
Pedro Algarvio
64280e9298 Don't copy hash files
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-05 01:20:01 +00:00
Pedro Algarvio
d8b5d2074e Only symlink latest and major if we're actually handling the latest release
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-05 01:20:01 +00:00
Pedro Algarvio
d1b412fe51 Reduce code duplication
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-05 01:20:01 +00:00
Pedro Algarvio
3430b629f9 Also create minor/repo.json for Windows/macOS/Onedir packages.
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-05 01:20:01 +00:00
Pedro Algarvio
32c848450b Mimic the same directory structure as DEB and RPM repos
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-05 01:20:01 +00:00
Pedro Algarvio
0dfa4bc901 Adjust to the 2023 Salt Project GPG key.
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-04 14:11:36 +00:00
Pedro Algarvio
0af788e4fe Building documentation is now part of the prepare release step.
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-04 14:11:36 +00:00
Pedro Algarvio
0421d3da67 Some improvements to the selection of which jobs should run
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-04 14:11:36 +00:00
Pedro Algarvio
76183f094d Rename define-jobs to runner-types which is what it actually does
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-04 14:11:36 +00:00
Pedro Algarvio
bbb3214c1c Start building the Onedir repo
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-02 10:39:55 +00:00
Pedro Algarvio
1315b323d7 Start building the macOS repo
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-02 10:39:55 +00:00
Pedro Algarvio
94ed425ddb Start building the Windows repo
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-02 10:39:55 +00:00
Pedro Algarvio
94af5e2541 Lay down the .repo files for the RPM repo
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-02 10:39:55 +00:00
Pedro Algarvio
2f2c32f8cb Nightly build repos shall be placed on a directory named by the current date (YYYY-MM-DD)
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-02 10:39:55 +00:00
Pedro Algarvio
156215a33f Rename dev-build support to nightly-build, and add rc-build support
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-02 10:39:55 +00:00
Pedro Algarvio
8574012381 All RPM distributions support ARM
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-02 10:39:55 +00:00
Pedro Algarvio
59ff75ec27 Start building RPM repos
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-02 10:39:55 +00:00
Pedro Algarvio
b4e14cbcbd There's no real reason why we can't also include Debian 10 Arm package in the repo
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-02 10:39:55 +00:00
Pedro Algarvio
b5cd1c8303 Actually build, and upload the nightly builds. Just DEB's for now.
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-02 10:39:55 +00:00