Commit graph

116303 commits

Author SHA1 Message Date
Pedro Algarvio
a749ec551a Start writing the release notes in markdown.
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-17 05:28:37 +00:00
Pedro Algarvio
d0630ae7af Move the check-changelog-entries pre-commit local hook to tools.
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-17 05:28:37 +00:00
Pedro Algarvio
3a04e21f70 Converted the changelog setup to markdown
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-17 05:28:37 +00:00
Pedro Algarvio
315e1c437d Drop Ubuntu 18.04
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-17 05:24:32 +00:00
Pedro Algarvio
94d6603ea1 Remove Photon OS 3 from the Jenkins builds
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-17 05:24:32 +00:00
Daniel A. Wozniak
990728fe46 Bump pyzmq to latest version on Windows 2023-02-15 14:24:35 -07:00
Pedro Algarvio
61a7bd94b1 Bump to python-tools-scripts==0.10.4
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-15 07:11:45 +00:00
Pedro Algarvio
e56d5d6a29 Wider output
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-15 07:11:45 +00:00
Pedro Algarvio
e4f4993fda A little logic change
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-15 07:11:45 +00:00
Pedro Algarvio
704e31ef31 We now also create a repository for the source tarballs.
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-15 07:11:45 +00:00
Pedro Algarvio
a37102e15e I think I finally nailed the onedir repo structure and repo.json generation
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-15 07:11:45 +00:00
Pedro Algarvio
99ddf1ac76 Add some output about collected versions
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-15 07:11:45 +00:00
Pedro Algarvio
48c44c9521 We don't really want the windows packages on the onedir repository
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-15 07:11:45 +00:00
Pedro Algarvio
f02ee2de98 Properly define os for the onedir repository
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-15 07:11:45 +00:00
Pedro Algarvio
da775a337a Fix yet another issue with onedir based repositories.
When there are two major release remotely, say 3006 and 3007, and we
released 3007.1, both major and latest symlinks would be created
properly.
If however we released 3006.3, the latest in the 3006 range versions, we
would not update the matching major.

Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-15 07:11:45 +00:00
Pedro Algarvio
8a4034c6d9 Fix major and latest handling for deb/rpm
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-15 07:11:45 +00:00
Pedro Algarvio
4c9269fc97 Fix the rpm .repo generation pointing to the old key names.
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-15 07:11:45 +00:00
Pedro Algarvio
4c8cc60629 Add tools/utils.py and move some common functionality there.
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-15 07:11:45 +00:00
Pedro Algarvio
f57bf390a3 Hopefully the final fix for the repo.json creation
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-15 07:11:45 +00:00
Pedro Algarvio
90b3f06625 Another fix to the repo.json generation
The top level `repo.json` should only include `latest` and Salt's major version.
The minor `repo.json` should include the minor version, and as a bonus, latest too.

Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-15 07:11:45 +00:00
Pedro Algarvio
ac22f0836d Factor out the gpg key export
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-15 07:11:45 +00:00
Pedro Algarvio
2c59d2d3d5 Factor out getting repo.json from the buckets
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-15 07:11:45 +00:00
Pedro Algarvio
6f4115919f Minor cosmetic change to the output written to GH Actions
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-15 07:11:45 +00:00
Gareth J. Greenaway
2e30ac0a02
Merge pull request #63606 from guvishal989/metadata_azure
Add support of exposing meta_server_grains for Azure VMs
2023-02-10 06:32:45 -08:00
Gareth J. Greenaway
f2691e3c94
running pre-commit manually 2023-02-09 11:07:07 -08:00
Gareth J. Greenaway
800ca02398
Merge branch 'master' into metadata_azure 2023-02-09 09:45:51 -08:00
Pedro Algarvio
a52652201f Export the GnuPG key instead of copying it over
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-09 05:37:59 +00:00
Pedro Algarvio
3630ebf110 Also use boto3 to download repo.json
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-09 05:37:59 +00:00
Pedro Algarvio
115ba148b3 Fix JSON loading
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-09 05:37:59 +00:00
Pedro Algarvio
7650854d12 Factor out the create repo path calculation.
It now also includes the initial path for the folders in the actual S3 buckets.

Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-09 05:37:59 +00:00
Pedro Algarvio
143c160d56 Start using our code to upload to S3.
Our code knows that it needs to delete the `latest` directories prior to
uploading.

Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-09 05:37:59 +00:00
Pedro Algarvio
e8c7bee17e We need to delete all local symlinks in the remote S3 bucket.
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-09 05:37:59 +00:00
Pedro Algarvio
9eda9161ce Add code to upload to S3 buckets
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-09 05:37:59 +00:00
Pedro Algarvio
4270c816c4 Make pkg-repo a repo sub-command for pkg
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-09 05:37:59 +00:00
Pedro Algarvio
54246055a8 Use our upload/download artifact actions
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-09 05:37:59 +00:00
Pedro Algarvio
9c713f4437 Add our own upload-artifact and download-artifact actions.
These compress the artifacts prior to calling the official
`{upload,download}-artifact` actions in order to preserve permissions
and symlinks.

Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-09 05:37:59 +00:00
Pedro Algarvio
292248f812 Be more explicit about using Jinja for templates
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-09 05:37:59 +00:00
Pedro Algarvio
3fa827925f Fix pre-commit by changing the pyzmq requirements.
It's now `pyzmq>=20.0.0` on all platforms, and `<=22.0.3` just for windows.

Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-09 05:37:59 +00:00
Pedro Algarvio
89eae05f8b We no longer use the environment variable
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-09 05:37:59 +00:00
Pedro Algarvio
8466afeb68 Fix the workflow concurrency group.
Without this change, if Salt has a `foo` branch, and a user with an
opened PR for which it's branch is `foo` will make each workflow cancel
each other on pushes.

Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-07 21:54:59 +00:00
Pedro Algarvio
e597888a2c Fix UnboundLocalError for out of scope variable
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-07 21:54:59 +00:00
Pedro Algarvio
58927f77c8 Format issues as links
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-07 21:54:59 +00:00
Pedro Algarvio
bc45a639d6 Strip white-space from included changelog
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-07 21:54:59 +00:00
Pedro Algarvio
0e65d2f106 Only update latest on the repo.json file if we're actually processing the latest version
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-07 21:54:59 +00:00
Pedro Algarvio
0362de7bce Add one more file extension which should not be copied over to pkg repos
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-07 21:54:59 +00:00
Pedro Algarvio
8a8ac0683b Always run the full test suite if the GitHub event is not pull_request
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-07 21:54:59 +00:00
Pedro Algarvio
dea4aa62b9 Validate, and normalize, the passed Salt Versions.
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-07 21:54:59 +00:00
Pedro Algarvio
6c819439b5 Add a few more nice to have hooks
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-07 07:10:13 +00:00
Pedro Algarvio
de0070b713 Properly handle .0 new style versions.
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-06 15:36:48 +00:00
Pedro Algarvio
e7c3ae3d27 Update to latest golden images
Signed-off-by: Pedro Algarvio <palgarvio@vmware.com>
2023-02-06 07:27:05 -07:00