Repository navigation
stage kops/kubernetes to s3 buckets when running ec2 jobs - #18922
Conversation
8477265 to
3edf4c3
Compare
|
This is working correctly, we need the linked PR in k/release to be merged first. |
I am having some trouble understanding what's happening here. Was there a discussion that I missed somewhere? |
It's a continuation of #18662 but it also works on the build-kubernetes flag which your PR didn't modify. Also, getting kops e2e jobs to use ephemeral S3 buckets instead of gs://k8s-staging-kops/pulls has been a long-standing to-do item. (Eliminating the GCP egress fee as well as blocking presubmits from writing to the staging bucket.) |
3edf4c3 to
1fbd26c
Compare
|
The k/release PR has been merged. We can merge this PR now. |
Please try to understand, I am not aware of your intentions. |
1fbd26c to
a9eab27
Compare
hakman
left a comment
There was a problem hiding this comment.
Thanks, the S3 path works end to end in the calico and ec2-build logs. A few issues inline.
For the description: besides S3 staging, this fixes --build-kubernetes on AWS. Master rejects the default gs://k8s-staging-kops/pulls/... path, which is what fails pull-kubernetes-ec2-master-scale-correctness-2000 today. It also makes pull-kops-kubernetes-e2e-ubuntu-ec2-build actually run on AWS.
a9eab27 to
e702606
Compare
|
I applied all the suggestions. |
hakman
left a comment
There was a problem hiding this comment.
One more small change, please.
| } | ||
| results, err := d.BuildOptions.Build() | ||
| if err != nil { | ||
| return err | ||
| // kubetest2 does not call Down() when Build() fails, so the staging bucket would leak. | ||
| return errors.Join(err, d.deleteStagingStore()) | ||
| } |
There was a problem hiding this comment.
This only covers the builder failing. A defer catches all cases.
func (d *deployer) Build() (err error) {
// kubetest2 does not call Down() when Build() fails, so delete the staging bucket on
// every error, not only when the builder fails.
defer func() {
if err != nil {
err = errors.Join(err, d.deleteStagingStore())
}
}()
if err := d.init(); err != nil {
return err
}
results, err := d.BuildOptions.Build()
if err != nil {
return err
}e702606 to
8d6b8e3
Compare
|
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: hakman The full list of commands accepted by this bot can be found here. The pull request process is described here DetailsNeeds approval from an approver in each of these files:
Approvers can indicate their approval by writing |
|
/test pull-kops-e2e-kubernetes-azure |
|
/test pull-kops-e2e-k8s-aws-amazonvpc |
|
/hold cancel |
|
/hold |
8d6b8e3 to
f7b9aa6
Compare
|
/test pull-kops-e2e-kubernetes-azure |
|
/hold cancel All the tests are passing |
|
/lgtm |
|
Thanks! |
No description provided.