Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Scheduler Performance Testing #18458

Merged
merged 3 commits into from Dec 21, 2015
Merged

Conversation

hongchaodeng
Copy link
Contributor

This resolves #18091.

The work currently is separate and standalone. I want to ask some questions w.r.t. existing dev flow:

  • How to integrate it with k8s overall structure? Specifically we want to add a trigger script in hack and also can compile these code in build.
  • How to ensure scheduler performance test (potentially other perf related test suite) are verified -- at least compiled, for new PRs. In the future we might want to integrate it into e2e test and reject any PRs that slows result dramatically.

@k8s-bot
Copy link

k8s-bot commented Dec 9, 2015

Can one of the admins verify that this patch is reasonable to test? (reply "ok to test", or if you trust the user, reply "add to whitelist")

If this message is too spammy, please complain to ixdy.

@hongchaodeng
Copy link
Contributor Author

@k8s-bot
Copy link

k8s-bot commented Dec 9, 2015

Can one of the admins verify that this patch is reasonable to test? (reply "ok to test", or if you trust the user, reply "add to whitelist")

If this message is too spammy, please complain to ixdy.

@xiang90
Copy link
Contributor

xiang90 commented Dec 9, 2015

/cc @lavalamp This extends your original work in integration test.

@k8s-github-robot
Copy link

Labelling this PR as size/L

@k8s-github-robot k8s-github-robot added the size/L Denotes a PR that changes 100-499 lines, ignoring generated files. label Dec 9, 2015
@timothysc
Copy link
Member

general comments before review. Is there a reason why you chose performance vs. component as we talked about in the sig.

Also please squash commits.

How To Run
------
```
cd kubernetes/test/performance/scheduler
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should have a kicker script from ./hack to follow all the existing patterns.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am keeping this standalone for now and seeking discussion here :)
How to better integrate it with k8s overall structure and ensure it won't be broken in future PRs?

@hongchaodeng
Copy link
Contributor Author

@timothysc , Thanks for the comments.

squash the commits.

I clean up the commits before submitting it. All commits do one thing specifically.

performance vs. component

That's easy to change. @davidopp links all these to "perf" issues. IMHO, "performance" sounds closer to what we are doing. We came up with "component" sort of hurried. Let's keep it open and collect opinions from all folks.

@xiang90
Copy link
Contributor

xiang90 commented Dec 9, 2015

@hongchaodeng Component seems to be more generic. We probably will want to add more correctness related test into here?


Future Work
------
A list of some future work:
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

for this readme I don't think you need to add future work, as it just outlines the tests. It's not a proposal.

@hongchaodeng
Copy link
Contributor Author

If we add correctness testing here, how could we separate it from integration test?
"component" sounds to include many aspects.

@timothysc
Copy link
Member

benchmarks/performance could be one aspect of component testing.

@hongchaodeng
Copy link
Contributor Author

I agree that we can change naming from "performance" to "component".
But this collection of work is about "performance".
How about make the directory like test/component/scheduler/perf

@timothysc
Copy link
Member

sgtm.

@ixdy
Copy link
Member

ixdy commented Dec 10, 2015

@kubernetes/sig-scalability someone here is probably better equipped to review this than I

@ixdy ixdy removed their assignment Dec 10, 2015
@hongchaodeng
Copy link
Contributor Author

@wojtek-t

The test suite relies on running etcd instance on http://localhost:4001. I skipped it in test-go.sh.

@k8s-bot
Copy link

k8s-bot commented Dec 17, 2015

GCE e2e test build/test passed for commit e3da7703b07307b60d131cf60ac63718b2c4d6e9.

@k8s-github-robot
Copy link

The author of this PR is not in the whitelist for merge, can one of the admins add the 'ok-to-merge' label?

@wojtek-t
Copy link
Member

@hongchaodeng - please squash the commits

@k8s-bot
Copy link

k8s-bot commented Dec 18, 2015

GCE e2e build/test failed for commit cf3505a7befb6c2ca94780d5721d3920e5a07766.

@k8s-bot
Copy link

k8s-bot commented Dec 18, 2015

GCE e2e test build/test passed for commit 9704222.

@hongchaodeng
Copy link
Contributor Author

@wojtek-t
Thanks! Squashed the commits. This is the best granular in my mind for separation.

@wojtek-t
Copy link
Member

LGTM

@wojtek-t wojtek-t added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Dec 21, 2015
@k8s-github-robot
Copy link

@k8s-bot test this

Tests are more than 48 hours old. Re-running tests.

@k8s-bot
Copy link

k8s-bot commented Dec 21, 2015

GCE e2e build/test failed for commit 9704222.

@wojtek-t
Copy link
Member

@k8s-bot test this please

@k8s-bot
Copy link

k8s-bot commented Dec 21, 2015

GCE e2e test build/test passed for commit 9704222.

@k8s-github-robot
Copy link

@k8s-bot test this [submit-queue is verifying that this PR is safe to merge]

@k8s-bot
Copy link

k8s-bot commented Dec 21, 2015

GCE e2e test build/test passed for commit 9704222.

@k8s-github-robot
Copy link

Automatic merge from submit-queue

k8s-github-robot pushed a commit that referenced this pull request Dec 21, 2015
Auto commit by PR queue bot
@k8s-github-robot k8s-github-robot merged commit 2efc738 into kubernetes:master Dec 21, 2015
@jdef
Copy link
Contributor

jdef commented Jan 4, 2016

/cc @sttts

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
lgtm "Looks good to me", indicates that a PR is ready to be merged. size/XL Denotes a PR that changes 500-999 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Scheduler Performance Testing Proposal