-
Notifications
You must be signed in to change notification settings - Fork 3
chore: initial proposal for user feedback issue templates #196
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
|
||
**Dataset name**: [e.g. tsv2_blood, adamson_perturb, etc.] | ||
|
||
**Task name**: [e.g., clustering, embedding, label_prediction, etc.] |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We can fill this in for them since it's coming from a specific task's page
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
(still leave it here, just a call out)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Rethinking this issue type: It makes sense for now since the benchmarking assets (datasets, models) are currently part of the repo, but once we move these out of the repo's purview, this issue type form will no longer be appropriate. As discussed in Slack, Airtable might be better for capturing benchmark result feedback longer term.
@atolopko-czi and @ehoops-cz wanted to give you a heads-up that Katrina from the Salesforce team was added to this PR. Could you kindly remove her? I appreciate you! cc: @KatrinaCZI |
woops, wrong Katrina, corrected! |
For https://czi.atlassian.net/browse/VC-2619
@erin.hoops brought up that we intend to capture VCP feedback for benchmarks via a UI link that navigates to a Github issue form. To get a jumpstart on what information we might want to collect from users, I put together two issue templates.
Add user feedback issue templates, for use by VCP FE. Split into two templates, one for benchmarking results, another for cz-benchmark package (code) feedback.
This is just a draft to get started on ideation for what we actually want in the template(s)! (ChatGPT generated)