You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+19-11Lines changed: 19 additions & 11 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -8,7 +8,7 @@ As more companies adopt GitHub Copilot, it becomes increasingly important to mea
8
8
9
9
Quantitative feedback from the Developer at the time of creating a PR provides valuable insights on the time savings experienced by the Developer. Time savings is needed first before other downstream impacts like velocity increases, or other improvements can happen. The level of granularity provides multiple feedback opportunities for Developers and can capture a variety of PRs so we can understand adoption challenges and improvement opportunities. If helpful, the Survey results may also be combined with Key Performance Indicators (KPIs) that the product provides to further contextualize the survey responses.
10
10
11
-
The survey responses are stored in a file called results.csv in a new branch "copilot-survey-engine-results" to provide insights into how developers are using the tool, the value they report, and the challenges they encounter.
11
+
The survey responses are stored in a file called **results.csv** in the **copilot-survey-engine-results** branch to provide insights into how developers are using the tool, the value they report, and the challenges they encounter.
12
12
13
13
We hope that this project provides value to your organization, and we encourage you to contribute and build upon it. Your contributions can help further enhance the survey capabilities and provide even greater insights into the developer experience with Copilot.
14
14
@@ -18,14 +18,14 @@ The application actively monitors three key events: the closure of a pull reques
18
18
19
19
### How a survey gets created
20
20
21
-
When a pull request is closed, the app automatically creates an issue that prompts the user with relevant survey questions. Our application is equipped to handle multiple languages, including English, Spanish, Portuguese, and French. For this, the engine performs a language analysis on the pull request description, matching it with the appropriate language when generating the corresponding issue.
21
+
When a pull request is closed, the app automatically creates an issue that prompts the user with relevant survey questions. Our application is equipped to handle multiple languages, including English, Spanish, Portuguese, and French. Selection will be made according to the `BOT_LANGUAGE` value in the .env file.
22
22
23
-
Note: *If the env file does not contain a Language API Key or Endpoint, the analysis will be skipped and the default language will always be English.*
23
+
> **Note**: *If the env file does not contain a value for `BOT_LANGUAGE` the default language will always be English.*
24
24
25
25
### Sample screenshot of a survey
26
26
### Copilot Usage Survey
27
27
28
-
1.***Did you use Copilot in developing this PR? (If you select No, just answer question 5***
28
+
1.***Did you use Copilot in developing this PR? (If you select No, just answer question 5)***
29
29
-[ ] No
30
30
-[ ] Yes
31
31
@@ -36,8 +36,8 @@ Note: *If the env file does not contain a Language API Key or Endpoint, the anal
36
36
(Example: The PR would normally take 5 days, but only took 4 days with Copilot then the answer is 20%)
37
37
-[ ] 0%
38
38
-[ ] > 0% but < 10%
39
-
-[ ]>11% but < 20%
40
-
-[ ]>21% but < 30%
39
+
-[ ]≥ 11% but < 20%
40
+
-[ ]≥ 21% but < 30%
41
41
-[ ] ≥ 31% but < 40%
42
42
-[ ] ≥ 41%
43
43
@@ -62,9 +62,9 @@ Note: *If the env file does not contain a Language API Key or Endpoint, the anal
62
62
-[ ] Work on other items in the backlog
63
63
-[ ] Other. Please explain in the comment
64
64
65
-
### Where does the app store surveys?
65
+
### Where does the app store survey results?
66
66
67
-
As we receive edits on the issue, the App will validate the responses received (options selected) and once all questions have been answered, the issue will be closed automatically and the responses will be saved into a results.csv file in the same repo in which the issue was created.
67
+
As we receive edits on the issue, the App will validate the responses received (options selected) and once all questions have been answered, the issue will be closed automatically and the responses will be saved into a results.csv file in the same repo in which the issue was created on a new branch called *copilot-survey-engine-results*.
68
68
69
69
## Setup. Deploy on your own environment
70
70
@@ -75,7 +75,7 @@ The web server is the minimum requirement for this app to work and can be hosted
75
75
76
76
### Step 1. Execute locally and configure secrets
77
77
78
-
To run the application on you local machine you'll need to have installed NodeJS. Once you have it, you can access to the folder where you've cloned this project and run the following:
78
+
To run the application on you local machine you'll need to have installed [NodeJS](https://nodejs.org/). Once you have it, you can access to the folder where you've cloned this project and run the following:
79
79
80
80
```sh
81
81
# Install dependencies
@@ -85,11 +85,19 @@ npm install
85
85
npm start
86
86
```
87
87
88
-
As a first time execution probot will prompt you for creating a new GitHub App or connect it with an existing App. As you complete the requested information, a .env file will get created in your local source code and all the private information regarding your GitHub App will be automatically written there. If you need guidance on how to configure your first GitHub App, please review this guide https://probot.github.io/docs/development/#configuring-a-github-app.
88
+
Once the service is running, you will see a listening endpoint in your terminal. Please follow the link, and you will find a screen like the following image.
89
+
90
+

91
+
92
+
As a first time execution probot is prompting you for creating a new GitHub App or connect it with an existing GitHub App. As you complete the requested information, a .env file will get created in your local source code and all the private information regarding your GitHub App will be automatically written there. If you need guidance on how to configure your first GitHub App, please review this guide https://probot.github.io/docs/development/#configuring-a-github-app.
93
+
94
+
> **Note**: Make sure to delete the `WEBHOOK_PROXY_URL` value from the env file and confirm that all details regarding the GitHub App are correct.
89
95
90
96
### Step 3. Deploy your App!
91
97
92
-
Once you have your source code deployed in the web server or hosting platform of your choosing, finally go to your GitHub App and update your webhook URL to reflect your Web Server URL.
98
+
Once you have your source code deployed in the web server or hosting platform of your choosing, finally go to your GitHub App General settings and update your webhook URL to reflect your Web Server URL.
0 commit comments