Skip to content

Send telemetry for notebook trust prompt selections #12964

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Jul 14, 2020
Merged

Send telemetry for notebook trust prompt selections #12964

merged 2 commits into from
Jul 14, 2020

Conversation

joyceerhl
Copy link

As requested by @ronglums 😊

  • Pull request represents a single change (i.e. not fixing disparate/unrelated things in a single PR).
  • Title summarizes what is changing.
  • Has a news entry file (remember to thank yourself!).
  • Appropriate comments and documentation strings in the code.
  • Has sufficient logging.
  • Has telemetry for enhancements.
  • Unit tests & system/integration tests are added/updated.
  • Test plan is updated as appropriate.
  • package-lock.json has been regenerated by running npm install (if dependencies have changed).
  • The wiki is updated with any design decisions/details.

RunByLineVariableHover = 'DATASCIENCE.RUN_BY_LINE_VARIABLE_HOVER',
TrustAllNotebooks = 'DATASCIENCE.TRUST_ALL_NOTEBOOKS',
TrustNotebook = 'DATASCIENCE.TRUST_NOTEBOOK',
DoNotTrustNotebook = 'DATASCIENCE.DO_NOT_TRUST_NOTEBOOK'
Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

When do we use DATASCIENCE vs DS_INTERNAL?

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

THe original intent was DATASCIENCE was used for queries used by PMs I think. DS_INTERNAL was stuff we weren't sure we'd need? I can never remember. @IanMatthewHuff may remember. He implemented this distinction.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, it's supposed to be anything that is user triggered / part of a user action was DATASCIENCE. DS_INTERNAL is for things like tracking internal timings. DATASCIENCE is correct here as these are all user actions. The intent was to clarify our MAU numbers to make sure that we were only looking at users who were doing something with the product. For instance, auto starting the server (which can happen just from opening a workspace) was getting users counted in MAU even when they never did anything with our product.

Copy link
Member

@IanMatthewHuff IanMatthewHuff left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Might want to check with rong on the one comment that I made. Not sure if PMs care about the total view of the message.

Copy link
Member

@IanMatthewHuff IanMatthewHuff left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approving based on just adding the "prompt shown" telemetry that Rong mentions.

@sonarqubecloud
Copy link

Kudos, SonarCloud Quality Gate passed!

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities (and Security Hotspot 0 Security Hotspots to review)
Code Smell A 0 Code Smells

No Coverage information No Coverage information
0.0% 0.0% Duplication

@codecov-commenter
Copy link

Codecov Report

❗ No coverage uploaded for pull request base (master@c217914). Click here to learn what that means.
The diff coverage is 83.33%.

Impacted file tree graph

@@            Coverage Diff            @@
##             master   #12964   +/-   ##
=========================================
  Coverage          ?   60.06%           
=========================================
  Files             ?      670           
  Lines             ?    36520           
  Branches          ?     5127           
=========================================
  Hits              ?    21937           
  Misses            ?    13487           
  Partials          ?     1096           
Impacted Files Coverage Δ
src/client/telemetry/index.ts 82.35% <ø> (ø)
...tascience/interactive-ipynb/trustCommandHandler.ts 80.39% <71.42%> (ø)
src/client/datascience/constants.ts 99.77% <100.00%> (ø)
src/client/testing/common/types.ts 100.00% <0.00%> (ø)
src/client/common/installer/productInstaller.ts 86.16% <0.00%> (ø)
...ience/interactive-ipynb/nativeEditorViewTracker.ts 87.80% <0.00%> (ø)
...nt/interpreter/autoSelection/rules/workspaceEnv.ts 98.00% <0.00%> (ø)
src/client/datascience/jupyter/liveshare/utils.ts 14.28% <0.00%> (ø)
...tascience/kernel-launcher/kernelDaemonPreWarmer.ts 94.28% <0.00%> (ø)
src/client/datascience/datascience.ts 67.60% <0.00%> (ø)
... and 663 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update c217914...7879f2c. Read the comment docs.

@joyceerhl joyceerhl merged commit 374198b into microsoft:master Jul 14, 2020
joyceerhl added a commit that referenced this pull request Jul 14, 2020
* Send telemetry for notebook trust prompt

* Send telemetry when prompt is shown
joyceerhl added a commit that referenced this pull request Jul 15, 2020
* Only allow Enter / NumpadEnter w/o ctrl/shift/alt (#12939)

* Send telemetry for notebook trust prompt selections (#12964)

* Fixes for persisting trust (#12950)
karthiknadig added a commit that referenced this pull request Aug 5, 2020
* Update model.isTrusted on trust change (#12820) (#12823)

* Reduce visual complexity of trust prompt (#12839) (#12847)

* Port python 2.7 fix to release (#12877)

* port color fix on collapse all (#12895) (#12897)

* fix a color on collapse all (#12895)

* update changelog

* Merge fixes into July release (#12889)

Co-authored-by: Timothy Ruscica <[email protected]>

* Merge more fixes into july release (#12918)

Co-authored-by: Joyce Er <[email protected]>

* Port trust fixes (#12929)

* Fix regressions in trusted notebooks (#12902)

* Handle trustAllNotebooks selection

* Fix bug where after trusting, UI didn't update

* Recover from ENOENT due to missing parent directory when trusting notebook (#12913)

* Disable keydown on native cells in untrusted notebooks (#12914)

* Hide editor icons when editor is not a notebook (#12934) (#12935)

* Check for hideFromUser before activating current terminal (#12942) (#12956)

* Check for hideFromUser before activating current terminal

* Add tests

* Tweak logic

* Port final trust fixes for release (#12965)

* Only allow Enter / NumpadEnter w/o ctrl/shift/alt (#12939)

* Send telemetry for notebook trust prompt selections (#12964)

* Fixes for persisting trust (#12950)

* Display survey for native notebooks on/after 1st August (#12961) (#12975)

Co-authored-by: Joyce Er <[email protected]>

Co-authored-by: Joyce Er <[email protected]>

* Contains cherry picks, version updates, change log updates (#12983)

* Update version and change log

* Improve detection when LS is fully loaded for IntelliCode (#12853)

* Fix path

* Actually fix settings

* Add news

* Add test

* Format

* Suppress 'jediEnabled' removal

* Drop survey first launch threshold

* Wait for client ready

* Handle async dispose

* Fix the date

Co-authored-by: Mikhail Arkhipov <[email protected]>

* hide the gather button while a cell is executing (#12984)

* Update date (#13002)

* remove release notes from the start page (#13032)

* Cherry pick, version change and change log update (#13079)

* Ensure languageServer value is valid, send event during activate (#13064)

* Update change log and version

* Activate banner prompt for Pylance (#12817)

* Fix path

* Actually fix settings

* Add news

* Add test

* Format

* Suppress 'jediEnabled' removal

* Drop survey first launch threshold

* Remove LS experiments

* Frequency + tests

* Fix test

* Update message to match spec

* Open workspace for extension rather than changing setting

* Fix localization string

* Show banners asynchronously

* Add experiments

* Formatting

* Typo

* Put back verifyAll

* Remove obsolete experiments, add Pylance

* Suppress experiment if Pylance is installed

* PR feedback

Co-authored-by: Jake Bailey <[email protected]>

* Update change log as per comments

Co-authored-by: Jake Bailey <[email protected]>
Co-authored-by: Mikhail Arkhipov <[email protected]>

* Port fix the gather survey (#13086) (#13105)

* Fix the gather survey (#13086)

* fix the gather survey
added 'gather stats' telemetry
mention the gather comments to update the python ext

* oops

* fix tests and address comments

* update gather stats when resetting the kernel

* set globalstate vars to 0 when we open vs code

* fix gather stats telemetry

* fix tests

* fix tests for real

Co-authored-by: Joyce Er <[email protected]>
Co-authored-by: Ian Huff <[email protected]>
Co-authored-by: David Kutugata <[email protected]>
Co-authored-by: Don Jayamanne <[email protected]>
Co-authored-by: Timothy Ruscica <[email protected]>
Co-authored-by: Mikhail Arkhipov <[email protected]>
Co-authored-by: Jake Bailey <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
no-changelog No news entry required
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants