Test Pilot Program update: week ending 2018-07-27

Test Pilot

  • Launched both Lockbox and Notes on the Test Pilot platform, 2018-07-10.

  • Biggest referrer on launch day was the story on blog.mozilla.org.

  • Made metrics updates and pushed a release to stage 2018-07-12.

  • Planning for the second half of 2018 in progress.

  • Released a Screenshots update the week of 2018-07-26: three new annotation tools.

Cloud Storage

  • Shield Study: launched 2018-06-28.

  • End date for the study was 2018-07-16. It is self-expiring and users are being unenrolled.

  • Initial findings were presented 2018-07-23.

  • 8800 respondents

  • 97% response rate

  • Google Drive, then Dropbox, then Microsoft One Drive, then iCloud.


  • Continuing to work on custom backgrounds in Color, just got drag & drop working.

  • Working on addressing performance issues; one significant bug was identified.

  • Working through new designs and use cases so this can eventually replace Personas Plus.

  • Red-lined design spec is being completed.

  • Small bugs being squashed.

Email Tabs

  • Working on acceptance criteria and experiment definition.


  • Expanded release to en global (was en_US) on 2018-07-18.

  • Work will begin on the Android app at the end of July.


  • Notes team has switched to the new Firefox Accounts Android component for authentication.

  • QA has started testing this change.

  • Feedback from surveys rolling in: checklists are most requested feature.


  • Backgrounds and file toasts are in place.

  • iOS prototype is working; needs UI cleanup still writing the plumbing pieces to get the webpack js bundle into the right place automatically when building the xcode project,

  • Up next: work on the equivalent of intents.

  • Multi-file support is working; new tests being added.

  • Close to pushing the new UI.

  • Updated Android APK is available.

  • Merging service workers into v next.

Side View

  • ~6500 users.

  • Led to ~12k more Test Pilot installs.

  • 20K referrals from a snippet that pointed to the Mozilla blog that was posted 2018-07-10.

  • Working to get Side View into Shield; PHD written and submitted for review.


  • Team is working on a new concept, based on the discussions in the Monthly MoCo meeting.

  • Preliminary max/diff surveys are in design.

  • Next steps/milestone are identified.

  • Resourcing is TBD.