Welcome to the topic about the first Phase of testing Translate.Next. If you haven’t done so already, please read our Testing Translate.Next topic first.
In this topic, we’ll explain the testing plan for this first phase. This is also where we will be collecting all your feedback.
Phase 1 Testing Plan
This testing will happen exclusively on our Pontoon staging site. We have not yet turn Translate.Next on on production, and only intend to do so once this phase is done and we have confidence in the state of our code.
Timeline
This testing Phase will last until the conditions to start Phase 2 are met, but will be split in rounds. For the first round, we ask that testers perform their tests before Sunday, April 14th. We will then gather your feedback, turn it into bugs, prioritize those, and work on fixing the most important issues. We will notify all interested testers (here and by email) when we start the next round for this Phase.
Preliminary steps
These steps must be completed before any testing.
- Go to Pontoon’s stage website
- Log in the same way you would do on production
- Go to the translate page for your preferred locale and the project of your choice
- Make sure Translate.Next is turned on (look in the top right corner)
Once you have completed these steps, please run one, some, or all of the following instructions.
Regular localization
Follow your usual workflow to get to strings that need to be translated into your preferred locale, and translate some of them. Please send translations with the “Make Suggestions” option on and off to test both cases. Try to use all the features you would normally use on Pontoon.
Reviewing
Search for strings that need to be reviewed (for most teams that would be unreviewed strings), and review them as you would normally. Approve some, reject some, propose better translations when appropriate, and so on.
Search
Search for a specific string in content, and make sure that results are coherent (one easy way to verify that is to run the same search on production and verify that the results match).
Machinery
Look for strings to translate, and use the Machinery tab to translate them. Please test as many different options as possible: from Translation Memory, from Machine Translation, with or without changes, etc.
Logged out
Log out of the website. Make sure you are still on Translate.Next (you can use the navigation bar for example, it is different than in the old Translate page). Then verify that you cannot make any changes (sending, approving or rejecting translations).
Push the boundaries
To say it bluntly, we want you to break it. If you can find a behavior that doesn’t work as it does on the old Translate page, and it is not referenced in our bugs list, then you have likely found an issue. When that happens, please let us know by commenting here. See the Testing Translate.Next topic or the Report template below for more information about how to report an issue.
Why test on stage
This is important: this testing is happening on our stating instance, which means that none of the work you are going to be doing will be reflected in production data, or in any of the products you might contribute to.
We understand that this is not ideal, and that is part of the reason why we are only asking a small number of users to help us with this step. But, we do not want to risk breaking your team’s workflow, or a product’s integrity, because of potential bugs in our code. As soon as we are confident that our code is safe, we will turn to Phase 2, which will happen on production, where all your contributions will be shared with the rest of your team.
Report template
<ins>URL:</ins>
<ins>Description:</ins>
<ins>Expected outcome:</ins>
<ins>Steps to reproduce:</ins>
1.
2.
3.
