This document pretends to put everything that is important to check before doing a full site release as well as to how to do it, to ensure that the site fully works upon the release of a new version.
Depending on the nature of the changes, only some sections of this list will be relevant - Feel free to focus only on those you deem most important.
If you think we are missing any important point, we greatly appreciate suggestions.
First things first, we'll use the beta environment as it lets us run the site under additional checks that will automate some of the problem detections for us.
To run the new version on the beta environment we'll use the ce utility:
Ensure that the beta environment is active by running ce --env beta environment start - You can skip this step if it‘s already running from a previous run or if you’d rather boot it once the current version is marked as active.
Check what versionId the desired commit has. This can be checked on the Travis CI build logs as its build number for that specific commit, or by running ce --env beta builds list which shows a list of the most recent builds with their corresponding commit hash.
Once you have the desired versionId, mark it as the current version to be used by running ce --env beta builds set_current {versionId}
If needed, you can now restart the currently running instances with ce --env beta instances restart if needed.
Once this is finished, the /beta endpoint should be ready for testing.
--ensureNoIdClash flag shutting the app down if it detects one or more pairs of compilers sharing the same id even if they belong to different languages. An error should be logged with the culprits for easy debugging.In-depth documentation follows below, but once the beta site is running, some basic checks include: