Skip to content

Amazon EC2

Jump to bottom
Frédéric Wang edited this page Jun 23, 2012 · 19 revisions

The testing framework is being experimented on Amazon EC2. A more complete documentation will be available when the installation is done.

Amazon EC2

Pricing

  • Amazon EBS Snapshots to Amazon S3 (http://aws.amazon.com/en/pricing/ebs/).

    • Used to store images of Linux and Windows machines. Amazon S3 storage cost.

  • Amazon Virtual Private Cloud (https://aws.amazon.com/en/pricing/vpc/)

    • Used to choose the private addresses assigned to instances. This is free.

  • Amazon S3 (http://aws.amazon.com/en/s3/pricing/)

    • mathjaxtest bucket is used to store MathJax results. Amazon S3 storage cost.
    • There is no Data Transfer charge for data transferred between Amazon EC2 and Amazon S3 within the same Region or for data transferred between the Amazon EC2 Northern Virginia Region and the Amazon S3 US Standard Region.
    • Do we pay if we download test results from the AWS Management Console?

  • CloudFront (http://aws.amazon.com/en/pricing/cloudfront/)

    • Do we need to provide a public Web access to the test results (mathjaxtest bucket)?

  • Running Instances (during testing period only)

AWS Management Console

  • Instances

    • Windows and Linux instances in use

  • Images

    • AMIs: images of the machines.
      • Linux
      • Windows

  • Elastic Block Store

    • Volumes:

      • Windows and Linux volumes of instances in use

    • Snapshots:

      • Windows (30GiB)
      • Linux (8GiB)

  • Network & Security

    • Security Groups

      • mathjaxtest
      • ICMP, TCP, UDP from mathjax-test: allow total communication between member of the security groups.
      • HTTP allow connection to the Web interface
      • SSH: allow connection to the Linux machine
      • RDP: allow connection to the Windows machine
      • The VNC port is disallowed. Use VNC over a SSH session for better security.
      • The Windows machine also has its own security configuration in addition to the above setting. In particular, "10.0.0.30" is in the list of Internet Explorer trusted sites and the Windows Firewall has specific rules to accept connection from the task handler.

    • Key Pairs

    • mathjaxtest: key to use for remote access (SSH and RDP)

Starting the Testing Framework

  • Running an Instance

    • Click on Images => AMIs. Right click on an instance (Linux or Windows) and select "Launch Instance"
    • Choose an Instance Type, select VPC and Continue. Suggestion: use "High-CPU On-Demand Instances" for intensive testing. "Standard On-Demand Instances" may be fine otherwise. "Micro On-Demand Instances" can also be used to do maintenance tasks (they can't be used within a VPC).
    • Enter a private IP address for your instance, and Continue. The framework is configured to assume that IPs from 10.0.0.30 to 10.0.0.34 correspond to Linux machines while IPs from 10.0.0.40 to 10.0.0.44 correspond to Windows machines. Also the main machine (with the test suite, MathJax branches and Task Controller) is assumed to be 10.0.0.30.
    • Skip the next screen.
    • Choose the mathjaxtest Key Pairs and Continue.
    • Choose the mathjaxtest Security Groups and Continue.
    • Launch the instance.

  • Associating Elastic IP to an instance

    • Click on Network & Security => Elastic IPs
    • Allocate New Adress, choose VPC, Yes Allocate
    • Right Click on the Elastic IP => Associate
    • Associate IP to an instance, Yes Associate

Remote Access

  • Some SSH/VNC/RDP clients

    • Linux: vinagre (SSH, VNC), rdeskop (RDP)
    • Windows, Mac: ?

  • Linux Instance

    • Use a SSH client to connect to the instance.
    • Use the "screen" command to handle several windows. Quick guide to the screen environment: use "Ctrl + a, Ctrl + c" to create a new window, "Ctrl + a, Ctrl + n" to move to the next window, "Ctrl + a, Ctrl + p" to move to the previous window, use the "exit" command to close the current window and finally "Ctrl + a, Ctrl + d" to detach the screen session. When you detach a screen session, all the servers will keep running even if you logout from the SSH session. You can restore your screen session when you connect again with the command "screen -r" (provided the machine has not been stopped since your last connection).
    • In one screen window, use "~/start.sh" to start the VNC server. On the machine 10.0.0.30, this will also mount the mathjaxtest bucket on ~/MathJax-results/ and start the task handler.
    • If necessary, you may use a VNC client to connect to the instance.

  • Windows Instance

    • Use a RDP client to connect to the instance.
    • Open a Windows Session.

  • Web Interface

  • Directory Structure

    • Linux
      • ~/start.sh: Bash script to start Selenium and VNC servers.
      • ~/MathJax-test/: MathJax testing framework
      • ~/MathJax-results/: mount point for Amazon S3 bucket
      • ~/Desktop/Webdrivers/: Drivers for Chrome. Added to $PATH by ~/.bashrc.
    • Windows
      • ~\selenium-server.bat: Bat script to start the Selenium server.
      • ~\selenium-server.jar: Selenium server.
      • ~\Desktop\Webdrivers: Drivers for Chrome and Internet Explorer. Added to $PATH.

  • Installation (see Platform Supported)

    • Browsers: Firefox, Chrome, Internet Explorer, Safari, Opera, Konqueror.
    • Fonts: STIX and Mathjax fonts.
    • Plugin: MathPlayer
    • Selenium Servers (see directory structure)
    • Webdrivers (see directory structure)

Running the Tests

  • Starting Selenium servers

    • Linux: From a separate screen window, execute "~/seleniumServer.sh"
    • Windows: Open "Windows PowerShell" and execute ".\seleniumServer.bat"
    • If you have any problem to interrupt Selenium instances you may stop the server and run it again.

  • Creating task

  • Running task

Stopping the Testing Framework

  • Saving the test results to Amazon S3 The test results are saved on the main machine in MathJax-test/web/results/. They will be cleared when the instance terminates. To save a copy to Amazon S3, just copy the relevant files in ~/MathJax-results/.

  • Terminating an Instance Warning: this will totally clear the instance and its associated volume. Be sure to save unfinished task before doing so. In particular save a copy of the test results to Amazon S3. See also "Maintenance of the Testing Machine" if you need to update the AMIs.

    • Right Click on an instance and select terminate.
    • Check "Release Elastic IPs", Yes Terminate

Maintenance of the Testing Machine

  • Preserving the state of the Linux or Windows machines Instances Actions => Create an AMI file. After a moment, a new AMI image and Snapshot will be created. You can now terminate the instance and delete the former AMI and Snapshot. Problem: it may be easy to unintentionally delete the Snapshot of a machine.

MathJax Uncyclo

Clone this wiki locally