Generic Environment for Full Automation of Benchmarking标杆管理全自动化的一般环境.pptVIP

Generic Environment for Full Automation of Benchmarking Tomá? Kalibera, Lubomír Bulej, Petr T?ma History: Middleware Benchmarking Projects Vendor testing Borland, IONA, MLC Systeme Open source testing omniORB, TAO, OpenORB, … Open CORBA Benchmarking anyone can upload their own results Motivation: Regression Testing for Performance Regression Benchmarking Steps of Running a Benchmark Generic Benchmarking Environment Automated processing monitoring, handling of failures management tools Common form of results allow benchmark independent analysis raw data, system configuration Flexibility bench