Creating and Updating Scenarios in Web-based Testbeds
The web-based architecture adds to testbeds key advantages like results sharing, remote test execution, and collaboration. However, complexity of the testbed’s configuration data might undermine the performance due to large data amounts. As a result, the tremendous amounts of data generated by a testbed need to be processed and sent from the testbed server to the web UI, which is non-trivial. Additionally, a web-based testbed evolves its collaboration and remote execution possibilities by dynamically configuring its evaluations. The respective CRUD operation on the configuration files, which are also called scenarios, must be usable and performant while those might be large in data size.
The goal of this thesis is to develop an approach for dynamic configuration of web-based testbeds by handling also larger configurations usable and performant. To achieve this goal, creation of scenarios, updating existent scenarios, and large data exchange between User Agent and Web Server are the main challenges to solve. While the creation requires a wizard-a-like workflow in the Web UI, the update of scenarios requires an intelligent partial loading of larger scenarios, as well as how to submit them back to the testbed. To prove feasibility of the shown concept, the thesis makes use of an existent web-based testbed aTLAS, which already implements the core of the web-based testbed architecture. The evaluation of the system will be conducted based on various metrics, such as the performance of the testbed, and the usability and effectiveness of the front-end. The evaluation will be done using real-world data and will involve user testing to ensure that the system is effective and user-friendly.
The objective of this master’s thesis is to find an approach or a combination of approaches to solve the previously mentioned problem in the context of web-based testbeds and large scenarios. This particularly includes the state of the art regarding (web-based) testbeds and how they work with large configurations. The demonstration of feasibility with an implementation prototype of the concept is part of this thesis as well as a suitable evaluation with exemplary use cases.