• CfP: LT 2016 - The Fifth International Workshop on Large-Scale Testing

    From Jack ZhenMing Jiang@21:1/5 to All on Mon Oct 12 18:51:19 2015
    The Fifth International Workshop on Large-Scale Testing (LT 2016)
    Co-located with ICPE 2016
    March 12, 2016
    Delft, Netherlands
    http://lt2016.eecs.yorku.ca/ =======================================================================

    Many large-scale software systems (e.g., e-commerce websites,
    telecommunication infrastructures, enterprise systems, etc.) must service hundreds, thousands or even millions of concurrent requests. Many field problems of these systems originate in their inability to scale to field workloads, rather than feature bugs. In addition to conventional functional testing, these systems must be tested with large volumes of concurrent
    requests (called the load) to ensure the quality of these systems.
    Large-scale testing includes all different objectives and strategies of
    testing large-scale software systems using load. Examples of large-scale testing are live upgrade testing, load testing, high availability testing, operational profile testing, performance testing, reliability testing, stability testing and stress testing.

    Large-scale testing is a difficult task requiring a great understanding
    of the system under test. Practitioners face many challenges such as tooling (choosing and implementing the testing tools), environments (software and hardware setup) and time (limited time to design, test, and analyze). Yet, little research is done in the software engineering domain concerning this topic. Moreover, prior large-scale testing research is largely focused on telecommunication applications and web-based e-commerce systems. Industry
    is focused primarily on creating tools to automatically drive specified
    load into the system under test (e.g., LoadRunner or Apache JMeter). In this workshop, we intend to bring together industrial practitioners and researchers to establish and grow an academic research community around this important
    and practical research topic. Especially as large-scale testing is gaining
    more importance, due to an increasing number of systems (on-premise and/or cloud-based systems) that need to serve thousands or millions of users.

    We solicit the following two tracks of submissions: technical papers
    (maximum 4 pages) and presentation track for industry or experience talks (maximum 700 words). Technical papers should follow the standard ACM SIG proceedings format and need to be submitted electronically via EasyChair (https://www.easychair.org/conferences/?conf=lt2016). Extended abstracts
    need to be submitted as "abstract only" submissions via EasyChair. Accepted technical papers will be published in the ICPE 2016 Proceedings. Materials
    from the presentation track will not be published in the ICPE 2016 proceedings but will be made available on the workshop website. Submitted papers can be research papers, position papers, case studies or experience reports addressing issues including but not limited to the following:

    - Proper and accurate definition of test requirements

    - Efficient and cost-effective test execution and test monitoring

    - Rapid and scalable analysis of the test results

    - Case studies and experience reports on large-scale testing

    - Large-scale testing on emerging systems (e.g., adaptive/autonomic systems
    or cloud services)

    - Taxonomies of testing large-scale software systems

    - Large-scale testing in different software development contexts (e.g., agile,
    DevOps, and outsourced)

    - Using performance models to support large-scale testing

    - Efficient test data management for large-scale testing

    Important Dates
    - Technical Papers: November 23th, 2015
    - Presentation Track: February 1st, 2016
    - Paper Notifications: December 4th, 2015
    - Talk Notifications: February 8th, 2016
    - Camera Ready: December 8th, 2015
    - Workshop Date: March 12th, 2016

    Workshop Organizers
    - Christian Vogele, fortiss GmbH, Germany
    - Zhen Ming (Jack) Jiang, York University, Canada

    Program Committee
    - Bram Adams (Ecole Polytechnique de Montreal, Canada)
    - Cor-Paul Bezemer (Queen's University, Canada)
    - Andreas Brunnert (RETIT, Germany)
    - Thomas Cerqueus (Universite de Lyon, France)
    - Christoph Csallner (University of Texas at Arlington, USA)
    - Shaun Dunning (NetApp Inc., USA)
    - Vahid Garousi (Hacettepe University, Turkey)
    - Shadi Ghaith (IBM, Ireland)
    - Robert Heinrich (Karlsruher Institute of Technology, Germany)
    - Robert Horrox (EMC Isilon, USA)
    - Pooyan Jamshidi (Imperial College London, UK)
    - Samuel Kounev (University of Wurzburg, Germany)
    - Diwakar Krishnamurthy (University of Calgary, Canada)
    - Alexander Podelko (Oracle, USA)
    - Weiyi Shang (Concordia University, Canada)
    - Gerson Sunye (University of Nantes, France)
    - Andre van Hoorn (University of Stuttgart, Germany)

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)