Reference no: EM133759295
Software Measurement and Testing
QUALITY RISK ASSESSMENT
Imagine a company is implementing a brand-new software system, and they want to ensure they deliver the highest quality of software to their customers. A primary approach for delivering high quality software is to conduct a quality risk assessment early in the software development lifecycle, to identify project and product risks that can be mitigated (treated) by testing and quality assurance activities. This allows us to strategise and plan an approach to testing and QA that prevents and detects defects much earlier in the lifecycle.
Generative AI can be helpful for brainstorming quality risks, but can we trust it to do the job for us? The aim of this assignment is to:
Demonstrate your capabilities in conducting a quality risk assessment, and
Learn the advantages and limitations of using generative AI to identify project and product risks.
You are welcome to use ideas and materials from lecture 2 and lab 2 to support this assignment, and the risk assessment questionnaire that has been provided for lab 2 and the assignment..
Assignment
This is an individual assignment. You are not permitted to work in groups when writing your answers to this assignment.
Leaíning Outcome 1: Relate the multiple industry-based roles involved in modern software testing
Assignment Tasks
The following tasks are mandatory and must be completed for this assignment.
Task 1 - Quality Risk Assessment
In this task, you will conduct a quality risk assessment for a chosen customer and system, based on the quality characteristics and sub-characteristics in the ISO/IEC 25010 product quality model.
You are not permitted to use generative AI for this task. All ideas and answers must be your own. All answers must be written in your own words.
Complete the following tasks:
Choose a customer and system as the basis for your quality risk assessment. Specify the customer's name, system name (if known), and briefly describe the system.
You do not need to submit a customer profile for this task (although you may find the process we followed in lab 1 will support you in understanding your chosen customer).
Using the ISO/IEC 25010:2023 product quality model, and the risk assessment questionnaire provided in lab 2, identify a set of project and product risks for your system. For each risk, identify potential impacts, risk levels, and risk mitigations (including preventative and detective testing & QA activities that can mitigate each risk).
Include the following in your risk assessment:
At least 1 risk per sub-characteristic from the ISO/IEC 25010:2023 product quality model (i.e. minimum 40 risks). To support the process, read the risk assessment questionnaire, and consider how each characteristic and sub-characteristic might matter to your customer and their stakeholders (e.g., executives, managers, customers, staff, end-users). Please ensure you list the quality characteristic and the sub-characteristic for each risk.
At least 1 risk per project risk type from the risk assessment questionnaire (i.e. minimum 8 project risks).
Identify potential impacts, risk levels and mitigations for each risk.
Document the above in a risk register.
Provide a risk matrix to support your assignment of risk level.
Task 2 -AI-Generated Quality Risks
In this task, you will use a generative AI tool to generate quality risks for the same customer and system.
The aim is to find out what types of risks generative AI tools are able to produce, based on their current levels of capability. You do not need to reword or improve the risks or mitigations.
For the same customer and system, use the generative AI tool to complete the following tasks:
Choose a generative AI tool, specifying the name and URL of the tool.
For the same customer and system, ask the tool to generate:
A set of 40 (minimum) product quality risks. You may need to run a series of prompts to generate a minimum of 40 risks.
A set of 8 (minimum) testing project risks.
Potential risk impacts, risk levels, and risk mitigations including preventative and detective testing and QA activities, for each risk.
Document the above in a risk register.
Document the prompts that were used to generate the above.
In this task, you will compare the risks you identified, against those that were generated by the AI tool.
You are not permitted to use generative AI for this task. All ideas and answers must be your own. All answers must be written in your own words.
Compare the risks that were identified in tasks 1 and 2, providing answers to the following questions (including rationale/justification for each answer):
Did the AI tool generate any risks that were not included in your risk register?
Would any of the new risks have been useful to include in your risk register (e.g., to produce a higher-quality system for the customer)?
Were any of the new risks not useful?
Were any ISO/IEC 25010:2023 product quality sub-characteristics missed by the AI tool?
Which sub-characteristics were missed?
Why do you think they were missed?
Could any of the missing sub-characteristics impact on the quality of the system?
Did the AI tool introduce any new risk types that were not included in the ISO/IEC 25010:2023 product quality model?
Were they useful?
Would they be useful to include in the ISO/IEC 25010 product quality model?