Release 1. This is the first release of this unit of competency in the DEF Defence Training Package.

This unit describes the skills and knowledge required to plan test and evaluation processes.

It includes identifying test requirements and undertaking scoping, determining test and evaluation methodology, developing and finalising test and evaluation plans.

This unit was developed for Defence test and evaluation workers but is applicable to any individuals who work in this field.

The skills and knowledge described in this unit must be applied within the legislative, regulatory and policy environment in which they are carried out. Organisational policies and procedures must be consulted and adhered to.

Those undertaking this unit would work independently or as part of a team, under direct and indirect supervision, use discretion and judgement, and take responsibility for the quality of their output. They would perform sophisticated tasks in a range of contexts.

No licensing, legislative or certification requirements apply to unit at the time of publication.

Not applicable.

Test and Evaluation.

Not applicable.

ELEMENTS 

PERFORMANCE CRITERIA 

Elements describe the essential outcomes.

Performance criteria describe the performance needed to demonstrate achievement of the element.

1  

Identify test and evaluation requirements and undertake scoping 

1.1 

Analyse the need for test and evaluation

1.2 

Undertake definition study, define system under test and determine scope and boundaries of the test and evaluation process

1.3 

Identify and engage with stakeholders to ensure requirements are addressed in planning

2 

Determine test and evaluation methodology 

2.1 

Undertake research and analyse to identify, assumptions, risks, constraining factors, impacts, alternate options and variations

2.2 

Analyse methodology, technical feasibility, supportability and cost-effectiveness and define reporting outcomes

2.3 

Assess alternatives for test and evaluation design

2.4 

Identify preferred test and evaluation options that best fits organisational requirements

2.5 

Consult relevant specialists to determine extent of potential risks

2.6 

Prepare business case and obtain approvals to proceed with test development

3 

Develop test and evaluation plans 

3.1 

Design and document planning process utilising management tools, in accordance with test and users’ requirements, in consultation with specialists

3.2 

Define aims, objectives and impacts in test plan and timeframes

3.3 

Identify resources to complete quality deliverables on time and within budget

3.4 

Determine test methods by consideration of resource constraints, environmental constraints, evidence requirements, existing capabilities and their compatibility with existing procedures

3.5 

Describe test conditions, tolerances, techniques, environments and the basis for assessment

3.6 

Develop indicators to monitor test performance and seek agreement by relevant stakeholders

3.7 

Investigate potential risks and identify them in the plan

3.8 

Establish a risk management process to analyse information and options

3.9 

Clarify and agree on skills, roles and responsibilities of team members and stakeholders, and identify reporting requirements

3.10 

Address management of test parameters in the plan and design evaluation criteria

4 

Finalise test plans 

4.1 

Identify requirements for data management, analysis, tools and storage

4.2 

Maintain security and confidentiality of data

4.3 

Promulgate and maintain test and evaluation plans and test plan approvals

4.4 

Define test safety requirements

Foundation skills essential to performance are explicit in the performance criteria of this unit of competency.

Range is restricted to essential operating conditions and any other variables essential to the work environment.

Non-essential conditions may be found in the DEF Defence Training Package Companion Volume Implementation Guide.

This unit supersedes and is equivalent to DEFTST001 Plan testing and evaluation processes.

Release 1. This is the first release of this unit of competency in the DEF Defence Training Package.

Evidence required to demonstrate competence in this unit must be relevant to and satisfy all the requirements of the elements and performance criteria on at least one occasion and include:

• applying risk management techniques
• negotiating timelines, roles and responsibilities with stakeholders and team members
• using planning techniques related to test and evaluation that may be complex in terms of scope; degree of risk; environmental, political, cultural and social factors that apply; consequences of failure and degree of control.

Evidence required to demonstrate competence in this unit must be relevant to and satisfy all the requirements of the elements and performance criteria and include knowledge of:

• approval processes
• integrated logistics support and resource scheduling packages
• legislation, organisational policy and procedures that determine test and evaluation processes
• management tools suited to implementing test and evaluation processes
• organisational change management
• principles relating to the implementation phase of test and evaluation processes
• requirements for scheduling test and evaluation activities
• resource plans
• team and stakeholder engagement
• test and evaluation implementation methods which may be complex in terms of scope; degree of risk; environmental, political, cultural and social factors that apply; consequences of failure and degree of control
• test management arrangements.

Assessors must hold credentials specified within the Standards for Registered Training Organisations current at the time of assessment.

Assessment must satisfy the Principles of Assessment and Rules of Evidence and all regulatory requirements included within the Standards for Registered Training Organisations current at the time of assessment.

Assessment must occur in workplace operational situations where it is appropriate to do so; where this is not appropriate, assessment must occur in simulated workplace operational situations that replicate workplace conditions.

Assessment processes and techniques must be appropriate to the language, literacy and numeracy requirements of the work being performed and the needs of the candidate.

Resources for assessment must include access to:

• a range of relevant exercises, case studies and/or simulations
• applicable documentation, including legislation, regulations, codes of practice, workplace procedures and operation manuals
• relevant and appropriate materials, tools, equipment and personal protective equipment (PPE) currently used in industry.