Laboratory Capacity and Verification Testing Report

Laboratory capacity and verification testing report

Prepared for the

Vietnam Energy Efficiency Standards and Labelling (VEESL) Program

Produced by

Chris Evans, Kevin Lane

399 Silbury Boulevard, Milton Keynes

MK9 2AH, United Kingdom

Email:

Telephone: +44 (0)1908 303 600
www.S2E4.com

June 2014

Table of Contents

1 Introduction 7

2 Existing accreditation and approval of testing organisations 9

2.1 Accreditation by the BoA 9

2.2 Approval by MOIT 9

3 Provision of expert training 10

3.1 Electric fans 11

3.1.1 Report back to VEESL and MOIT from the electric fans expert 11

3.2 Rice cookers 13

3.2.1 Report back to VEESL and MOIT from the rice cookers expert 13

3.3 Compact fluorescent lamps 14

3.3.1 Report back to VEESL and MOIT from the CFLs expert 15

4 Inter-laboratory comparison tests 17

4.1 Results of witness testing 17

4.2 Results of testing electric fans 18

4.2.1 Discussion of results of testing electric fans 21

4.3 Results of testing rice cookers 23

4.3.1 Discussion of results of testing rice cookers 26

4.4 Results of testing CFLs 28

4.4.1 Discussion of results of testing CFLs 30

5 Conclusions and recommendations 33

5.1 Product testing related advice for each of the QUATEST laboratories 33

5.2 Recommendations applicable to all approved testing organisations in Vietnam 34

5.3 The accreditation operated by the Vietnamese Board of Accreditation (BoA) 34

5.4 Support for the MOIT approval process 34

5.5 Recasting threshold for energy label bands 35

APPENDIX 1 Example of test results sheet for one model of electric fan 36

APPENDIX 2 Example of test results sheet for one model of rice cooker 37

APPENDIX 3 Example of test results sheet for one model of CFL 38

List of Figures

Figure 1: Testing of electric fans with support from the expert 11

Figure 2: Testing of rice cookers with support from the expert 13

Figure 3: Testing of CFLs with support of the expert 15

Figure 4: Electric fan manufacturer label and the energy label 19

Figure 5: Star rating of the 20 fans as measured by the three laboratories 20

Figure 6: Maximum-to-minimum star rating of the 20 fans as measured by the three laboratories 20

Figure 7: Reported minimum-to-maximum efficiency of the 20 fans, by three laboratories 22

Figure 8: Rice cooker and its energy label 23

Figure 9: Star rating of the 20 rice cookers as measured by the three laboratories 25

Figure 10: Maximum-to-minimum star rating of the 20 rice cookers as measured by the three laboratories 25

Figure 11: Reported average cooking efficiency (%) of the 20 models of rice cookers 26

Figure 12: Example of CFL label 29

Figure 13: Average efficacy (lm/W) measured for the 20 models of CFLs 30

Figure 14: Average measured power (W) of the 20 CFL models 31

Figure 15: Measured/reported initial luminous flux (lm) of the 20 CFL models 32

List of Tables

Table 1: Summary of findings by electric fans testing expert 12

Table 2: Summary of findings by rice cookers testing expert 14

Table 3: Summary of findings by CFLs testing expert 16

Table 4: Brand/model list of electric fans tested 18

Table 5: Brand/model list of rice cookers tested 24

Table 6: Energy efficiency bands given in TCVN 8252:2009 27

Table 7: Brand/model/size list of CFLs tested 28

Table 8: Difference between the average efficacies of the tested CFL lamps 30

Table 9: Example of test results sheet for one model of electric fan 36

Table 10: Example of test results sheet for one model of rice cooker 37

Table 11: Example of test results sheet for one model of CFL 38

Disclaimer

The views and opinions expressed in this article are those of the authors and do not necessarily reflect the official policy or position of any agency of the Australian Government.

The authors have made their best endeavours to ensure the accuracy and reliability of the data used herein, however make no warranties as to the accuracy of data herein nor accept any liability for any action taken or decision made based on the contents of this report.

Executive summary

The Australian Government Department of Industry (DoI) is providing assistance to Vietnam through the Vietnam Energy Efficiency Standards and Labelling (VEESL) Program, funded by the Australian Agency for International Development (AusAID).

This report has been compiled by consultants with extensive experience of product testing who are providing direct assistance and advice to the VESSL Program. It provides results for that part of the Program intended to help build laboratory testing capacity in three state-owned QUATEST laboratories.

The work being reported was undertaken in partnership with Vietnam’s Ministry of Industry and Trade (MOIT) and comprised of two main components:

·  Visits to the test laboratories, QUATEST 1, 2, 3, by experts in the energy efficiency performance testing of electric fans, rice cookers and compact fluorescent lamps (CFLs). The purpose of the visits being to provide supplementary training to the already experienced laboratory testing staff;

·  The inter-laboratory testing of 20 models of electric fans, rice cookers and CFLs (which followed on from the visits by the experts).

Achieving accurate and consistent test results by these three laboratories is crucial for effective standards and labelling in Vietnam. Methods for measuring declared values for energy consumption and performance characteristics must be of sufficient accuracy to provide confidence to governments, consumers and manufacturers. Any significant variations in the reproducibility[1] of results achieved by test laboratories could reduce the effectiveness of the implementation of the MEPS and labelling regulations. It must be recognised that some variation in measurement is unavoidable. This can be due to the variance of the product itself and to the measurement method applied. While the first one is the responsibility of the manufacturer, the second one is the responsibility of either or both the test laboratory(s) and the organisation publishing the test standard.

The part of the Program reported here began with the supplementary training visits made to the three QUATEST laboratories. In each case, the experts provided advice focussed on making improvements to testing procedures - the precise application of testing methods, the use of calibrated measuring equipment and the routine assessment of sources of errors of measurement.

The results of the inter-laboratory testing that then followed were mixed. Those of multiple samples of the same models of CFLs showed, with the exception of consistently lower results from one of the QUATESTs, good reproducibility – as should be expected.

The results of the testing of electric fans and rice cookers were much less reproducible with large and inconsistent variations in performance measured for the same samples of some models. The experts identified a number of reasons, which could have contributed to these variations, which were the responsibility of the test laboratories:

·  Some inconsistencies in the precise application of techniques between the laboratories;

·  Some equipment not being as specified in the test standard;

·  Some equipment not being calibrated.

Additionally, in the case of the rice cookers, the expert identified that the published test method needed amending as it could not be undertaken in ways that avoided significant errors of measurement.

The challenges faced by laboratories when conducting performance tests on products should not be underestimated. Relatively small changes in procedures or in the accuracy of measuring instruments can have a significant impact on the energy efficiency ratings that are subsequently calculated from the laboratory test results. Implementation of the advice that the experts gave to each of the QUATEST laboratories was intended to have a positive impact on improving the consistency of test results.

The authors of this report recommend further actions are taken. A multi-agency approach, in which the Vietnam Board of Accreditation (BoA) takes part, should implement a programme to assist the test laboratories to improve the suitability and calibration of their measuring equipment. In addition, estimating and eliminating sources of measurement errors are also important actions to be taken.

Some specific recommendations:

·  Amend the measurement standard TCVN 8252:2009 for rice cookers in order to improve its repeatability[2];

·  Assist the BoA to implement best practice when accrediting test laboratories to ISO/IEC17025;

·  Introduce a requirement that inter-laboratory trials are to be undertaken for each new test standard to identify and resolve any inconsistencies in application of the test methodology and so ensure that reproducible test results are consistently obtained;

·  Each QUATEST to implement a procedure under which uncertainties of measurement[3] are estimated for all the test programs they undertake.

·  Further and specific refinements to laboratory procedures should be made at each QUATEST. The guidance provided by the testing experts and the comments presented in this report are relevant to this.

·  Request the BoA to then undertake a re-accreditation program (which would normally be undertaken annually) for the QUATEST laboratories;

1  Introduction

The Government of Vietnam has introduced legislation to implement Minimum Energy Performance Standards (MEPS) for appliances and equipment alongside a program of Energy Labelling. The Australian Government is supporting the Vietnam Energy Efficiency Standards and Labelling (VEESL) Program, using funds supplied by the Australian Agency for International Development (AusAID) and the Australian Department of Industry (DoI). These funds have been used to employ consultants with extensive experience in this area who are providing direct assistance and advice to the Australian and Vietnamese Government officials managing VESSL.

The aim of the VEESL Program is to improve prosperity in Vietnam while increasing energy security and reducing carbon emissions. This will be achieved through a range of activities designed to build sustainable capacity within Vietnam to set and enforce appliance and equipment energy standards, and monitor and evaluate the MEPS and Energy Labelling Program. Two of the main activities, within the scope of this report, are to:

·  Support the monitoring of compliance through verification testing;

·  Support the development of local test capacity and technical and commercial skills in laboratories through training, and through inter-laboratory (round robin) testing.

The legislation to implement MEPS and Energy Labelling for appliances and equipment became effective during 2013. This has required new products to meet MEPS levels and, in many cases, being required to display an energy label at the point of sale. All affected products must be compliant with the legally imposed performance requirements.

Though the responsibility for this lies with the product supplier, the Vietnamese market surveillance authorities also have a responsibility for checking that these products are in compliance with these requirements. Some checks, such as whether a label is being correctly displayed, can be made at the point of sale[4] but the technical performance of the product can only be checked through tests conducted by a suitably skilled and equipped testing organisation.

Since the results of these check tests may be used as evidence for enforcement action, it is vital that tests are conducted accurately according to the specified test methodology, and that the results are sufficiently repeatable and reproducible. Much of the current responsibility for conducting compliance tests is likely to be with the state testing organisations, Quality Assurance and Testing Centre (QUATEST) 1, 2 & 3, and a program was developed on behalf of VEESL to support these organisations.

The VEESL program reported here was undertaken in partnership with the Vietnam Ministry of Industry and Trade (MOIT). It consisted of the following components:

·  Providing supplementary training for laboratory staff undertaking the testing of electric fans, rice cookers and compact fluorescent lamps (CFLs);

·  Witnessing of the testing of these products by the experts that had provided the training;

·  Production of testing methodological guides for electric fans and rice cookers;

·  Inter-laboratory testing of 20 models of electric fans, rice cookers and CFLs.

Products were purchased from the Vietnamese market for testing. The results of testing were intended to enable the program to achieve the following:

·  An exploration of whether the standard test procedures, their regulated performance levels and the testing being conducted were sufficient to deliver the performance standards required by the Vietnamese authorities; and, if so,

·  A check on whether these products were compliant with their regulatory requirements and performed as claimed on their energy labels.

2  Existing accreditation and approval of testing organisations

There are two official accreditation or approval programs that are applicable to testing organisations in Vietnam. Both have been applied to the QUATEST laboratories. The first is based on the accreditation process managed by the Bureau of Accreditation Vietnam (BoA). The second, approval to undertake the tests required by the standards and labelling regulations, is undertaken by MOIT.

2.1 Accreditation by the BoA

The BoA is the official body in Vietnam responsible for accrediting certification bodies under the ISO/IEC Guide 65 and specifically for accrediting test laboratories in accordance with ISO/IEC 17025. The BoA has international recognition as the Vietnamese member of the International Accreditation Forum (IAF), Asia Pacific Laboratory Accreditation Cooperation (APLAC), International Laboratory Accreditation Cooperation (ILAC) and the Pacific Accreditation Cooperation (PAC).

QUATEST laboratories 1, 2 & 3 each have a generic accreditation certificate for ISO/IEC 17025 issued by the BoA. These certificates do not state which specific TCVN standards that the laboratories have been accredited for (accreditation under ISO/IEC 17025 is specific to identified standards; it cannot be applied generically to the laboratory). Examination of the content of the BoA’s website, in which detailed schedules of accredited tests are displayed for each organisation, reveals that the detailed lists they publish are not up to date. Enquiries are on-going, but currently it has not been possible to confirm whether each QUATEST has been specifically accredited to ISO/IEC 17025 for testing the energy efficiency of electric fans, rice cookers and CFLs.

2.2 Approval by MOIT

An approval process of testing organisations is undertaken by MOIT. This is undertaken separately to the ISO/IEC based accreditation process undertaken by the BoA.

The VEESL program has previously provided guidance to MOIT that was intended to assist them to conduct audits of testing organisations. This guidance was prepared to ensure the quality systems operated by approved testing organisations extended beyond the minimum requirements required by ISO/IEC standards.