AIG Survey of Eco-Efficiency Procedures in Manufacturing, Financial Year 2002/2003
Contents
- Overview *** You are here ***
- Quality Framework
- A. General Information
- B. User Requirements, Survey Objectives and Budget
- C. Alternative Sources of Data
- D. Data Outputs
- E. Questionnaire Design and Data Collection
- F. Respondent Load
- G. Population / Frame
- H. Sample Design
- I. Estimation and Analysis
Overview
 | Portfolio: | Environment and Heritage | ||
| Agency: | Environment and Heritage, Department of the | ||
| Contact Person... | Name: | Kerry Smith | |
| Email: | kerry.smith@ea.gov.au | ||
| Phone: | 02 6274 1671 (International +61) | | |
Summary
|
The survey will encourage Ai Group members to adopt eco-efficiency measures by: The main topics covered are: The physical and financial data will be used to develop "eco-efficiency ratios" for the industry. In particular, Ai Group is looking to develop eco-efficiency benchmarking data that can be measured against expenditure. This is consistent with our approach in other and planned benchmarking surveys which use activities as a ratio of expenditure to develop standards. Ai Group believes that by having expenditure as a common variable in our ratios we can compare eco-efficiency activities with other business activities in data already (planned to be) collected by Ai Group. As well, Ai Group may well want to undertake some regression analysis of the results with expenditure being a key variable for analysis. While we recognise that this may require additional effort by respondents, experience with previous surveys and in the pilot testing suggest that companies unable/unwilling to provide expenditure data will simply skip these survey fields. The initial sample size is 500 units. The main considerations in setting this figure are respondent burden, cost and the target response rate. |
Return to top
Reference Period & Frequency
| Reference Period: | Financial Year 2002/2003 |
| Frequency: | Annual |
| First run: | 2001 |
Return to top
Response Rates
| | | As planned | Actual |
| Number of businesses... | | ||
| | | | |
|
| | 600 | Not available |
|
| | 550 | Not available |
|
| | 100 | Not available |
| | | | |
| Average time to complete questionnaire: | | 60 mins | Not available |
| Statistics... | | | |
| Response rate: | | 18% | Not available |
Return to top
Clearance Information
| Survey reviewed by | |
| Stat. Clearing House: | Financial Year 2002/2003 |
| Status: | Approved |
| For additional clearance information, please contact the Statistical Clearing House by phone, fax, post or email. | |
Return to top
|
AIG Survey of Eco-Efficiency Procedures in Manufacturing, |
 |
 |
|||
 |
 |
|
|||
 |
 |
 |
 |
|
|
Quality Framework
This data quality framework has been published internationally (Brackstone G., Managing Data Quality in a Statistical Agency, (1999) Survey Methodology, Vol. 25, no. 2, Statistics Canada) and has been recommended by the ANAO as 'better practice' in specifying performance measures (ATO Performance Reporting under the Outcomes and Outputs Framework, Australian Taxation Office, Audit Report No.46 2000-01, pp63-64.) on advice from the ABS Statistical Consultancy Unit.
Return to Survey Contents
Relevance
The relevance of statistical information reflects the degree to which it meets the needs of the clients. It is usually described in terms of key user needs, key concepts and classifications used, the scope of the collection and the reference period. |
Why do you need to conduct a survey? (B1)
- It is a goal of industry and the Australian Government to improve the economic efficiency and environmental performance of Australian businesses. To achieve this goal, Department of Environment and Heritage (DEH) and industry associations are working together to encourage businesses to adopt measures that can improve their eco-efficiency, that is, measures that enable them to produce goods and services with less energy and fewer natural resources, resulting in less waste and pollution. A survey is a necessary component of encouraging businesses to improve their eco-efficiency, as it will provide baseline data which future improvements may be measured.
- The survey will encourage Ai Group members to adopt eco-efficiency measures by:
- encouraging member companies to measure their inputs (energy, water, materials) & outputs (wastes and products), so that they can identify and make resource savings;
- establishing eco-efficiency benchmarks for the Ai Group, so that each business can compare its eco-efficiency with the benchmarks for the Association;
- providing information to government on changes over time to the eco-efficiency performance of the Ai Group, to assist with government policy-making; and
- enabling Ai Group to report publicly on its members environmental activities and impacts.
- whether the business has environmental plans and systems;
- physical quantities of energy and water used, air emissions and waste products;
- physical quantities and financial values of products;
- whether the business has adopted eco-efficiency measures, and the outcomes.
The main topics covered are:
The physical and financial data will be used to develop "eco-efficiency ratios" for the industry. In particular, Ai Group is looking to develop eco-efficiency benchmarking data that can be measured against expenditure. This is consistent with our approach in other and planned benchmarking surveys which use activities as a ratio of expenditure to develop standards. Ai Group believes that by having expenditure as a common variable in our ratios we can compare eco-efficiency activities with other business activities in data already (planned to be) collected by Ai Group. As well, Ai Group may well want to undertake some regression analysis of the results with expenditure being a key variable for analysis.
While we recognise that this may require additional effort by respondents, experience with previous surveys and in the pilot testing suggest that companies unable/unwilling to provide expenditure data will simply skip these survey fields.
The initial sample size is 500 units. The main considerations in setting this figure are respondent burden, cost and the target response rate.
- The data from the survey will provide valuable information on eco-efficiency practices for individual businesses, which will be able to benchmark their performance against the survey results. In time Ai Group will be looking to extend the data to cover a significantly larger number of companies within the Australian Industry Group membership. The survey will also provide initial data on eco-efficiency in the manufacturing industry such as:
- waste generation;
- recycling volumes, internal and external;
- expenditure on water, electricity and gas; and
- annual savings from eco-efficiency management.
Data will be published by business size (employment, sales volume) and industry sector.
- Frequency distributions and regression analysis.
- Benchmarking will be applied against standard sales figure. Questions have been designed to reflect industry terminology, practices and standards.
- The target population is Australian Industry Group members.
- A random sample of Ai Group members will be selected from our national membership database, with an over-weighting of large companies and under-weighting of small companies.
- The sample unit will be the establishment.
- The survey will be a mailed out for self-completion. Telephone follow-up will be undertaken to lift the response rate.
The nature of the information sought has determined the data collection methodology. For instance, some of the data requires the respondent to consult accounts and business records, which is best done in the respondent’s own time.
- The reference period will be the 2002/03 financial year.
- As above.
Return to Quality Framework
Accessibility
The accessibility of statistical information refers to the ease with which it can be referenced by users. It includes the ease with which the existence of information can be ascertained, as well as the suitability of the form or medium through which the information can be accessed. |
How will the results of the survey be explained / presented to the major users? (I6)
- Tables, analysis, graphs, and advice to users on how to interpret the results.
- The survey is being conducted by the Australian Industry Group (Ai Group). It is being conducted under an Eco-Efficiency Agreement with the Department of Environment and Heritage. The Agreement is being managed by the Industry Partnerships Section, Environment Protection Branch, Department of Environment and Heritage.
- Sophie Montgomery
Industry Partnerships Section
Telephone : (02) 6274 1671
Email : sophie.montgomery@ea.gov.au
- Confidentiality has been promised. Each unit included in the sample will be allocated a unique record number, and this will be the only identifier on the questionnaire.
Business names and other identifying features will also be kept separate from company data during survey processing, data entry and analysis.
In terms of survey output, only aggregated data will be published, with checks also made to ensure that information on individual firms cannot be identified within aggregated data.
Return to Quality Framework
Timeliness
The timeliness of statistical information refers to the delay between the reference point to which it pertains and the date on which the information becomes available. |
To what reference peiod(s) does the survey refer? (A6)
- The reference period will be the 2002/03 financial year.
Forms testing | 27/05/2002 to 31/05/2002 (prior to first survey collection - no significant changes have been made) |
Questionnaire finalised | Proposed questionnaire is attached |
Data collection commences | One week after SCH approval |
Data collection finishes | Four weeks after data collection commences |
Results available | Eight weeks after data collection finishes. |
Return to Quality Framework
Accuracy
The accuracy of statistical information is the degree to which the information correctly describes the phenomena it was designed to measure. It includes measures of both sampling and non-sampling error. |
What is the expected total number of businesses you will attempt to contact (ie total sample size initially drawn)? How has this been set? (H4)
- 600 for the survey.
- An analysis of non-responding units will be undertaken.
- We expect 100 units will respond to the survey, a response rate of 20%.
- members of the Australian Industry Group are more likely to respond to Australian Industry Group surveys than other non-compulsory surveys;
- typical response rates achieved by other Australian Industry Group surveys in the past.
This takes into account the following:
- If non-response rates are high in any particular strata, then follow up phone contact will be used to lift response rates in that strata.
As previously mentioned, we expect minimal defunct units on the frame.
- None.
- The questionnaire was tested in the week of 27 May 2002 with three member companies (small, medium and large) of the Australian Industry Group. Given AiG staff’s experience (of over 15 years) in designing and administering member and large national surveys, this was considered sufficient. The pilot largely confirmed expectations about the relevance and ease in completing the questionnaire for companies from small to large.
- Consultations have taken place between the Australian Industry Group (industry body) and the Federal Department of the Environment and Heritage.
- The original frame had approximately 2,000 units.
- We have asked the respondent to provide their industry sector for output purposes.
- We anticipate no less than 450 units will be live and in scope. There may be some non-live units, although this is expected to be minimal (maximum 5% of sample) as Australian Industry Group membership listings are constantly updated.
- Units on the frame are similar in terms of:
- membership to the Australian Industry Group; and
- industry sector (ie. Manufacturing).
Return to Quality Framework
Interpretability
The interpretability of statistical information reflects the availability of the supplementary information and metadata necessary to interpret and utilise it appropriately. It includes appropriate presentation of data such that it aids correction interpretation.
- Tables, analysis, graphs, and advice to users on how to interpret the results.
- The survey is a random sample.
- The sample is stratified by company size. No strata will be completely enumerated, although the sample will be over-weighted towards large companies (employment over 100 persons) as these firms are expected to be involved in eco-efficiency arrangements more so than small firms. Respondent burden for small and medium sized firms has also been taken into account.
- If non-response rates are high in any particular strata, then follow up phone contact will be used to lift response rates in that strata.
As previously mentioned, we expect minimal defunct units on the frame.
- Outliers will be identified and excluded.
- Data will be published in tabular form for selected data items by business size and industry, and will include averages and ratios.
- An analysis of non-responding units will be undertaken.
- Frequency distributions and regression analysis.
Return to Quality Framework
Coherence
The coherence of statistical information reflects the degree to which it can be successfully brought together with other statistical information within a broad analytical framework and over time. The use of concepts, classifications and target populations promotes coherence, as does the use of common methodology across surveys. |
Is the survey a new survey or a cycle of an existing repeated survey? (A7)
- This is the second of three surveys, to be conducted annually in 2002, 2003 and 2004.
- As above.
- The Australian Industry Group constantly updates member details to ensure accuracy as a priority. However, responses from the survey will be fed back to the membership list, particularly in relation to industry classification.
- The questionnaire has been designed such that questions are simple, and use terminology consistent with industry practices. This will help to ensure that data items remain consistent over the duration of the study.
- Some of the other signatories to the Eco-Efficiency Agreements have undertaken similar surveys, but given the differences in the member profiles, there was little scope to draw on their experiences and work. Nevertheless, the work being undertaken by the Chambers of Commerce and Industry in preparing their eco-efficiency survey was considered in preparing this survey
In 1999, the Ai Group and the Monash Centre for Environmental Management were funded by Environment Australia to undertake a ‘Survey of Productivity and Environmental Strategies and Practices in Australian Manufacturing Companies’. While the survey results were considered in the development of the Eco-Efficiency Survey, it was concluded that overall, the objectives and data outputs of the two surveys are quite different. Little use can therefore be made of the 1999 survey.
- The Ai Group / Monash University survey provides a useful resource of background information on the environmental approaches used by Ai Group members. The survey aimed to assess corporate environmental management practices in Australian manufacturing companies, with particular attention given to the linkages between environmental management practices, productivity initiatives, and competitive strategies.
While there is some overlap with the Eco-Efficiency Survey (on questions related to environment management strategies used by companies, eco-efficiency activities undertaken and information on environment management), overall the focus of this survey is rather on obtaining environmental input, output and expenditure data. Where there is overlap, correlations will be made between the two surveys. In general, however, the 1999 survey will provide some contextual and background information to the 2002 Eco-Efficiency Survey.
- Benchmarking will be applied against standard sales figure. Questions have been designed to reflect industry terminology, practices and standards.
- Working with other agencies/organisations is not seen as appropriate in this instance due to the specialised nature of the data collected, the specific focus on Ai Group members, and the lack of existing information in this field.
Return to Quality Framework
