ABARE Fuel and Electricity Survey, Financial Year 2001/2002
Contents
- Overview *** You are here ***
- Quality Framework
- A. General Information
- B. User Requirements, Survey Objectives and Budget
- C. Alternative Sources of Data
- D. Data Outputs
- E. Questionnaire Design and Data Collection
- F. Respondent Load
- G. Population / Frame
- H. Sample Design
- I. Estimation and Analysis
Overview
 | Portfolio: | Agriculture, Fisheries and Forestry | ||
| Agency: | ABARE - Australian Bureau of Agricultural and Resource Economics | ||
| Contact Person... | Name: | Andrew Dickson | |
| Email: | adickson@abare.gov.au | ||
| Phone: | 02 6272 2173 (International +61) | | |
Summary
|
The statistical information to be collected by the Fuel and Electricity Survey (FES) is required by Commonwealth and State governments, the energy industry, academics and industry consultants. In addition, Australia has commitments to provide detailed energy supply and demand information to international organisations such as the International Energy Agency (IEA), the World Energy Council (WEC) and the Asia Pacific Economic Cooperation (APEC) forum, as well as providing input into Australia's National Greenhouse Gas Inventory. More recently there has been an increased demand for energy end-use data in the commercial, residential, transport, energy renewables and energy cogeneration sectors. The FES aims to satisfy this identified demand by undertaking the following: a) surveying the largest consumers and producers of energy; b) supplying the Australian and New Zealand Minerals and Energy Council (ANZMEC) with the survey results on the Australian industrial sector for incorporation into the National Energy End-Use Database; and c) by publishing the statistical data collected. The FES statistical information will be published by ABARE in a comprehensive set of statistical tables at the completion of the survey, which addresses the fundamental need for historical and forecast information on the amount of energy consumed and produced in Australia, by industry, by fuel type and by State. A consistent set of data is not available from any other source in Australia. Consumption and production data for some fuel types is available from administrative sources, predominantly fuel suppliers, however, this information lacks the required end-use information required by clients (by fuel, by industry, by equipment type and in some instances by region). The FES is focused on collecting this detailed end-use data as well as less detailed consumption and production data where it is not available from other sources. The FES will collect data on the amount of energy consumed and produced for the proceeding three fiscal years (1998-99 to 2000-01) and forecasted needs on an annual basis out to 2005-06. This data is collected on a site by site (operational entity) basis and requires the information by fuel, by industry and by equipment type. The information is collected for both consumption and production data, but where possible if data is collected elsewhere, duplication is avoided. The FES is designed to provide a reliable and accurate data set on energy consumption and production in Australia, which will meet the needs of clients for detailed end-use information. The statistical data to be published may include approximately 50 fuel, 30 industry (at 2 or 3 digit ANZSIC level, depending on the industry) and 15 equipment types. There are a number of constraints applicable to the FES. These constraints include: 1) a fixed budget (including funding arrangements with DISR for the survey); |
Return to top
Reference Period & Frequency
| Reference Period: | Financial Year 2001/2002 |
| Frequency: | 2-yearly |
| First run: | 1973-74 |
Return to top
Response Rates
| | | As planned | Actual |
| Number of businesses... | | ||
| | | | |
|
| | 5000 | 4905 |
|
| | 4700 | 4518 |
|
| | 2350 | 1226 |
| | | | |
| Average time to complete questionnaire: | | 120 mins | 100 mins |
| Statistics... | | | |
| Response rate: | | 50% | 27% |
Return to top
Clearance Information
| Survey reviewed by | |
| Stat. Clearing House: | Financial Year 2001/2002 |
| Status: | Approved |
| Approval period: | From 2001/2002 to 2003/2004 |
| For additional clearance information, please contact the Statistical Clearing House by phone, fax, post or email. | |
Return to top
|
ABARE Fuel and Electricity Survey, |
 |
 |
|||
 |
 |
|
|||
 |
 |
 |
 |
|
|
Quality Framework
This data quality framework has been published internationally (Brackstone G., Managing Data Quality in a Statistical Agency, (1999) Survey Methodology, Vol. 25, no. 2, Statistics Canada) and has been recommended by the ANAO as 'better practice' in specifying performance measures (ATO Performance Reporting under the Outcomes and Outputs Framework, Australian Taxation Office, Audit Report No.46 2000-01, pp63-64.) on advice from the ABS Statistical Consultancy Unit.
Return to Survey Contents
Relevance
The relevance of statistical information reflects the degree to which it meets the needs of the clients. It is usually described in terms of key user needs, key concepts and classifications used, the scope of the collection and the reference period. |
Why do you need to conduct a survey? (B1)
- The Australian energy sector is experiencing rapid change, with this rapid change high quality and timely information about the past, present and future is critical to decision makers in both the private and government sectors. The areas of interest include energy market reform, energy efficiency, environmental policies such as climate change, energy security issues and information on which medium to long term energy planning can be based.
- surveying the largest consumers and producers of energy;
- supplying the Australian and New Zealand Minerals and Energy Council (ANZMEC) with the survey results on the Australian industrial sector for incorporation into the National Energy End-Use Database; and
- by publishing the statistical data collected.
The statistical information to be collected by the Fuel and Electricity Survey (FES) is required by Commonwealth and State governments, the energy industry, academics and industry consultants. In addition, Australia has commitments to provide detailed energy supply and demand information to international organisations such as the International Energy Agency (IEA), the World Energy Council (WEC) and the Asia Pacific Economic Cooperation (APEC) forum, as well as providing input into Australia's National Greenhouse Gas Inventory.
More recently there has been an increased demand for energy end-use data in the commercial, residential, transport, energy renewables and energy cogeneration sectors. The FES aims to satisfy this identified demand by undertaking the following:
The FES statistical information will be published by ABARE in a comprehensive set of statistical tables at the completion of the survey, which addresses the fundamental need for historical and forecast information on the amount of energy consumed and produced in Australia, by industry, by fuel type and by State. A consistent set of data is not available from any other source in Australia. Consumption and production data for some fuel types is available from administrative sources, predominantly fuel suppliers, however, this information lacks the required end-use information required by clients (by fuel, by industry, by equipment type and in some instances by region). The FES is focused on collecting this detailed end-use data as well as less detailed consumption and production data where it is not available from other sources.
- a fixed budget (including funding arrangements with DISR for the survey);
- a maximum sample size of approximately 5,000; and
- completion of the survey by 30 June 2002, including publication of historical data and formal reporting to DISR.
The FES will collect data on the amount of energy consumed and produced for the proceeding three fiscal years (1998-99 to 2000-01) and forecasted needs on an annual basis out to 2005-06. This data is collected on a site by site (operational entity) basis and requires the information by fuel, by industry and by equipment type. The information is collected for both consumption and production data, but where possible if data is collected elsewhere, duplication is avoided.
The FES is designed to provide a reliable and accurate data set on energy consumption and production in Australia, which will meet the needs of clients for detailed end-use information. The statistical data to be published may include approximately 50 fuel, 30 industry (at 2 or 3 digit ANZSIC level, depending on the industry) and 15 equipment types.
There are a number of constraints applicable to the FES. These constraints include:
- The principal data outputs to be produced from the 2001-2002 FES will include:
- the addition and maintenance of current actual and forecast data to the comprehensive fuel and energy statistical data collection maintained by ABARE for analytical, statistical and research purposes; and
- the publication of a comprehensive set of statistical tables on the amount of energy consumed and produced in Australia, by industry, by fuel type and by State for the 1998-99 to 2005-06 periods. The proposed publication is expected to be in a similar format to previous ABARE "Australian Energy" reports.
The publication, 'Australian Energy - Market Developments and Projections to 2014-15' (ABARE Research Report 99.4) was one of the principal outputs from the 1999 survey, and provides an example of one of the principal outputs to be produced from the current survey. The report contains a snap shot of the type of data to be produced, whilst more detailed data will also be made available to clients in electronic format (on diskette, CD & e-mail).
In addition, the data produced by the survey will also be used in a number of other research and commodity streams within the bureau.
What statistical data analysis techniques will be performed? (I7)
- The survey results are analysed against a number of criteria, historical trends, current situation and projected requirements. The results of the survey are comprehensively reported in an ABARE research report against key contemporary energy policy issues. The results are also used extensively in a number of other areas, such as in the analysis of energy intensity trends, emissions of greenhouse gases and energy policy briefing.
Statistical data analysis may take place on the data at a later stage, subject to requirements of clients for any such analysis. Techniques that may be used on the data include regression at unit level and time series analysis at aggregate level. Econometric techniques will be used to project aggregate energy usage forward, incorporating aggregate predictions of future usage as supplied in this survey.
What consideration has been given to the use of standards? Please specify. (D2)
- Significant consideration has been undertaken for the inclusion of both Australian and international standards in the design of the FES. The standards to be used in the survey include:
- employment;
- fuel classifications;
- equipment classifications; and
- industry classifications based on the Australian New Zealand Standard Industrial Classification (ANZIC).
- The target population for the 2001 FES is all Australian business establishments operating in the 2000-2001 financial year. Both public and private establishments are in scope although the pre-existence of data sources covering some industry sectors will preclude some direct collection of data.
How will you obtain the list of businesses (frame) from which the sample is to be selected? (G2)
- The frame from which the sample is to be selected will comprise of the following lists:
- previous FES respondents;
- a list of cogenerators provided by the Australian EcoGeneration Association;
- a list of renewable generators sites provided by the Office of the Renewables Regulator; and
- a population list provided by the ABS, representing all employing establishments, including agricultural establishments.
What is the type of unit on the frame to be used for the survey? (G3)
Establishment by industry.
- A self-completion questionnaire is the major method of information collection in the FES. The self-completion questionnaire will be mailed out to potential respondents, with respondents mailing back the completed survey forms in postage paid self-addressed envelopes.
To ensure the adequacy of the quality of the data collected and that the target survey response rate is met, survey staff will contact those respondents by mail and telephone who have provided incomplete data or who have been delinquent in responding.
The choice of a mail-out self-completion questionnaire for primary data collection has been identified as the most cost-effective method to collect data from businesses, in addition to being consistent in data collection methodology with similar surveys conducted by the Australian Bureau of Statistics (ABS). The telephone contact is necessary to ensure data quality and that the target response rate can be effectively achieved.
Financial year.
Repeated
Biennially
Return to Quality Framework
Accessibility
The accessibility of statistical information refers to the ease with which it can be referenced by users. It includes the ease with which the existence of information can be ascertained, as well as the suitability of the form or medium through which the information can be accessed. |
How will the results of the survey be explained / presented to the major users? (I8)
- As per question D1, one of the principal outputs to be produced from the 2001 FES to be presented to major users, will be the publication of a comprehensive set of statistical tables on the amount of energy consumed and produced in Australia, by industry, by fuel type and by State for the 1998-99 to 2005-06 periods. The proposed publication is expected to be in a similar format to previous ABARE 'Australian Energy' reports.
A copy of the publication, 'Australian Energy - Market Developments and Projections to 2014-15' (ABARE Research Report 99.4) was one of the principal outputs from the 1999 survey, and provides an example of one of the principal outputs to be produced from the current survey. The report contains a snap shot of the type of data to be produced, whilst more detailed data will also be made available to clients in electronic format (on diskette, CD and e-mail).
In addition, the data produced by the survey will also be used in a number of other research and commodity streams within the bureau, including other publications.
Which agency and area is responsible for the survey? (A2)
- ABARE,
Industries Branch - Energy Economics;
and the Data Management and Collection Section
- Carol Keil,
Telephone : 6272 2345
E-mail: cjkeil@abare.gov.au;
Andrew Dickson,
Telephone : 6272 2173
E-mail: adickson@abare.gov.au
What commitments have been made to preserve the confidentiality of respondents? How will these be implemented? (F3)
- ABARE will provide the following commitments to ensure the confidentiality of survey respondents:
- all survey respondents will be provided with a written commitment that all provided data will be subject to ABARE's confidentiality provisions;
- all published data will be in an aggregated format;
- there will be no identification of respondent individual company names or activities in the publications or reports released by ABARE;
- all data provided to third parties will require a written release form signed by the survey respondent prior to that data being authorised for release; and
- all survey data will be maintained in a secure environment within ABARE.
Return to Quality Framework
Timeliness
The timeliness of statistical information refers to the delay between the reference point to which it pertains and the date on which the information becomes available. |
To what reference peiod(s) does the survey refer? (A6)
Financial year.
- The FES is conducted on a biennial basis over a 12-month period between July and June, commencing in an odd year (eg. 2001) and finishing in an even year (eg. 2002).
The historical data collected from the survey will be published in late June 2002, with the release of the forecast statistics to coincide with the ABARE Outlook conference, held in early March 2003.
The provisional timetable for the key milestones of the FES is as follows:
| Design of survey sample | July - August 2001 |
| Conduct FES workshop | July 2001 |
| Redevelopment of FES database | July - November 2001 |
| Provision of sample contact list by ABS | August 2001 |
| Mail out of survey contact detail request form | August 2001 |
| Redesign and printing of survey forms | September - October 2001 |
| Mail out of survey forms | November 2001 |
| Collection and processing of forms | November - January 2002 |
| Conduct follow-up of survey non-respondents | January 2002 |
| Analysis of data | February - June 2002 |
| Conduct FES database quality assessment | February 2002 |
| Conduct FES response rate assessment | February 2002 |
| Conduct industry and departmental consultations | March - June 2002 |
| Complete final report containing historical data | June 2002 |
| Present forecast report at Outlook conference | March 2003 |
Return to Quality Framework
Accuracy
The accuracy of statistical information is the degree to which the information correctly describes the phenomena it was designed to measure. It includes measures of both sampling and non-sampling error. |
What is the expected total number of businesses you will attempt to contact (ie total sample size initially drawn)? How has this been set? (H4)
- A sample of approximately 5,000 will be selected from the ABS population list (the sample may be larger or smaller depending on the exact number of units that fall into completely enumerated strata - this cannot be determined exactly prior to sample selection due to confidentiality constraints used by ABS in preparing data on population numbers). There are approximately 800 units from other lists. The final sample number will depend on the match rate between the ABS sample and the other lists used.
What allowances will be made for potential sources of non-sampling error in estimation? (I6)
- Energy supply data is available from several sources at a variety of levels of disaggregation and is considered to be accurate. Energy consumption data is then reconciled with the supply data, with the end-use detail calibrated against the reconciled totals. This calibration process will control both sampling and non-sampling level error at calibration cell level. The potential for remaining non-sampling error to effect the accuracy of estimates will be discussed in the non-response report undertaken at the conclusion of the survey.
Of the number of businesses reported in H5, how many businesses are expected to respond (ie the responding sample size)? (H6)
- The previous methodology used for collecting this survey achieved a response rate of approximately 37%. With the use of preliminary contact letters, and more vigorous telephone follow up it is hoped to achieve a response rate in excess of 50%.
What allowances have been made for expected non-response and frame deficiencies in the sample design? (H8)
- Non-responses will be monitored and an intensive follow-up undertaken for non-responding businesses that are felt to be unique in their patterns or levels of energy use. If a non-response for these units remains, an assessment will be made of the necessity to clerically impute responses for these businesses. Otherwise a non-response will be treated as ignorable, given stratum level information. An assessment of the sensitivity of estimates to this process will be incorporated into the non-response report compiled at the conclusion of the survey.
In what ways does the coverage provided by the frame differ from the target population? (G6)
- Outside the agricultural sector, the ABS frame covers employers only, and for agriculture the coverage of units with an EVAO of less than $5,000 may be relatively poor. Non-employers and small agricultural units are expected to be relatively insignificant users of energy other than electricity and petroleum. Use of these energy sources by these units will be covered at the national level by use of data on petroleum sales (source from the Commonwealth Department of Industry, Science and Resources (DISR)) and electricity use (source from the Electricity Supply Association of Australia (ESAA)).
What quality control procedures will there be for data entry and coding? (I3)
- The quality control procedures which have been implemented for the data entry and coding component of the survey include:
- streamlining of the survey forms to minimise and/or eliminate manual coding;
- development and implementation of conversion tables within the FES database to eliminate the manual conversion of collected data;
- clerical scrutiny of forms prior to data entry;
- development and implementation of on-line editing within the FES database to correct data entry errors and respondent data errors which were not identified in the initial phase of clerical scrutiny; and
- the production of regular detailed statistical reports of data entered by respondent, refusals, responses received by date and percentage of data captured by date and summary reports by fuel classifications, by equipment classifications and industry classifications.
What testing of the questionnaire(s) has (have) taken place? (E5)
- Whilst no trials or testing of the proposed questionnaire for the 2001 FES has been undertaken, the biennial FES has been undertaken regularly since 1973-74 with substantial informal consultations with stakeholders conducted prior to each survey to ensure respondents needs are met, where possible.
What consultations have taken place, other than testing, with businesses or business associations regarding availability of data items and data collection methods? (E6)
- Individual consultations, in addition to a survey workshop held in July 2001, have been undertaken with businesses, business associations and government agency representatives to ensure that the data requirements of the 2001-2002 FES, including data types, data periods (historical and forecast) and survey collection methods are appropriate and do not represent a significant burden on respondents.
- Currently the population list to be used for the ABS component consists of approximately 1.5 million establishments. The other lists contributing to the FES frame contain approximately 800 businesses, the majority of which should be included on the ABS list.
What actions have been taken to overcome known frame deficiencies? (G7)
- Attempts to ameliorate previous potential deficiencies in the population list used by the FES are being made through the use of the ABS establishment list, derived from the ABS business register.
Of the total number of businesses reported in H4, how many businesses are expected to be live and in scope? (H5)
- The proportion of businesses to be sampled which are expected to be live and in scope is approximately 97-98%, with the proportion of business units out of scope being approximately 2-3%.
What evidence is there that the expected respondents will be representative of non-respondents? (H7)
- There is no evidence (apart from the smaller units tend to be non-respondents). An analysis of patterns of non-response and their potential consequences for estimates will be provided as an output from the current collection.
Return to Quality Framework
Interpretability
The interpretability of statistical information reflects the availability of the supplementary information and metadata necessary to interpret and utilise it appropriately. It includes appropriate presentation of data such that it aids correction interpretation. |
How will the results of the survey be explained / presented to the major users? (I8)
- As per question D1, one of the principal outputs to be produced from the 2001 FES to be presented to major users, will be the publication of a comprehensive set of statistical tables on the amount of energy consumed and produced in Australia, by industry, by fuel type and by State for the 1998-99 to 2005-06 periods. The proposed publication is expected to be in a similar format to previous ABARE 'Australian Energy' reports.
A copy of the publication, 'Australian Energy - Market Developments and Projections to 2014-15' (ABARE Research Report 99.4) was one of the principal outputs from the 1999 survey, and provides an example of one of the principal outputs to be produced from the current survey. The report contains a snap shot of the type of data to be produced, whilst more detailed data will also be made available to clients in electronic format (on diskette, CD and e-mail).
In addition, the data produced by the survey will also be used in a number of other research and commodity streams within the bureau, including other publications.
What sample design will be used, eg, census, stratified simple random sample? (H1)
- The sample will be a stratified simple random sample.
What stratification has been used in the sample design? (H2)
- The stratification for the ABS population list component of the survey will be by State of location, by industry (aggregations of ANZSIC classes), by size (EVAO or employment).
This stratification has been adopted because figures by State and industry grouping (with published levels of industries being aggregations of stratum level industries) are of direct interest. Finer industry stratification has been used where it is believed that levels and patterns of energy use differ significantly within a publication industry over and above the effects of differing size (eg. Alumina producers and Aluminium smelters are known to have different energy usage characteristics than other manufacturers in ANZSIC group 272).
Size stratification has been used because it is known that, within an ANZSIC class, energy use tends to be larger for larger businesses.
- Non-responses will be monitored and an intensive follow-up undertaken for non-responding businesses that are felt to be unique in their patterns or levels of energy use. If a non-response for these units remains, an assessment will be made of the necessity to clerically impute responses for these businesses. Otherwise a non-response will be treated as ignorable, given stratum level information. An assessment of the sensitivity of estimates to this process will be incorporated into the non-response report compiled at the conclusion of the survey.
Will outliers be identified, and, if so, how will they be handled? (I4)
- Data outliers will be identified using clerical scrutiny, comparison of usage estimates with known energy production, import/export and stock change data and adjustment, as appropriate.
Will data be aggregated into statistical tables, and if so what are the estimation formulae for the principal output data items? (I5)
- Initial weights will be calculated as simple expansion weights at stratum level (eg. stratum population/number of respondents). Information on energy consumption and production is collected from both energy suppliers/producers and energy end-users. Information available from suppliers (from whom data will be completely enumerated, or collected as an aggregate from alternative sources), will be used to calibrate information collected from end-users (after being adjusted for exports). The supply information provides the total demand by fuel by sector (therefore the error is small) and the data provided by the end-user provides detailed information about how the energy is used. Weighted data is then aggregated to form output tables.
What allowances will be made for potential sources of non-sampling error in estimation? (I6)
- Energy supply data is available from several sources at a variety of levels of disaggregation and is considered to be accurate. Energy consumption data is then reconciled with the supply data, with the end-use detail calibrated against the reconciled totals. This calibration process will control both sampling and non-sampling level error at calibration cell level. The potential for remaining non-sampling error to effect the accuracy of estimates will be discussed in the non-response report undertaken at the conclusion of the survey.
What statistical data analysis techniques will be performed? (I7)
- The survey results are analysed against a number of criteria, historical trends, current situation and projected requirements. The results of the survey are comprehensively reported in an ABARE research report against key contemporary energy policy issues. The results are also used extensively in a number of other areas, such as in the analysis of energy intensity trends, emissions of greenhouse gases and energy policy briefing.
Statistical data analysis may take place on the data at a later stage, subject to requirements of clients for any such analysis. Techniques that may be used on the data include regression at unit level and time series analysis at aggregate level. Econometric techniques will be used to project aggregate energy usage forward, incorporating aggregate predictions of future usage as supplied in this survey.
Return to Quality Framework
Coherence
The coherence of statistical information reflects the degree to which it can be successfully brought together with other statistical information within a broad analytical framework and over time. The use of concepts, classifications and target populations promotes coherence, as does the use of common methodology across surveys. |
Is the survey a new survey or a cycle of an existing repeated survey? (A7)
- The survey is a cycle of an existing survey. The biennial FES has been regularly conducted by ABARE since 1973-74.
Is the survey to be conducted once only or repeated? If repeated, with what frequency is the survey to be repeated? (A8)
Repeated
Biennially
- The existing FES frame undergoes continuous updating from sources such as press, annual reports, industry bodies and other databases developed within the Bureau.
Any future use of the ABS listing will be decided on a survey by survey basis.
All frames proposed for future cycles of the FES will be maintained principally through the register maintenance practices of the ABS and of the Australian Taxation Office.
What consideration has been given to making data item definitions consistent between repeats of this survey or across other surveys? (D3)
- Both the current and past FES surveys have been designed with the significant use of Australian and international industry and fuel classification standards, ensuring consistency between this survey and other relevant Australian and/or international surveys, where possible.
- There are no other existing surveys that collect data on the basis required.
Although some data is available from alternative sources, the data sets available are not based on a consistent methodology, are highly aggregated, in addition to failing to provide sufficient end-use information. These sources include the Electricity Supply Association of Australia, the Australian Gas Association and the NSW and Queensland Joint Coal Boards. These data sources provide energy supply use data only and not consumption data.
- There are no alternative data sources that provide the level of detail required. In the few instances where similar data is collected by alternative data sources, the collection methods lack a consistent methodology and provide little or no end-use information. The data in many cases is collected in value terms, which can not be accurately converted, to physical terms and/or data is collected for different reporting periods.
- Significant consideration has been undertaken for the inclusion of both Australian and international standards in the design of the FES. The standards to be used in the survey include:
- employment;
- fuel classifications;
- equipment classifications; and
- industry classifications based on the Australian New Zealand Standard Industrial Classification (ANZIC).
- Where possible, information is sourced from other agencies to avoid duplication of effort. These sources include the Australian Gas Association (AGA), the Electricity Supply Association of Australia (ESAA), the Petroleum Section of the Department of Industry, Science and Resources and the Joint Coal Boards in NSW and Queensland. However, as identified in questions C1 & C2, the information provided by these organisations is supply use data only, is highly aggregated and provides little or no information on energy consumption.
Return to Quality Framework
