JODI-Gas Participation Assessment
The JODI-Gas Participation Assessment Definitions: Sustainability, Timeliness, and Completeness
Sustainability measures the number of JODI-Gas questionnaires received from each participating country or economy over the assessment period (six months) and within the agreed submission deadlines. A Good rating (smiley face), is earned when a country or economy submits JODI questionnaire responses for all six months in the period.
"good" if the 6 questionnaires have been submitted
"fair" if 4 or 5 questionnaires have been submitted
"less reliable" when less than 4 questionnaires have been submitted
Timeliness evaluates whether or not data has been received within two months of the end of each reference month in accordance with the data submission deadlines established by the JODI Partner Organisations. A smiley face is awarded if all six submissions within a given assessment period were received by the agreed deadlines.
"good" when all 6 submissions during the assessment period have been received within two months of the end of the reference month relevant to each submission
"fair" when 4 or 5 submissions have been received on time
"less reliable" when less than 4 submissions have been received on time
Completeness tracks the number of data points submitted for the flows of production, imports and exports (separated into LNG and pipeline), stock changes, gross inland deliveries (observed), deliveries for electricity and heat generation, and closing stocks in volumetric units (million cubic metres at 15 degrees Celsius, and 760 mm Hg) in the JODI-Gas Questionnaire. To earn a smiley face, each country or economy must submit more than 90% of its data related to production, demand and stock changes.
As the JODI-Gas World Database is still at an early stage of development, the assessment currently only accounts for volumetric data as it is readily available. However, a more accurate measurement of natural gas is achieved by reference to heat content value (terajoules), and the JODI Partner Organisations will continue to encourage their participating countries and economies to complete their data-sets, by also reporting in terajoules.
"good" when more than 90% of the data are given for flows of production, imports and exports (separated into LNG and pipeline), stock changes, gross inland deliveries (observed), deliveries for electricity and heat generation, and closing stocks in volumetric units (million cubic metres at 15 degrees Celsius, and 760 mm Hg)
"fair" when between 60% and 90% of the data are given
"less reliable" when less than 60% of the data are given
Data Confidence Level Assessment
The assessment was carried out on different levels:
- Comparability of the JODI data with other sources: monthly data from national and secondary sources has been assessed.
- JODI data have also been compared with annual data (when available) in order to check whether the levels and trend over the years could be confirmed.
- When no other sources were available for comparison with the JODI data, internal consistency and balance check have been carried out.
Examples of internal consistency checks: the sum of all the reported products with reported figure for Total Products is compared. When both, closing and stock changes data have been submitted, the consistency of the reported changes with the calculated ones is compared.
Example of balance check : the JODI questionnaire does not collect full balance information, however some basic checks for reasonableness can be carried out e.g. supply + import - export + stock change should have a relation with demand.
Remark: for IEA /OECD countries, data in the JODI database are the MOS data for all months except data shown for M-1. Comparability for the last month has been derived from comparison with MOS data. This methodology is applied using a rolling 12 month period.
- Blue: A blue background indicates that results of the assessment show reasonable levels of comparability
- Yellow: A yellow background indicates that the metadata should be consulted
- White: A white background indicates that data has not been assessed
- Purple: data under verification
More detailed notes on respective assessment approach by each JODI Organisation can be found from the link below.