Chapter 5: Data Collection and Reporting

Effective GHG monitoring requires a well-designed data architecture that handles diverse sources, formats, and update frequencies:

5.2 Data Quality Management

Quality Assurance (QA) Framework

Data Layer	Purpose	Update Frequency	Typical Volume
Raw Observations	Ground sensors, satellites, surveys	Real-time to daily	TB/month
Quality-Controlled Data	Validated, calibrated measurements	Daily to weekly	GB/month
Activity Data	Energy statistics, land use, production	Monthly to annual	MB/year
Emission Factors	IPCC defaults, country-specific values	Annual updates	KB/year
Calculated Emissions	Inventory estimates by sector/gas	Annual	MB/year
Reports & Submissions	UNFCCC reports, public disclosures	Annual/biennial	MB/year

Multi-Level QA/QC Process

Level 1 - Automated Real-Time Checks:

Range validation: values within physical limits
Spike detection: identify sudden anomalies
Consistency checks: correlations between variables
Instrument diagnostics: temperature, pressure, flow rates
Timestamp validation: no gaps or duplicates

Level 2 - Expert Review:

Visual inspection of time series
Comparison with historical patterns
Cross-validation with other sites
Investigation of flagged anomalies
Metadata completeness check

Level 3 - Inter-Institution Comparison:

Round-robin calibration comparison exercises
Traveling standard measurements
Blind sample audits
Performance statistics reporting

Quality Flags

The WIA-ENE-051 specification (Phase 2 §9.1) defines the following four quality flags.

5.3 Data Harmonization and Standards

Common Data Formats

Flag	Meaning	Action
0 - Good (GOOD)	Passed all QC tests, high quality	Use in analysis
1 - Marginal (MARGINAL)	Minor issues, medium quality	Use with caution, document
2 - Bad (BAD)	Failed QC, low quality	Exclude from analysis
-999 - Missing (MISSING)	No data available	Handle as fill value

NetCDF (Network Common Data Form)

Use case: Climate and satellite data

Advantages:

Self-describing with metadata
Multi-dimensional arrays (time, lat, lon, level)
Efficient storage and access
CF (Climate and Forecast) conventions

Example structure:

dimensions:
    time = UNLIMITED ;
    latitude = 180 ;
    longitude = 360 ;
variables:
    double time(time) ;
        time:units = "days since 1970-01-01" ;
    float xco2(time, latitude, longitude) ;
        xco2:units = "ppm" ;
        xco2:long_name = "Column CO2" ;
        xco2:standard_name = "atmosphere_mole_content_of_carbon_dioxide" ;

CSV with Metadata Headers

Use case: Time series from monitoring stations

Example format:

# Site: Mauna Loa Observatory
# Parameter: CO2 (ppm)
# Instrument: Picarro G2401
# Calibration: WMO-CO2-X2019 scale
# Quality: Automated + expert review
# Contact: ghg@example.org
#
timestamp,co2_ppm,ch4_ppb,quality_flag
2025-01-01T00:00:00Z,418.45,1923.2,0
2025-01-01T01:00:00Z,418.52,1924.1,0
2025-01-01T02:00:00Z,418.41,1922.8,0

JSON for APIs and Web Services

Use case: Real-time data exchange, API responses

{
  "station": {
    "id": "MLO",
    "name": "Mauna Loa Observatory",
    "location": {
      "latitude": 19.5362,
      "longitude": -155.5763,
      "elevation": 3397
    }
  },
  "measurements": [
    {
      "timestamp": "2025-01-01T00:00:00Z",
      "variables": {
        "co2": {"value": 418.45, "unit": "ppm", "uncertainty": 0.1},
        "ch4": {"value": 1923.2, "unit": "ppb", "uncertainty": 2}
      },
      "quality": "good"
    }
  ],
  "metadata": {
    "instrument": "Picarro G2401",
    "calibration_scale": "WMO-CO2-X2019",
    "data_version": "2.0"
  }
}

5.4 Emission Inventory Compilation

IPCC Methodology Overview

The IPCC provides standardized guidelines for national greenhouse gas inventories. The specification follows the 2006 IPCC Guidelines for National Greenhouse Gas Inventories and the 2019 Refinement. The codes below are the sector numbers of the UNFCCC reporting tables; the 2006 Guidelines combine Agriculture and LULUCF into a single AFOLU sector (Sector 3).

Calculation Approaches

Sector	CRF Code	Key Categories	Data Sources
Energy	1	Fuel combustion, fugitive emissions	Energy statistics, facility reports
IPPU (Industrial Processes and Product Use)	2	Mineral, chemical, metal production	Production data, process info
Agriculture	3	Enteric, manure, soils, rice, burning	Livestock counts, crop area, fertilizer
LULUCF (Land Use, Land-Use Change and Forestry)	4	Forest land, cropland, grassland, settlements	Land use maps, biomass surveys
Waste	5	Landfills, wastewater, incineration	Waste statistics, treatment data

Tier System

Tier 1 - IPCC Defaults:

Use default emission factors
Simple activity data (e.g., total fuel consumption)
Uncertainty: ±50% (per specification Phase 3 §3.3)
Good for: Small sources, initial estimates

Example Tier 1 calculation:

Emissions_CO2 = Activity_Data × Emission_Factor

Example (coal combustion, specification Phase 3 §3.3):
Activity: 100,000 TJ coal consumed
EF: 94,600 kg CO2/TJ (IPCC 2006 default)
Oxidation: 1 (the 2006 Guidelines assume complete oxidation by default)
Emissions = 100,000 × 94,600 / 1,000 = 9,460,000 tonnes CO2

Tier 2 - Country-Specific:

Country or technology-specific emission factors
More detailed activity data
Uncertainty: ±20% (per specification)
Good for: Key categories, major sources

Tier 3 - Detailed Models:

Facility-specific data and models
Continuous monitoring where applicable
Uncertainty: ±10% (per specification)
Recommended for: Largest sources, policy-relevant categories

5.5 Uncertainty Quantification

Sources of Uncertainty

Uncertainty Propagation

Source	Typical Range	Reduction Strategies
Activity Data	±5-20%	Better statistics, surveys, smart meters
Emission Factors	±10-50%	Country-specific measurements, Tier 3 methods
Model Parameters	±20-100%	Calibration, validation, sensitivity analysis
Completeness	Unknown	Comprehensive source identification

Combining Uncertainties

For multiplication/division (typical emission calculation):

Relative uncertainty (combined) = sqrt(u_A² + u_EF²)

where:
  u_A = relative uncertainty in activity data
  u_EF = relative uncertainty in emission factor

Example:
  Activity uncertainty: ±10%
  EF uncertainty: ±25%
  
  Combined: sqrt(10² + 25²) = sqrt(100 + 625) = 26.9%
Specification example (Phase 3 §3.3): sqrt(5² + 10²) = 11.2%

For addition/subtraction (aggregating emissions):

Absolute uncertainty (combined) = sqrt(U_1² + U_2² + ... + U_n²)

Note: Assumes independent, normally distributed errors

Monte Carlo approach for complex inventories:

Define probability distributions for each parameter
Run 10,000+ simulations sampling from distributions
Calculate emissions for each simulation
Derive 95% confidence interval from results

5.6 Time Series Consistency

Recalculation Requirements

When methodologies improve or new data becomes available, entire time series must be recalculated:

Reasons for Recalculation

Discovery of errors in previous submissions
Methodological improvements (e.g., Tier 1 → Tier 3)
Revision of activity statistics by national agencies
Updated emission factors from new research
Category structure changes

UNFCCC guideline: Recalculate entire time series (typically 1990-present) to maintain consistency

Documentation required:

Detailed explanation of changes
Quantitative impact assessment
Comparison tables (old vs. new estimates)
Justification for recalculation

5.7 Reporting Templates

Common Reporting Format (CRF)

The UNFCCC requires Annex I countries to submit standardized electronic tables. The specification is written against the CRF, but under the Paris Agreement's Enhanced Transparency Framework (ETF), all Parties use the Common Reporting Tables (CRT) from the 2024 submissions onward.

CRF Table	Content	Notes
Summary 1.A	Summary of national emissions and removals by gas and category	Prepared for each year
Summary 2	Summary of emissions in CO₂ equivalent	Prepared for each year
Summary 3	Summary of methods (Tiers) and emission factors applied	Ensures transparency
Table 10	Emission trends (base year to reporting year)	Time-series consistency check
Sectoral Tables	1.A-1.C (Energy), 2.A-2.H (IPPU), etc.	Sector-specific detail

WIA-ENE-051 CRF Generator

// Automated CRF table generation
const crf = new wia.reporting.CRFGenerator({
  country: 'KOR',
  year: 2024,
  inventoryData: nationalInventory,
  uncertainties: uncertaintyData
});

// Generate all required tables
const tables = await crf.generateAllTables();

// Export in official format
await crf.export({
  format: 'UNFCCC_XML',   // specification Phase 2 §8.3 CRF XML
  version: '2024',
  output: 'KOR_2024_CRF.xml'
});

// Automated validation
const validation = await crf.validate();
if (!validation.passed) {
  console.log('Issues:', validation.errors);
}

5.8 Data Access and Transparency

Open Data Principles

Major Data Portals

5.9 Real-Time Monitoring Dashboards

Principle	Implementation	Benefits
Accessible	Public web portals, APIs, download links	Broad utilization, transparency
Machine-readable	CSV, JSON, NetCDF (not PDF scans)	Automated analysis, integration
Documented	Metadata, methodology descriptions	Proper interpretation, replicability
Timely	Regular updates, near-real-time where possible	Actionable information, early warning
Free	No cost for access (public good)	Equity, innovation, research

WIA-ENE-051 Dashboard Example

// Real-time city emissions dashboard
const dashboard = wia.dashboard.create({
  region: 'Los Angeles Basin',
  datasources: [
    { type: 'satellite', mission: 'OCO-3', gas: 'CO2' },
    { type: 'ground', network: 'LA-Megacities', gas: 'CO2' },
    { type: 'traffic', source: 'CalTrans' },
    { type: 'power', source: 'CAISO' }
  ],
  updateInterval: '1hour',
  aggregation: 'city'
});

// Display components
dashboard.addWidget({
  type: 'timeseries',
  title: 'CO2 Enhancement vs Background',
  yaxis: 'ppm above baseline'
});

dashboard.addWidget({
  type: 'map',
  title: 'Spatial Distribution',
  colorscale: 'emissions'
});

dashboard.addWidget({
  type: 'attribution',
  title: 'Source Breakdown',
  method: 'inverse_model'
});

5.10 Blockchain for Data Integrity

Immutable Emission Records

WIA-ENE-051 supports blockchain-based verification of emission reports (specification Phase 4 §9: W3C Verifiable Credentials (VC), IPFS report storage, and on-chain recording of hashes).

Benefits:

Tamper-evident submission timestamps
Audit trail of all revisions
Cryptographic proof of data origin
Decentralized verification by multiple parties
Public transparency without compromising privacy

Implementation:

// Submit inventory with blockchain proof
const submission = {
  country: 'KOR',
  year: 2024,
  inventoryHash: sha256(inventoryData),
  submitter: '0x742d35Cc6634C0532925a3b844Bc9e7595f0bEb0',
  timestamp: Date.now()
};

// Record on blockchain
const tx = await wia.blockchain.submitInventory(submission);
console.log('Transaction hash:', tx.hash);

// Later verification
const verified = await wia.blockchain.verify(inventoryHash);
console.log('Submitted:', new Date(verified.timestamp));
console.log('Integrity:', verified.valid ? 'Intact' : 'Compromised');

Key Takeaways

Robust data architecture handles diverse GHG data sources and formats
Multi-level QA/QC ensures data quality from instruments to final reports
Standardized formats (NetCDF, JSON, CSV) enable interoperability
IPCC Tier system (specification uncertainties ±50%/±20%/±10%) balances accuracy and resource requirements
Uncertainty quantification is essential for transparent reporting
Time series consistency requires recalculation when methods improve
CRF tables (CRT under the ETF) standardize UNFCCC reporting across countries
Open data principles promote transparency and innovation
Real-time dashboards enable actionable monitoring
Blockchain provides tamper-evident proof of emission reports

Review Questions

Describe the six layers of a GHG data collection architecture.
What are the three levels of quality assurance in GHG monitoring?
Explain the difference between Tier 1, 2, and 3 IPCC methodologies.
How do you propagate uncertainties in emission calculations?
Why must time series be recalculated when methodologies change?
What is the Common Reporting Format (CRF), and why is it important?
List the five principles of open data and their benefits.
Calculate combined uncertainty for activity data (±10%) and emission factor (±20%).
What advantages does blockchain offer for emission reporting?
Describe how WIA-ENE-051 automates CRF table generation.