Chapter 4: Phase 1 - Data Format

The foundation of any interoperable system is a common language for representing information. In WIA-CONTACT-001, this foundation is provided by Phase 1: Data Format specifications. This chapter presents the complete data model for extraterrestrial signal detection, explains the JSON-LD serialization format, details the validation rules that ensure data integrity, and provides practical examples that illustrate proper implementation.

The data format specifications were developed through extensive consultation with radio astronomers, signal processing engineers, and data scientists from observatories worldwide. They represent a careful balance between expressiveness (capturing all relevant information) and practicality (remaining simple enough for widespread implementation). The format is designed to be both human-readable and machine-processable, supporting both interactive analysis and automated processing pipelines.

4.1 Data Model Overview

The WIA-CONTACT-001 data model centers on the Signal Detection Record (SDR), a comprehensive representation of a potential extraterrestrial signal. The SDR captures five categories of information that together provide a complete picture of the detection event:

Each category is represented as a nested object within the SDR, with required and optional fields clearly specified. This modular structure allows for incremental refinement as more information becomes available during the verification process. A tentative detection can be submitted with minimal required fields, then updated as additional observations provide more detail.

4.2 Signal Detection Record (SDR) Schema

The following JSON schema defines the complete structure of a Signal Detection Record. This example shows all major fields with representative values:

{
  "@context": "https://wia.standards.org/contact-001/v1",
  "@type": "SignalDetectionRecord",
  "id": "sdr:2025-12-29-GBT-001",
  "version": "1.0.0",
  "created": "2025-12-29T14:30:00Z",
  "modified": "2025-12-29T15:45:00Z",

  "signal": {
    "frequency": {
      "center": 1420405751.768,
      "bandwidth": 0.5,
      "unit": "Hz",
      "frame": "barycentric",
      "driftRate": 0.0023
    },
    "power": {
      "snr": 15.7,
      "flux": 1.2e-26,
      "unit": "W/m²/Hz",
      "spectralDensity": -220.5
    },
    "modulation": {
      "type": "narrowband",
      "characteristics": ["continuous", "stable"],
      "encoding": null
    },
    "polarization": "circular-right"
  },

  "source": {
    "position": {
      "ra": "19h25m12.34s",
      "dec": "+21d45m32.1s",
      "frame": "ICRS",
      "epoch": "J2000"
    },
    "uncertainty": {
      "ra": 0.5,
      "dec": 0.5,
      "unit": "arcsec",
      "confidence": 0.95
    },
    "properMotion": null,
    "distance": null
  },

  "temporal": {
    "detected": "2025-12-29T14:25:33.123Z",
    "duration": 72.5,
    "unit": "seconds",
    "recurring": false,
    "period": null,
    "ephemeris": null
  },

  "context": {
    "facility": "GBT",
    "instrument": "L-band receiver",
    "observer": "Dr. Sarah Chen",
    "conditions": {
      "rfiLevel": "low",
      "weather": "clear",
      "solarActivity": "quiet"
    }
  },

  "status": "unverified",
  "confidence": 0.72,
  "threatLevel": "unknown"
}
        

4.3 Core Data Types

4.3.1 Frequency Specification

Frequency values are represented with high precision to enable accurate signal identification and tracking. The center frequency is specified in Hertz as a floating-point number with at least 9 significant digits. This precision is essential because narrowband extraterrestrial signals could have bandwidths of 1 Hz or less, and even small frequency errors could cause a verification observation to miss the signal entirely.

Table 4.1: Frequency Data Fields
FieldTypeRequiredDescription
centernumberYesCenter frequency in Hz (9+ significant digits)
bandwidthnumberYesSignal bandwidth in Hz
unitstringYesMust be "Hz"
framestringNoReference frame: topocentric, barycentric, rest
driftRatenumberNoDoppler drift in Hz/s (crucial for ETI detection)

The reference frame is particularly important for verification. A signal observed at one frequency from Earth will appear at a slightly different frequency when corrected to the solar system barycenter, due to Earth's orbital motion. The standard default is topocentric (as observed), but barycentric values enable direct comparison between observations made at different times.

4.3.2 Celestial Position

Source positions use the International Celestial Reference System (ICRS) by default, with right ascension and declination specified in either standard sexagesimal notation (hours/degrees, minutes, seconds) or decimal degrees. Both formats are accepted; the system automatically converts as needed.

Uncertainty estimates are mandatory for position data. These estimates enable verification observations to define appropriate search regions and allow statistical assessment of whether independent detections are consistent with a common source. The standard uses elliptical uncertainty regions characterized by semi-major axis, semi-minor axis, and position angle.

4.3.3 Temporal Information

All timestamps use ISO 8601 format with UTC timezone and millisecond precision where available. The detection timestamp indicates when the signal was first identified in the data stream (which may differ from when the data was recorded, in the case of archived data analysis). Duration specifies how long the signal was continuously observed.

For recurring or periodic signals, additional fields capture the recurrence pattern. This information is valuable for scheduling verification observations—if a signal repeats every 24.7 hours, verification attempts can be timed to coincide with expected transmissions.

4.3.4 Power and Signal-to-Noise

Signal strength is characterized by both signal-to-noise ratio (SNR) and absolute flux density. SNR provides a relative measure that is directly relevant to detection threshold comparisons—a signal with SNR of 10 is clearly detected, while one with SNR of 3 is marginal. Flux density in physical units (W/m²/Hz or Jansky) enables absolute calibration and comparison across different instruments with different sensitivities.

4.4 Metadata Structure

Contextual metadata provides essential information for interpreting the detection. The facility identifier must match a registered observatory in the WIA facility registry. This registry contains detailed information about each facility's capabilities, including telescope diameter, receiver systems, geographic location, and scheduling contacts.

"context": {
  "facility": {
    "id": "GBT",
    "name": "Green Bank Telescope",
    "location": {
      "latitude": 38.4330,
      "longitude": -79.8397,
      "elevation": 807,
      "timezone": "America/New_York"
    },
    "telescope": {
      "diameter": 100,
      "type": "single-dish",
      "mount": "alt-az"
    }
  },
  "instrument": {
    "name": "L-band receiver",
    "frequencyRange": [1150e6, 1730e6],
    "backend": "VEGAS",
    "resolution": 1.0,
    "polarizations": ["LCP", "RCP"]
  },
  "observation": {
    "mode": "tracking",
    "integration": 60,
    "calibrated": true,
    "calibrationMethod": "noise-diode"
  },
  "conditions": {
    "rfiLevel": "low",
    "weather": "clear",
    "solarActivity": "quiet",
    "ionosphericConditions": "stable"
  }
}
        

4.5 Validation Rules

All SDR submissions must pass multi-level validation before acceptance into the system. This validation ensures data quality and prevents common errors that could compromise verification efforts.

Level 1 - Schema Validation: The record must conform to the JSON schema, with all required fields present and correctly typed. Missing required fields, type mismatches (string where number expected), and malformed JSON all trigger Level 1 errors.

Level 2 - Range Validation: Numeric values must fall within physically plausible ranges. Frequencies must be positive. SNR must be greater than 1 (otherwise, what was detected?). Celestial coordinates must be valid (RA between 0 and 360 degrees, Dec between -90 and +90 degrees). Duration cannot exceed the time between detection and submission.

Level 3 - Consistency Validation: Related fields must be internally consistent. If polarization is "circular-right", the instrument must support circular polarization. The frequency must fall within the instrument's frequency range. The observation duration cannot exceed the facility's maximum track time for the source position.

Level 4 - Reference Validation: Identifiers referencing external entities must correspond to valid registry entries. Facility IDs, instrument types, and observer credentials are all verified against authoritative databases.

Table 4.2: Common Validation Errors and Resolutions
Error CodeLevelDescriptionResolution
SDR-0011Missing required fieldAdd the required field with a valid value
SDR-0021Invalid data typeEnsure field value matches expected type
SDR-0032Value out of rangeCheck physical plausibility of value
SDR-0044Unknown facility IDRegister facility or correct ID
SDR-0053Temporal inconsistencyCheck timestamp ordering and durations
SDR-0063Frequency outside instrument rangeVerify instrument configuration

4.6 Example Records

Example 1: Narrowband Continuous Signal

This example shows a typical narrowband signal detection at the hydrogen line frequency—the classic "water hole" target for SETI searches:

{
  "@context": "https://wia.standards.org/contact-001/v1",
  "@type": "SignalDetectionRecord",
  "id": "sdr:2025-12-29-ATA-042",
  "signal": {
    "frequency": {
      "center": 1420405751.768,
      "bandwidth": 0.1,
      "unit": "Hz",
      "driftRate": 0.0023
    },
    "power": { "snr": 12.3, "flux": 8.5e-27 },
    "modulation": { "type": "narrowband", "characteristics": ["continuous"] }
  },
  "source": {
    "position": { "ra": 82.5, "dec": -12.3, "frame": "ICRS" },
    "uncertainty": { "ra": 1.0, "dec": 1.0, "unit": "arcsec" }
  },
  "temporal": { "detected": "2025-12-29T10:15:00Z", "duration": 120 },
  "context": { "facility": "ATA", "instrument": "feed-42" },
  "status": "unverified"
}
        

Example 2: Pulsed Periodic Signal

This example shows a pulsed signal with regular periodicity—potentially a beacon transmission:

{
  "@context": "https://wia.standards.org/contact-001/v1",
  "@type": "SignalDetectionRecord",
  "id": "sdr:2025-12-29-Parkes-007",
  "signal": {
    "frequency": { "center": 2800000000, "bandwidth": 1000, "unit": "Hz" },
    "power": { "snr": 8.7 },
    "modulation": { "type": "pulsed", "pulseWidth": 0.005, "period": 1.337 }
  },
  "source": {
    "position": { "ra": "12h30m45s", "dec": "-45d30m00s", "frame": "ICRS" }
  },
  "temporal": {
    "detected": "2025-12-29T08:00:00Z",
    "duration": 3600,
    "recurring": true,
    "period": 86400
  },
  "status": "verification-requested"
}
        

4.7 Migration from Legacy Formats

Many existing SETI programs use proprietary data formats developed over decades. WIA-CONTACT-001 provides migration tools to convert common legacy formats to the standard SDR format, enabling historical data to be integrated into the global network.

Converters are available for: SETI@home work units (Berkeley BOINC format), Breakthrough Listen filterbank and HDF5 formats, SERENDIP spectral data, ATA antenna array outputs, and generic FITS files with appropriate metadata extensions.

Implementation Note: The WIA-CONTACT-001 SDK includes command-line tools for batch conversion of legacy data. For large archives, streaming converters can process data incrementally without loading entire files into memory. Contact the WIA technical team for assistance with unusual formats.

Chapter 4 Summary

Key Takeaways:

  1. Signal Detection Record: The SDR is the core data structure, capturing signal characteristics, source position, temporal properties, and contextual metadata in a standardized JSON-LD format.
  2. Precision Requirements: Frequency and position data require high precision to enable accurate verification. Frequency should have 9+ significant digits; position uncertainty must be explicitly specified.
  3. Validation Levels: Multi-level validation (schema, range, consistency, reference) ensures data integrity before system acceptance.
  4. Contextual Metadata: Facility and instrument information enables proper interpretation and verification scheduling.
  5. Migration Support: Tools are provided for converting legacy formats, enabling integration of historical SETI data.

Review Questions

  1. Explain the five categories of information captured in a Signal Detection Record and why each is essential for verification.
  2. Why is high frequency precision (9+ significant digits) required? What problems could arise from insufficient precision?
  3. Describe the four levels of validation and what types of errors each level catches.
  4. Compare the examples for narrowband continuous and pulsed periodic signals. What fields differ, and why?
  5. Design an SDR for a hypothetical wideband signal with complex modulation. What additional fields might you need?
  6. Discuss the challenges of migrating legacy SETI data to the SDR format. What information might be lost?

Looking Ahead

Chapter 5 will explore Phase 2: API Interface specifications. We will examine the RESTful endpoints, WebSocket protocols, authentication mechanisms, and SDK usage for integrating with the WIA-CONTACT-001 network.

Korea Industrial, Research, Education Infrastructure Mapping

Korea operates its industrial ecosystem and standardization system through the following core infrastructure. Korea Top 5 Groups: Samsung, Hyundai Motor, LG, SK, Lotte. Each group operates standardization committees and ISO/IEC TC Korean secretariats. Samsung Electronics (semiconductors, displays, home appliances, telecom)·Hyundai Motor (automobiles, mobility)·LG Electronics (home appliances, displays, OLED)·SK hynix (memory)·LG Energy Solution·Samsung SDI (batteries)·POSCO Future M (materials)·Hyundai Mobis (parts). Korean IT Big Tech: NAVER (search, cloud, AI HyperCLOVA)·Kakao (messenger, payment, mobility, banking)·Coupang (e-commerce, logistics)·Karrot Market·Toss·Woowa Brothers. Korea Telcos: SK Telecom·KT·LG U+. 5G·5G dedicated networks·B2B cloud·AI businesses operating. Korea Top 7 Research Universities: Seoul National University·KAIST·POSTECH·Yonsei University·Korea University·UNIST·DGIST·GIST. All serve as standardization R&D bases and ISO/IEC/IEEE Korean chairs. Korea Government-affiliated National Research Institutes (26): KIST, KAERI, KIMM, KIER, KFRI, KRICT, KRIBB, KARI, KASI, KIGAM, KICT, KISTI, KETI, ETRI, NIMS, KIMS, KISDI, KOTRA, STEPI, KOEN, KICCE, KIET, KIPF, KIHASA, KICJ, KLRI. Korea Industrial Complexes / Tech Valleys: Pangyo Techno Valley·Dongtan·Gwanggyo·Songdo IBD·Yeouido·Gangnam·Sihwa·Banwol·Gumi·Ulsan·Changwon·Geoje·Yeosu·Onsan·Cheongju·Iksan·Gwangyang·POSCO Gwangyang Steel Mill·Asan Bay·Seosan·Songdo·Incheon Airport·Sejong·Cheongna·Geomdan. Korea Trade and Finance Infrastructure: Korea International Trade Association (KITA)·Korea Trade-Investment Promotion Agency (KOTRA)·Export-Import Bank of Korea (KEXIM)·Bank of Korea·Kookmin Bank·Shinhan·Hana·Woori·NH Nonghyup·IBK Industrial Bank·SC First Bank·Citi Bank Korea·HSBC Korea·DBS Korea — 14 Korean major banks and foreign banks. Korea K-POP / K-Content: HYBE·SM·YG·JYP 4 major entertainment companies·CJ ENM·tvN·MBC·KBS·SBS·EBS·YTN·Yonhap News TV·JTBC Korean broadcasting·NETFLIX Korea·Disney Plus·TVING·Wavve·Watcha·Coupang Play. Korea Gaming Industry: Nexon·NCsoft·Krafton·Netmarble·Kakao Games·Pearl Abyss·Com2uS·Gamevil·NHN·Smilegate·Webzen. Korea Automotive / Battery: Hyundai Motor·Kia·Genesis·LG Energy Solution·Samsung SDI·SK On·POSCO Future M·EcoPro·L&F battery cathode material suppliers. Korea Semiconductor: Samsung Electronics (HBM3E·HBM4)·SK hynix (HBM3E 12-Hi)·DB HiTek·SK siltron·SK Enpulse·Dongjin Semichem·Seoul Semiconductor·Simmtech·Samsung Display·LG Display.

Korea Standardization Infrastructure Mapping

Korea operates a comprehensive standards governance system through inter-ministerial cooperation. National Standards Council (under Prime Minister's Office, per Framework Act on National Standards Article 5) coordinates KATS (Korean Agency for Technology and Standards), MFDS (Ministry of Food and Drug Safety), MOTIE (Ministry of Trade, Industry and Energy), MSIT (Ministry of Science and ICT), MOIS (Ministry of the Interior and Safety), MOE (Ministry of Environment), MOHW (Ministry of Health and Welfare), MND (Ministry of National Defense), MCST (Ministry of Culture, Sports and Tourism), MOFA (Ministry of Foreign Affairs), MOJ (Ministry of Justice), and FSC (Financial Services Commission). Accreditation and Testing: KOLAS (Korea Laboratory Accreditation Scheme) accredits 800+ testing laboratories. KAS (Korea Accreditation System) accredits 50+ certification bodies. KTC (Korea Testing Certification), KTR (Korea Testing & Research Institute), KTL (Korea Testing Laboratory), and KCL (Korea Conformity Laboratories) provide conformance testing. Telecom and Cyber: KCC (Korea Communications Commission), KCA (Korea Communications Agency), TTA (Telecommunications Technology Association), IITP (Institute for Information & Communications Technology Planning & Evaluation), NIPA (National IT Industry Promotion Agency), KISA (Korea Internet & Security Agency), KCMVP (Korea Cryptographic Module Validation Program), NIS (National Intelligence Service), NSR (National Security Research Institute), and NCSC (National Cyber Security Center). National R&D Centers: KIST, ETRI, KAIST, Seoul National University, Yonsei University, Korea University, POSTECH, UNIST, GIST, DGIST, KISTI, KIER, KIMM, KRICT, KFRI, KRIBB. International Standards Cooperation: ISO TC/SC Korean secretariats, IEC TC/SC Korean secretariats, ITU-T Study Group Korean chairs, 3GPP RAN/SA Korean chairs, IEEE 802 Korean chairs, W3C Korea office, OASIS Korea office, IETF Korea cooperation, OECD CSTP, UN ESCAP, APEC SCSC Korean cooperation. Korean Industrial Standards (KS) Catalog: KS X (Information) 25,000+, KS A (Basic) 15,000+, KS B (Machinery) 25,000+, KS C (Electrical) 18,000+, KS D (Metallurgy) 12,000+, KS E (Mining) 5,000+, KS F (Construction) 18,000+, KS H (Food) 8,000+, KS I (Environment) 5,000+, KS J (Biology) 3,000+, KS K (Textile) 15,000+, KS L (Ceramics) 7,000+, KS M (Chemistry) 12,000+, KS P (Medical) 5,000+, KS Q (Quality Mgmt) 4,000+, KS R (Transport) 12,000+, KS S (Service) 3,000+, KS T (Packaging) 4,000+, KS V (Shipbuilding) 5,000+, KS W (Aerospace) 3,000+ — totaling 220,000+ Korean Industrial Standards. Key Acts: Personal Information Protection Act (Act 19234, effective Sept 15, 2024), Electronic Government Act, Electronic Signature Act, Act on Promotion of Information and Communications Network Utilization and Information Protection, Information and Communications Infrastructure Protection Act, Data Industry Act, Public Data Act, AI Framework Act (Act 20212, effective July 2026), Industrial Technology Innovation Promotion Act, Framework Act on Science and Technology — 70+ Korean standardization-related laws.

Korea Digital Transformation Detailed Mapping

Korea operates digital transformation through a comprehensive governance system. Digital Government: Digital Platform Government Committee (established September 2022, under the President)·Ministry of the Interior and Safety Digital Government Bureau·e-Government Support Center·Gov.kr·National Citizen Service·KDIS (Korea Digital Information Society)·NIA (National Information Society Agency)·MOIS (Ministry of the Interior and Safety). K-DNS Infrastructure: Korea Internet & Security Agency (KISA) Korea Internet Center·KISA DNS Root Server·KRNIC (Korea Network Information Center)·BGP Korea·National Cyber Security Center (NCSC)·KCC (Korea Communications Commission)·MSIT (Ministry of Science and ICT)·NIA·NIPA. Korean Cloud Infrastructure: KT Cloud·NAVER Cloud (NCloud)·Samsung SDS Cloud·LG U+ Cloud·NHN Cloud·Kakao Enterprise Cloud·SK Telecom Cloud·KISA Cloud Security Assurance Program (CSAP)·KCMVP-validated cloud·ISMS-P (Information Security & Personal Information Management System). Korean Security Certifications: KISA ISMS-P certification·KCMVP (Korean Cryptographic Module Validation Program)·NIS (National Intelligence Service) "National Cryptographic Technology Operation Standards"·NCSC "National Cyber Security Strategy 2024-2028"·CC (Common Criteria) Korean evaluation bodies·EAL4·EAL5·KS X ISO/IEC 15408·19790·24759 Korean Profile. Korean Data Standards: NIA AI Hub·National Data Standardization Committee·Statistics Korea (KOSTAT)·MyData 4 Designated Combination Specialists (Samsung SDS, KICI, KOSTAT, KFTC)·National Institute of Korean Language·National Law Information Center·National Spatial Information Platform·National Spatial Data Center·Korean Spatial Information Standards. Finance and Fintech Standards: FSC (Financial Services Commission)·FSS (Financial Supervisory Service)·FIU (Financial Intelligence Unit)·BOK (Bank of Korea)·FSEC (Financial Security Institute)·KFTC (Korea Financial Telecommunications)·KSD (Korea Securities Depository)·KRX (Korea Exchange) 8-agency cooperation. 5G/6G Communications Infrastructure: 5G subscribers 35 million (2024)·5G base stations 350,000·6G commercialization target 2028·5G dedicated networks 16 operators·6G Acceleration Council (MSIT, 2024). K-Content: KOCCA (Korea Creative Content Agency)·MCST (Ministry of Culture, Sports and Tourism)·KCA (Korea Communications Agency)·Korea Culture Information Service Agency·Korean Film Archive·Korea Publishing Industry Promotion Agency. Data 3 Acts (Personal Information Protection Act·Credit Information Act·Telecommunications Network Act, 2020 enforcement)·Data Industry Act (2021)·Public Data Act (2013)·AI Framework Act (2026)·Digital Platform Government Framework Act (2024 proposed) — Korea digital transformation core legislation.