A structured instrument for domain expert validation of the Immersive Learning Ontology — grounded in social science research methods and designed for iterative construct validation across eight ontology matrices.
⏱
Time required
60–90 minutes
📊
Items
8 matrices · 4 dimensions + relationships
🔬
Validation type
Content validity + construct clarity
🔒
Data handling
De-identified; UNT IRB compliant
What is Kairos?
Kairos is a multi-round expert validation instrument operationalizing content validity and construct validity procedures for ontology evaluation in learning sciences, instructional design, and educational technology research. It guides you through rating each of the eight Immersive Learning Ontology matrices across four validity dimensions, evaluating both individual terms and inter-component relationships.
The instrument follows procedures aligned with CVR methods (Lawshe, 1975), ontology evaluation frameworks (Gruber, 1993), and expert panel approaches established in immersive learning and instructional design research. This ontology extends the companion Immersion Ontology; familiarity with that framework is helpful but not required.
1.
Read the definition of each matrix and its representative terms before rating. Definitions reflect BFO-grounded Aristotelian genus-differentia formulations drawn from the ILO manuscript.
2.
Navigate matrices using the tab bar. Rate each matrix on four dimensions using the 1–7 scale. Use notes fields for revisions, evidence, or caveats from your instructional design or learning science experience.
3.
After rating all eight matrices, evaluate six key inter-ontology relationship claims on logical necessity and empirical plausibility.
4.
Complete the instrument usability section. Your candid feedback directly informs revision of Kairos and the ILO validation procedure.
5.
Download both the CSV data file and the HTML report, then use the email button to submit to the research team.
Meets or exceeds criterion — minor or no revision needed
Step 1 of 5
Consent & Expert Profile
Your domain background is central to the validity of this evaluation. All responses are de-identified in analysis unless you explicitly consent to attribution.
About you
Purpose
This study validates the Immersive Learning Ontology (ILO), a formal BFO-grounded specification of immersive learning's domain entities, processes, and relationships (Warren et al., in review). Expert panel methods are used to establish content validity, construct clarity, and boundary adequacy across the ontology's eight matrices and 41 defined terms.
What you will do
You will rate each of the eight ILO matrices on four validity dimensions using a 1–7 scale, evaluate key inter-component relationship claims, and provide qualitative notes where appropriate. You will also complete a brief usability section about this instrument.
Time commitment
Approximately 60–90 minutes. You may save your progress at any point and return later using the load function.
Confidentiality
Data will be stored in secure, password-protected systems or university-approved storage. Reports will use de-identified summaries unless you explicitly consent to attribution. Records will be retained for at least three years beyond the close of the research.
Voluntary participation
Participation is entirely voluntary. You may withdraw at any time without penalty and may skip any item that makes you uncomfortable.
Contact
Principal Investigator: Dr. Scott J. Warren, scott.warren@unt.edu, 940-369-7489. IRB questions: UNT Office of Research Integrity and Compliance, 940-565-4643, untirb@unt.edu.
Please enter your first and last name and select your primary domain expertise.
Please read and agree to the consent statement to continue.
Step 2 of 5
Matrix Ratings
Rate each of the eight ILO matrices across four validity dimensions. Use the tabs to navigate between matrices. Expand terms to read full definitions before scoring.
0
Matrices rated
0
Dimensions rated
—
Overall avg / 7
Step 3 of 5
Relationship Validity
The ILO specifies formal relationships between matrices and with the companion Immersion Ontology. Evaluate each claim on logical necessity and empirical plausibility.
Step 4 of 5 — Kairos Research
Instrument Feedback
This section is about Kairos itself — not the ILO you evaluated. Critical and candid feedback is more valuable than positive feedback.
Time and effort
Validity dimensions
Matrices and relationships
Instrument experience
Step 5 of 5
Review & Submit
Review your evaluation summary below. Download both files and email them to the research team.
Download your files
📄
Download CSV
Structured data for analysis
📋
Download HTML Report
Formatted evaluation summary
Send both downloaded files to scott.warren@unt.edu. The button below pre-fills the subject and body.