Skip to content

Learning Platform Evaluation — Scoring Framework

How to Use This Framework

This 72-criterion framework covers the full range of factors relevant to selecting a learning platform. Each criterion has a default weight (0 = not applicable, 1.0 = critical). Adjust weights based on the context established in 02-requirements-gathering.md.

Scoring scale: 1 (Poor / absent) → 2 (Below average) → 3 (Acceptable / present) → 4 (Good) → 5 (Excellent / best-in-class)

Weighted score per criterion: score × weight

Final weighted total: Sum of all weighted scores. Use this for cross-platform comparison.

Hard Filters (Apply Before Scoring)

Some criteria should be treated as non-negotiable. Platforms failing any hard filter should be eliminated before entering the scoring matrix. Hard filters vary by context — set them based on requirements gathered in Step 1.

Common hard filters for US Higher Education:

Hard FilterVerification Required
WCAG 2.1 AA accessibilityDocumented VPAT / accessibility statement
FERPA complianceWritten data processing agreement with FERPA terms
Data residency (US-only)Contractual commitment, not just marketing claim
Minimum uptime SLA (≥99.9%)SLA documented in contract, not just stated on website

Common hard filters for Enterprise / Corporate:

Hard FilterVerification Required
SOC 2 Type IICurrent audit report (within 12 months)
SSO / SAML 2.0Technical documentation, not just "supported" claim
GDPR compliance (if EU learners)DPA and sub-processor list available

Category 1: Learner Experience

Covers the quality of the interface, navigation, personalization, mobile access, and accessibility for the end learner.

#CriterionDefault WeightWhat to Evaluate / Demo Questions
1UI intuitiveness & navigation0.8Can a first-time learner find, start, and resume a course without training? Ask for a first-time learner demo.
2Mobile experience0.6Is there a native iOS/Android app, or mobile-responsive web? Can learners complete assessments on mobile?
3Offline / low-bandwidth access0.2Can content be downloaded for offline use? Does the platform perform on slow connections?
4Personalization & learning paths0.5Can learners receive role-based content recommendations? Are adaptive learning paths available?
5Gamification0.3Are points, badges, leaderboards, and achievement systems available and configurable?
6Learner dashboard & progress visibility0.7Can learners easily see completion status, upcoming due dates, and certificate progress in one view?
7Notification & reminder system0.5Are automated reminders sent for deadlines and incomplete courses? Are they configurable?

Weight adjustment guidance:

  • If mobile app is a hard requirement: increase criterion 2 to 1.0
  • If offline / field-worker access is needed: increase criterion 3 to 0.8–1.0
  • If gamification is specifically requested: increase criterion 5 to 0.7

Category 2: Content & Curriculum Authoring

Covers the tools and formats available for creating, organizing, and managing course content.

#CriterionDefault WeightWhat to Evaluate / Demo Questions
8Native course authoring tool0.7Is there a built-in authoring tool (no external tool required)? Can non-technical SMEs use it?
9Supported content formats0.8Does the platform support: video, PDF, SCORM, xAPI, H5P, audio, embedded code, live sessions? Request a format checklist.
10AI-assisted content creation0.4Can AI generate course outlines, lesson drafts, quiz questions, or translations from source documents?
11Course templates & reuse0.5Are course templates available? Can courses or modules be cloned for reuse across programs?
12Content versioning & update workflow0.6Can content be updated without breaking enrolled learner records? Is versioning tracked?
13Collaborative / SME authoring0.5Can subject matter experts co-author or contribute content without full admin access?
14Pre-built content library access0.3Is there a built-in off-the-shelf course library (compliance, soft skills, technical) included or available?

Weight adjustment guidance:

  • If SME-driven authoring is the model: increase criteria 8, 10, 13 to 0.8–1.0
  • If AI authoring is a differentiator in the evaluation: increase criterion 10 to 0.8–1.0
  • If all content is SCORM/xAPI from an external authoring tool: reduce criterion 8 and increase criterion 9

Category 3: Assessment & Credentialing

Covers the platform's ability to assess learner knowledge, skills, and issue verifiable credentials.

#CriterionDefault WeightWhat to Evaluate / Demo Questions
15Assessment types available0.8Does the platform support: multiple choice, true/false, short answer, essay, file upload, peer review, video response?
16Automated grading0.6Are objective assessments auto-graded? What question types support auto-grading?
17Rubric-based grading0.5Can instructors create and apply rubrics to subjective assessments? Do rubrics link to a gradebook?
18Certificates & digital badges0.7Are certificates automatically issued on completion? Are badges aligned to Open Badges / Credly for external verification?
19Competency / skills-based progression0.4Can the platform require demonstrated competency (not just completion) before unlocking next content?
20Proctoring integration0.3Does the platform integrate with proctoring services (Honorlock, ProctorU, Respondus)? Is it seamless within the learner flow?
21Assessment analytics0.5Can instructors see question-level performance data? Are item analysis reports available?

Weight adjustment guidance:

  • For compliance-heavy contexts: increase criteria 15, 16, 18 to 1.0
  • For academic institutions with high-stakes exams: increase criterion 20 to 0.8
  • For competency-based education programs: increase criterion 19 to 1.0

Category 4: Administration & User Management

Covers user provisioning, roles, enrollment automation, and organizational structure.

#CriterionDefault WeightWhat to Evaluate / Demo Questions
22User provisioning & lifecycle0.7Can users be created, deactivated, and deleted in bulk? Is lifecycle tied to HR/SIS data?
23Roles & permissions model0.8Are roles granular (admin / instructor / manager / learner / external)? Can custom roles be created?
24Enrollment automation0.7Can enrollment be triggered automatically by role, group, hire date, or external system events?
25Organizational hierarchy / groups0.6Can learners be organized into departments, cohorts, teams, or locations with separate reporting?
26Multi-tenancy / multi-org support0.4Can the platform support multiple branded sub-instances or portals from a single admin console?
27Bulk operations0.6Can admins perform bulk enrollment, unenrollment, content assignment, and user updates via CSV or API?
28Audit log0.5Is there a complete activity log of admin actions, enrollment changes, and assessment events for compliance purposes?

Weight adjustment guidance:

  • For large organizations with complex org structures: increase criteria 23, 24, 25 to 1.0
  • For customer education platforms: increase criterion 26 to 1.0
  • If HR/SIS auto-provisioning is required: increase criterion 22 to 1.0

Category 5: Collaboration & Community

Covers peer interaction, live session support, discussion tools, and social learning features.

#CriterionDefault WeightWhat to Evaluate / Demo Questions
29Discussion forums0.6Are course-level discussion forums available? Can threads be moderated? Are they threaded/nested?
30Cohort / group-based learning0.5Can learners be grouped into cohorts with separate discussion spaces, deadlines, or content tracks?
31Live session integration0.6Does the platform integrate with Zoom, Teams, or Webex? Can recordings be embedded back into the course?
32Peer review & collaborative projects0.4Is peer review of submissions available? Can group projects be assigned and tracked?
33Social / community layer0.3Are there platform-level social features (profiles, feeds, following) beyond course discussions?
34User-generated content (UGC)0.2Can learners or employees create and share content that others can discover?
35Messaging & announcements0.5Can instructors or admins send targeted messages to learner groups? Is learner-to-learner messaging available?

Weight adjustment guidance:

  • For cohort-based programs: increase criteria 29, 30, 31 to 0.9
  • For enterprise social learning / LXP use cases: increase criteria 33, 34 to 0.8
  • For customer community + education: increase criteria 30, 33 to 0.9

Category 6: Analytics & Reporting

Covers learner progress tracking, skills analytics, compliance reporting, and data access.

#CriterionDefault WeightWhat to Evaluate / Demo Questions
36Learner progress dashboards0.8Can managers and admins see real-time completion rates by learner, course, department, and date?
37Compliance & audit reporting0.7Can the platform generate compliance reports (who completed required training, when, with what score) exportable for audits?
38Assessment / content performance analytics0.6Are course-level and question-level performance reports available? Can content effectiveness be measured?
39Skills tracking & gap analysis0.4Does the platform track skills linked to learning activity? Can it identify skill gaps at individual and team level?
40Custom report builder0.5Can admins build custom reports with configurable filters, fields, and scheduled delivery?
41Data export / API access0.7Can all learning data be exported via CSV, API, or direct database connection? Is xAPI / LRS integration available?
42Predictive analytics / AI insights0.2Does the platform offer at-risk learner detection, completion probability, or AI-generated insights?

Weight adjustment guidance:

  • For compliance-heavy industries: increase criteria 36, 37 to 1.0
  • If BI/data warehouse integration is required: increase criterion 41 to 1.0
  • For skills-based organizations: increase criteria 39, 40 to 0.8–1.0
  • For Phase 1 / minimal analytics: set criteria 39, 40, 42 to 0

Category 7: Integration & Interoperability

Covers standards compliance, identity management, and connection to the broader tech stack.

#CriterionDefault WeightWhat to Evaluate / Demo Questions
43LTI 1.3 / LTI Advantage0.7Does the platform support LTI 1.3 as both a consumer and provider? Ask for a list of certified LTI integrations.
44SCORM & xAPI support0.8Does the platform import and track SCORM 1.2, SCORM 2004, xAPI (Tin Can), and AICC packages?
45SSO / identity management0.8Is SAML 2.0 supported? What identity providers are certified (Azure AD, Okta, Google, Shibboleth)?
46SIS / HRIS integration0.6Does the platform integrate with common SIS/HRIS systems (Banner, PeopleSoft, Workday, SAP SuccessFactors)?
47CRM integration0.3Is there a native Salesforce integration? Can training data sync with CRM records?
48Open API0.6Is a comprehensive REST API available with documentation? Are webhooks supported for event-driven integrations?
49Pre-built integrations ecosystem0.5How many certified/native integrations are available? Is there a published integration marketplace?

Weight adjustment guidance:

  • If LTI tools are critical (publisher content, proctoring): increase criterion 43 to 1.0
  • If HRIS auto-provisioning is required: increase criterion 46 to 1.0
  • For customer education with Salesforce dependency: increase criterion 47 to 1.0
  • If all content is SCORM from an authoring tool: increase criterion 44 to 1.0

Category 8: Security, Compliance & Accessibility

Covers data protection, regulatory compliance, and accessibility standards.

#CriterionDefault WeightWhat to Evaluate / Demo Questions
50WCAG 2.1 AA accessibility1.0Request a current VPAT (Voluntary Product Accessibility Template). Verify it covers all learner-facing interfaces, not just the admin panel.
51Data residency0.7Where is data stored? Can the institution specify a region or country? Is this contractually guaranteed?
52FERPA / COPPA / GDPR compliance0.8Is a Data Processing Agreement (DPA) available? What student/learner data is collected and shared with third parties?
53SOC 2 Type II / ISO 270010.7Is a current SOC 2 Type II report available? What is the audit frequency?
54Encryption & data security0.7Is data encrypted at rest (AES-256) and in transit (TLS 1.2+)? What is the penetration testing cadence?
55Data portability & deletion0.6Can all institutional/learner data be exported in a portable format at contract end? Can data be deleted on request?
56Role-based access controls0.7Are permissions granular enough to prevent unauthorized access to learner data across organizational units?

Weight adjustment guidance:

  • WCAG 2.1 AA is preset at 1.0 and should be treated as a hard filter for US higher ed and government
  • If FERPA applies: treat criterion 52 as a hard filter
  • If EU learners are involved: treat GDPR (within criterion 52) as a hard filter
  • If FedRAMP is required (US government): add it as a separate hard filter

Category 9: Infrastructure & Scalability

Covers deployment model, performance under load, uptime, and disaster recovery.

#CriterionDefault WeightWhat to Evaluate / Demo Questions
57Deployment model flexibility0.5Does the platform offer SaaS, self-hosted, and/or on-premise options? What are the trade-offs for each?
58Uptime SLA0.7What uptime is contractually guaranteed? What is the historical uptime for the past 12 months? Are maintenance windows scheduled outside business hours?
59Scalability under peak load0.7How does the platform handle enrollment spikes, exam periods, or mandatory training deadlines? Ask for evidence of peak load handling.
60Backup & disaster recovery0.5What is the backup frequency and retention period? What are the RTO and RPO targets?
61Infrastructure transparency0.4Is there a public status page? How are incidents communicated? What is the average P1 resolution time?

Weight adjustment guidance:

  • If self-hosted or on-premise is required: increase criterion 57 to 1.0
  • For mission-critical deployments: increase criteria 58, 59 to 1.0
  • For government / FedRAMP contexts: treat infrastructure criteria more stringently

Category 10: Implementation & Onboarding

Covers the time, effort, and support required to get from contract to production.

#CriterionDefault WeightWhat to Evaluate / Demo Questions
62Time to production0.6What is the typical setup and go-live timeline? What are the dependencies on the customer side?
63Content migration support0.4Does the vendor support migration of existing content (SCORM, course data, user records)? What formats are supported?
64Sandbox / staging environment0.6Is a dedicated non-production environment provided for testing? Is it always available or time-limited?
65Admin & instructor training0.6Is training included in the contract? What formats (live, async, documentation)? What is the quality of documentation?
66Implementation support model0.6Does the vendor provide an implementation manager or project manager? Is this included or a paid add-on?

Weight adjustment guidance:

  • If go-live timeline is tight (driven by academic calendar or contract renewal): increase criterion 62 to 1.0
  • If migration is in scope: increase criterion 63 to 0.8
  • If the organization has no technical staff: increase criteria 65, 66 to 1.0

Category 11: Support & Service

Covers ongoing support quality, channels, and account management post-launch.

#CriterionDefault WeightWhat to Evaluate / Demo Questions
67Support hours & channels0.7Is support available 24/7 or business hours only? What channels: ticket, chat, phone, Slack? What P1 response time is SLA-backed?
68Dedicated account management0.5Is a named Customer Success Manager (CSM) or Account Manager assigned? Is this included or a paid tier?
69Community & self-service resources0.6Is there an active user community, documentation portal, and knowledge base? What is the quality of self-service resources?
70Upgrade & release management0.5How are platform updates communicated? Is there a release calendar? Can updates be deferred?

Weight adjustment guidance:

  • If the organization has no internal technical staff: increase criterion 67 to 1.0
  • If a dedicated CSM relationship is required: increase criterion 68 to 1.0

Category 12: Pricing & Commercial Terms

Covers pricing transparency, total cost of ownership, and contract flexibility.

#CriterionDefault WeightWhat to Evaluate / Demo Questions
71Pricing model transparency0.7Is pricing public, or does it require a sales call to discover? Is the model per-seat, per-active-user, or flat-fee?
72Total cost of ownership (TCO)0.8What costs are included vs. extra (implementation, training, migrations, storage overages, integrations, support tiers)?
73Cost predictability at scale0.8How do costs change as users grow? Are overage pricing policies clear? Ask for a 3-year cost projection.
74E-commerce / monetization support0.2Does the platform support selling courses, subscriptions, or certifications with built-in payment processing?
75Contract terms & exit provisions0.6What is the minimum contract term? What are the exit/termination clauses? Is data returned in a portable format?
76Discounts & non-profit / edu pricing0.4Are education or non-profit pricing tiers available? Are multi-year discounts offered?

Weight adjustment guidance:

  • If budget is the primary constraint: increase all criteria in this category to 1.0
  • If course monetization is a use case: increase criterion 74 to 0.8–1.0
  • If a long-term, multi-year relationship is planned: increase criterion 75 to 1.0

Category 13: Vendor & Platform Viability

Covers the long-term health and strategic fit of the vendor and platform.

#CriterionDefault WeightWhat to Evaluate / Demo Questions
77Company stability & funding0.8Is the company publicly traded, VC-backed, non-profit, or bootstrapped? What is the funding runway or revenue profile? Any recent ownership changes?
78Customer base & references0.7How many customers of similar size and type? Can the vendor provide references in the same sector (higher ed, enterprise, government)?
79Product roadmap transparency0.6Is there a published product roadmap? How are customer requests incorporated? What AI features are on the roadmap?
80Community & open-source posture0.4Is the platform open-source? Does the vendor contribute to open standards (LTI, xAPI, IMS Global)? Is there an active user community?
81Market momentum0.5Is the platform gaining or losing market share? What is the analyst community saying? Are peer reviews (G2, Gartner) trending positively?

Weight adjustment guidance:

  • If the organization is risk-averse or committing to a multi-year contract: increase criterion 77 to 1.0
  • If open-source or standards participation matters: increase criterion 80 to 0.8–1.0
  • If the platform is a newly founded company: treat criterion 77 with heightened scrutiny

Summary: Default Weights by Category

#CategoryCriteria CountAvg Default WeightNotes
1Learner Experience70.51Increase mobile/offline for frontline
2Content & Curriculum Authoring70.54Increase AI if differentiator
3Assessment & Credentialing70.54Increase for compliance/academic
4Administration & User Management70.61Increase for large org complexity
5Collaboration & Community70.44Increase for LXP/social use cases
6Analytics & Reporting70.56Increase for compliance/BI integration
7Integration & Interoperability70.61Increase LTI/HRIS/API as needed
8Security, Compliance & Accessibility70.77WCAG is always 1.0; treat FERPA/GDPR as hard filters
9Infrastructure & Scalability50.56Increase for high-stakes / high-scale
10Implementation & Onboarding50.56Increase if no internal tech staff
11Support & Service40.58Increase if no internal tech staff
12Pricing & Commercial Terms60.58Set all to 1.0 if budget-constrained
13Vendor & Platform Viability50.60Increase if long-term commitment

Scoring Template

Copy this table for each platform being evaluated. Fill in Score (1–5) per criterion, compute Weighted Score.

Category#CriterionWeightScore (1–5)Weighted Score
Learner Experience1UI intuitiveness & navigation0.8
2Mobile experience0.6
3Offline / low-bandwidth access0.2
4Personalization & learning paths0.5
5Gamification0.3
6Learner dashboard & progress visibility0.7
7Notification & reminder system0.5
Content & Curriculum8Native course authoring tool0.7
9Supported content formats0.8
10AI-assisted content creation0.4
11Course templates & reuse0.5
12Content versioning & update workflow0.6
13Collaborative / SME authoring0.5
14Pre-built content library access0.3
Assessment & Credentialing15Assessment types available0.8
16Automated grading0.6
17Rubric-based grading0.5
18Certificates & digital badges0.7
19Competency / skills-based progression0.4
20Proctoring integration0.3
21Assessment analytics0.5
Administration & User Mgmt22User provisioning & lifecycle0.7
23Roles & permissions model0.8
24Enrollment automation0.7
25Organizational hierarchy / groups0.6
26Multi-tenancy / multi-org support0.4
27Bulk operations0.6
28Audit log0.5
Collaboration & Community29Discussion forums0.6
30Cohort / group-based learning0.5
31Live session integration0.6
32Peer review & collaborative projects0.4
33Social / community layer0.3
34User-generated content (UGC)0.2
35Messaging & announcements0.5
Analytics & Reporting36Learner progress dashboards0.8
37Compliance & audit reporting0.7
38Assessment / content performance analytics0.6
39Skills tracking & gap analysis0.4
40Custom report builder0.5
41Data export / API access0.7
42Predictive analytics / AI insights0.2
Integration & Interoperability43LTI 1.3 / LTI Advantage0.7
44SCORM & xAPI support0.8
45SSO / identity management0.8
46SIS / HRIS integration0.6
47CRM integration0.3
48Open API0.6
49Pre-built integrations ecosystem0.5
Security & Compliance50WCAG 2.1 AA accessibility1.0
51Data residency0.7
52FERPA / COPPA / GDPR compliance0.8
53SOC 2 Type II / ISO 270010.7
54Encryption & data security0.7
55Data portability & deletion0.6
56Role-based access controls0.7
Infrastructure & Scalability57Deployment model flexibility0.5
58Uptime SLA0.7
59Scalability under peak load0.7
60Backup & disaster recovery0.5
61Infrastructure transparency0.4
Implementation & Onboarding62Time to production0.6
63Content migration support0.4
64Sandbox / staging environment0.6
65Admin & instructor training0.6
66Implementation support model0.6
Support & Service67Support hours & channels0.7
68Dedicated account management0.5
69Community & self-service resources0.6
70Upgrade & release management0.5
Pricing & Commercial Terms71Pricing model transparency0.7
72Total cost of ownership (TCO)0.8
73Cost predictability at scale0.8
74E-commerce / monetization support0.2
75Contract terms & exit provisions0.6
76Discounts & non-profit / edu pricing0.4
Vendor & Platform Viability77Company stability & funding0.8
78Customer base & references0.7
79Product roadmap transparency0.6
80Community & open-source posture0.4
81Market momentum0.5
TOTAL=SUM()

Schema Education — Internal Research