john/tractatus
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
390 commits 1 branch 0 tags 125 MiB
Commit graph

82 commits

Author SHA1 Message Date
TheFlow
a1ab559899 fix(analytics): remove SessionSchema.index sessionId duplicate 
- Line 49 has sessionId with unique: true (creates index automatically)
- Line 75 had redundant SessionSchema.index({ sessionId: 1 })
- Removed explicit index to eliminate Mongoose duplicate warning
 2025-10-24 10:25:02 +13:00
TheFlow
d108da8ef8 fix(analytics): remove duplicate sessionId index in PageViewSchema 
- PageViewSchema had 'index: true' on sessionId field (line 16)
- AND compound index PageViewSchema.index({ sessionId: 1, timestamp: -1 })
- Compound index already covers sessionId queries (leftmost prefix)
- Removed redundant single-field index to eliminate Mongoose warning
 2025-10-24 10:22:41 +13:00
TheFlow
d8fdeddb8d fix(analytics): remove duplicate sessionId index definition 
- SessionSchema had both 'unique: true' and 'index: true'
- unique already creates an index, making index redundant
- Resolves Mongoose warning about duplicate schema index
 2025-10-24 10:21:31 +13:00
TheFlow
6626cbc7e1 fix(submissions): resolve Mongoose populate error for hybrid BlogPost model 
- BlogPost uses native MongoDB (not Mongoose), causing MissingSchemaError
- Removed all .populate('blogPostId') calls that tried to reference non-existent Mongoose model
- Manually fetch blog post data in controllers when needed
- Updated getSubmissions, getSubmissionById, getSubmissionByBlogPost, exportSubmission
- Updated SubmissionTracking static methods: getByStatus, getByPublication
- Standalone submissions (like Le Monde) now display without errors
 2025-10-24 10:19:33 +13:00
TheFlow
2c90f62a1e fix(submissions): handle null blogPostId in populate query 
- Changed populate to use options object with strictPopulate: false
- Allows submissions without blogPostId (standalone packages) to be returned
- Fixes 500 error on /api/submissions endpoint
- Le Monde package should now be visible in UI after server restart
 2025-10-24 09:55:51 +13:00
TheFlow
971690bb64 feat(cache): enforce mandatory cache version updates for JS changes 
- Enhanced update-cache-version.js to update service worker and version.json
- Added inst_075 governance instruction (HIGH persistence)
- Integrated cache check into deployment script (Step 1/5)
- Created CACHE_MANAGEMENT_ENFORCEMENT.md documentation
- Bumped version to 0.1.1
- Updated all HTML cache parameters

BREAKING: Deployment now blocks if JS changed without cache update
 2025-10-24 09:43:20 +13:00
TheFlow
2298d36bed fix(submissions): restructure Economist package and fix article display 
- Create Economist SubmissionTracking package correctly:
  * mainArticle = full blog post content
  * coverLetter = 216-word SIR— letter
  * Links to blog post via blogPostId
- Archive 'Letter to The Economist' from blog posts (it's the cover letter)
- Fix date display on article cards (use published_at)
- Target publication already displaying via blue badge

Database changes:
- Make blogPostId optional in SubmissionTracking model
- Economist package ID: 68fa85ae49d4900e7f2ecd83
- Le Monde package ID: 68fa2abd2e6acd5691932150

Next: Enhanced modal with tabs, validation, export

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-24 08:47:42 +13:00
TheFlow
f9ab3db284 feat(submissions): add multilingual document storage for publication packages 
Extends SubmissionTracking model to support complete bilingual submission
packages with version control for multiple languages.

Schema additions:
- documents.coverLetter.versions[] - Language-versioned content
- documents.mainArticle.versions[] - With translation metadata
- documents.authorBio.versions[]
- documents.technicalBrief.versions[]

Helper methods:
- getDocument(docType, language, fallbackToDefault)
- setDocumentVersion(docType, language, content, metadata)
- getAvailableLanguages(docType)
- isPackageComplete(language)
- exportPackage(language)

Scripts:
- load-lemonde-package.js - Loads complete Le Monde submission package

Le Monde Package:
- Publication target: Rank 10, high-value French intellectual publication
- Theme: Post-Weberian organizational theory for AI age
- Content: Wittgenstein + Weber critique + indigenous data sovereignty
- Format: 187-word letter (within 150-200 requirement)
- Languages: English (original) + French (translated)
- Database ID: 68fa2abd2e6acd5691932150
- Status: Ready for submission

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-24 02:18:18 +13:00
TheFlow
b6d972d000 fix(lint): resolve eslint errors in submission tracking 
- Add missing space after comma in SubmissionTracking model
- Replace string concatenation with template literal in blog controller

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-24 01:57:47 +13:00
TheFlow
46f3d6e7c6 feat(blog): add Manage Submission modal for publication tracking 
Implements comprehensive submission tracking workflow for blog posts
targeting external publications. This feature enables systematic
management of submission packages and progress monitoring.

Frontend:
- Add submission-modal.js with complete modal implementation
- Modal includes publication selector (22 ranked publications)
- 4-item submission checklist (cover letter, pitch, notes, bio)
- Auto-save on blur with success indicators
- Progress bar (0-100%) tracking completion
- Requirements display per publication
- Update blog-validation.js with event handlers
- Update cache versions (HTML, service worker, version.json)

Backend:
- Add GET /api/blog/:id/submissions endpoint
- Add PUT /api/blog/:id/submissions endpoint (upsert logic)
- Implement getSubmissions and updateSubmission controllers
- Fix publications controller to use config helper functions
- Integration with SubmissionTracking MongoDB model

Version: 1.8.4

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-24 01:55:06 +13:00
TheFlow
4c656385fe feat(server): add security middleware and website-specific routes 
Server Infrastructure Updates:
- Added response sanitization middleware (fixes Date serialization)
- Added CSRF protection middleware (double-submit cookie pattern)
- Enhanced rate limiting (public, form, auth limiters)
- Added cache control middleware for static assets
- Added cookie parser for CSRF support

Route Organization:
- Reorganized routes for website (auth, documents, blog, newsletter)
- Separated admin routes with /admin prefix
- Added koha routes for donations
- Added demo routes for interactive demonstrations
- Dev/test routes only in development environment

Config Updates:
- Updated app config for website platform
- Added website-specific configuration options

Model Updates:
- Updated model exports for website collections
- Added blog, media, newsletter models

These changes support the website platform while maintaining the
underlying Tractatus governance framework.
 2025-10-23 10:57:20 +13:00
TheFlow
fdbf5994fe fix(middleware): critical Date serialization bug in response sanitization 
Problem: All MongoDB Date objects were being serialized as empty {} in API
responses, breaking blog date display across entire site.

Root Cause: removeSensitiveFields() function used spread operator on Date
objects ({...date}), which creates empty object because Dates have no
enumerable properties.

Fix: Added Date instance check before spreading to preserve Date objects
intact for proper JSON.stringify() serialization.

Impact:
- Fixes all blog dates showing 'Invalid Date'
- API now returns proper ISO date strings
- Deployed to production and verified working

Ref: SESSION_HANDOFF_2025-10-23_WEBSITE_AUDIT.md
 2025-10-23 10:55:38 +13:00
TheFlow
2af47035ac refactor: remove website code and fix critical startup crashes (Phase 8) 
CRITICAL FIX: Server would CRASH ON STARTUP (multiple import errors)

REMOVED (2 scripts):
1. scripts/framework-watchdog.js
   - Monitored .claude/session-state.json (OUR Claude Code setup)
   - Monitored .claude/token-checkpoints.json (OUR file structure)
   - Implementers won't have our .claude/ directory

2. scripts/init-db.js
   - Created website collections: blog_posts, media_inquiries, case_submissions
   - Created website collections: resources, moderation_queue, users, citations
   - Created website collections: translations, koha_donations
   - Next steps referenced deleted scripts (npm run seed:admin)

REWRITTEN (2 files):

src/models/index.js (29 lines → 27 lines)
- REMOVED imports: Document, BlogPost, MediaInquiry, CaseSubmission, Resource
- REMOVED imports: ModerationQueue, User (all deleted in Phase 2)
- KEPT imports: AuditLog, DeliberationSession, GovernanceLog, GovernanceRule
- KEPT imports: Precedent, Project, SessionState, VariableValue, VerificationLog
- Result: Only framework models exported

src/server.js (284 lines → 163 lines, 43% reduction)
- REMOVED: Imports to deleted middleware (csrf-protection, response-sanitization)
- REMOVED: Stripe webhook handling (/api/koha/webhook)
- REMOVED: Static file caching (for deleted public/ directory)
- REMOVED: Static file serving (public/ deleted in Phase 6)
- REMOVED: CSRF token endpoint
- REMOVED: Website homepage with "auth, documents, blog, admin" references
- REMOVED: Instruction sync (scripts/sync-instructions-to-db.js reference)
- REMOVED: Hardcoded log path (${process.env.HOME}/var/log/tractatus/...)
- REMOVED: Website-specific security middleware
- KEPT: Security headers, rate limiting, CORS, body parsers
- KEPT: API routes, governance services, MongoDB connections
- RESULT: Clean framework-only server

RESULT: Repository can now start without crashes, all imports resolve

🤖 Generated with Claude Code
Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-21 22:17:02 +13:00
TheFlow
5ca2777815 refactor: remove project-specific code and fix broken imports (Phase 7) 
CRITICAL FIX: src/routes/index.js was importing 10 non-existent route files
- Repository would CRASH ON STARTUP

REMOVED (8 files):
- src/config/currencies.config.js - Koha donation system (10 currencies, exchange rates)
- src/routes/hooks-metrics.routes.js - Required deleted auth.middleware
- src/routes/sync-health.routes.js - Required deleted auth.middleware
- src/utils/security-logger.js - Hardcoded /var/log/tractatus paths, OUR inst_046
- scripts/seed-admin.js - Required deleted User.model
- scripts/validate-deployment.js - OUR deployment validation (inst_025)
- systemd/tractatus-dev.service - OUR server at /var/www/tractatus
- systemd/tractatus-prod.service - OUR production server config

REWRITTEN (2 files):
src/routes/index.js
- Removed imports: auth, documents, blog, newsletter, media, cases, admin, koha, demo, test
- Removed imports: hooks-metrics, sync-health (just deleted)
- Keep only: rules, projects, audit, governance (framework routes)
- Removed website endpoint documentation
- Updated to framework v3.5.0

src/config/app.config.js
- Removed: JWT config (auth system deleted)
- Removed: admin.email = john.stroh.nz@pm.me (hardcoded project-specific)
- Removed: features.aiCuration/mediaTriage/caseSubmissions (website features)
- Keep only: server, mongodb, logging, security (rate limiting), CORS
- Now generic template for implementers

RESULT: Repository can now start without errors, all imports resolve

🤖 Generated with Claude Code
Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-21 22:06:43 +13:00
TheFlow
aab23e8c33 refactor: deep cleanup - remove all website code from framework repo 
REMOVED: 77 website-specific files from src/ and public/

Website Models (9):
- Blog, CaseSubmission, Document, Donation, MediaInquiry,
  ModerationQueue, NewsletterSubscription, Resource, User

Website Services (6):
- BlogCuration, MediaTriage, Koha, ClaudeAPI, ClaudeMdAnalyzer,
  AdaptiveCommunicationOrchestrator

Website Controllers (9):
- blog, cases, documents, koha, media, newsletter, auth, admin, variables

Website Routes (10):
- blog, cases, documents, koha, media, newsletter, auth, admin, test, demo

Website Middleware (4):
- auth, csrf-protection, file-security, response-sanitization

Website Utils (3):
- document-section-parser, jwt, markdown

Website JS (36):
- Website components, docs viewers, page features, i18n, Koha

RETAINED Framework Code:
- 6 core services (Boundary, ContextPressure, CrossReference,
  InstructionPersistence, Metacognitive, PluralisticDeliberation)
- 4 support services (AnthropicMemoryClient, MemoryProxy,
  RuleOptimizer, VariableSubstitution)
- 9 framework models (governance, audit, deliberation, project state)
- 3 framework controllers (rules, projects, audit)
- 7 framework routes (rules, governance, projects, audit, hooks, sync)
- 6 framework middleware (error, validation, security, governance)
- Minimal admin UI (rule manager, dashboard, hooks dashboard)
- Framework demos and documentation

PURPOSE: Tractatus-framework repo is now PURELY framework code.
All website/project code remains in internal repo only.

🤖 Generated with Claude Code
Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-21 21:22:40 +13:00
TheFlow
0958d8d2cd fix(mongodb): resolve production connection drops and add governance sync system 
- Fixed sync script disconnecting Mongoose (prevents production errors)
- Created text search index (fixes search in rule-manager)
- Enhanced inst_024 with closedown protocol, added inst_061
- Added sync infrastructure: API routes, dashboard widget, auto-sync
- Fixed MemoryProxy tests MongoDB connection
- Created ADR-001 and integration tests

Result: Production stable, 52 rules synced, search working

🤖 Generated with Claude Code
Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-21 11:39:05 +13:00
TheFlow
3137e13888 chore(framework): session tracking, test enforcement, and schema improvements 
SUMMARY:
Atomic commit of framework improvements and session tracking from 2025-10-20
admin UI overhaul session. Includes test enforcement, schema fixes, null
handling, and comprehensive session documentation.

FRAMEWORK IMPROVEMENTS:

1. Test Failure Enforcement (scripts/session-init.js):
   - Test failures now BLOCK session initialization (was warning only)
   - Exit with code 1 on test failures
   - Prevents sessions from starting with broken framework components
   - Enhanced error messaging for clarity

2. Schema Fix (src/models/VerificationLog.model.js):
   - Fixed 'type' field conflict in action subdocument
   - Explicitly nest fields to avoid Mongoose keyword collision
   - Was causing schema validation issues

3. Null Handling (src/services/MetacognitiveVerifier.service.js):
   - Added null parameter validation in verify() method
   - Returns BLOCK decision for null action/reasoning
   - Prevents errors in test scenarios expecting graceful degradation
   - Confidence: 0, Level: CRITICAL for null inputs

SESSION TRACKING:

4. Hooks Metrics (.claude/metrics/hooks-metrics.json):
   - Total edit hooks: 708 (was 707)
   - Total write hooks: 212 (was 211)
   - Tracked session activity for governance analysis
   - Last updated: 2025-10-20T09:16:38.047Z

5. User Suggestions (.claude/user-suggestions.json):
   - Added suggestion tracking: "could be a tailwind issue"
   - Hypothesis priority: HIGH
   - Enables inst_049 enforcement (test user hypothesis first)
   - Session: 2025-10-07-001

6. Session Completion Document:
   - SESSION_COMPLETION_2025-10-20_ADMIN_UI_AND_AUTONOMOUS_RULES.md
   - Complete session summary: Phase 1, Phase 2, autonomous rules
   - Token usage: 91,873 / 200,000 (45.9%)
   - Framework pressure: 14.6% (NORMAL)
   - Zero errors, 8 new rules established

RATIONALE:
These changes improve framework robustness (test enforcement, null handling),
fix technical debt (schema conflict), and provide complete session audit trail
for governance analysis and future sessions.

IMPACT:
- Test failures now prevent broken sessions (was allowing them)
- Schema validation errors resolved
- MetacognitiveVerifier handles edge cases gracefully
- Complete session audit trail preserved

FILES MODIFIED: 6
- scripts/session-init.js: Test enforcement
- src/models/VerificationLog.model.js: Schema fix
- src/services/MetacognitiveVerifier.service.js: Null handling
- .claude/metrics/hooks-metrics.json: Session activity
- .claude/user-suggestions.json: Hypothesis tracking

FILES ADDED: 1
- SESSION_COMPLETION_2025-10-20_ADMIN_UI_AND_AUTONOMOUS_RULES.md: Session documentation

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-21 04:05:09 +13:00
TheFlow
4e4401a117 fix(auth): resolve admin login - token sanitization and missing password field 
SUMMARY:
Fixed admin login failures caused by two issues:
1. Response sanitization middleware stripping auth tokens
2. Admin users missing password field in database

ROOT CAUSE ANALYSIS:
- sanitizeResponseData middleware removed ALL fields named 'token'
- This included authentication tokens that SHOULD be sent to clients
- Admin user records created without proper password field
- User.authenticate() failed on bcrypt.compare() with undefined password

FIXES:
1. Changed auth response field from 'token' to 'accessToken'
   - Avoids overly aggressive sanitization
   - More semantically correct (it's specifically an access token)
   - Frontend updated to use data.accessToken

2. Created fix-admin-user.js script
   - Properly creates admin user via User.create()
   - Ensures password field is bcrypt hashed
   - Deletes old malformed user records

3. Updated login.js auto-fill for correct dev email
   - Changed from admin@tractatus.local to admin@agenticgovernance.digital

TESTING:
- Local login now returns accessToken (308 char JWT)
- User object returned with proper ID serialization
- Auth flow: POST /api/auth/login → returns accessToken + user
- Ready for production deployment

FILES:
- src/controllers/auth.controller.js: Use accessToken field
- public/js/admin/login.js: Store data.accessToken, update default email
- scripts/fix-admin-user.js: Admin user creation/fix utility

NEXT STEPS:
1. Deploy to production
2. Run: node scripts/fix-admin-user.js admin@agenticgovernance.digital <password>
3. Test admin login at /admin/login.html

🤖 Generated with Claude Code (https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-20 21:13:42 +13:00
TheFlow
f8ef2128fc refactor(data): migrate legacy public field to modern visibility field 
SUMMARY:
Completed migration from deprecated 'public: true/false' field to modern
'visibility' field across entire codebase. Ensures single source of truth
for document visibility state.

MIGRATION EXECUTION:
✓ Created migration script with dry-run support
✓ Migrated 120 documents in database (removed deprecated field)
✓ Post-migration: 0 documents with 'public' field, 127 with 'visibility'
✓ Zero data loss - all documents already had visibility set correctly

CODE CHANGES:

1. Database Migration (scripts/migrate-public-to-visibility.js):
   - Created safe migration with dry-run mode
   - Handles documents with both fields (cleanup)
   - Post-migration verification built-in
   - Execution: node scripts/migrate-public-to-visibility.js --execute

2. Document Model (src/models/Document.model.js):
   - Removed 'public' field from create() method
   - Updated findByQuadrant() to use visibility: 'public'
   - Updated findByAudience() to use visibility: 'public'
   - Updated search() to use visibility: 'public'

3. API Controller (src/controllers/documents.controller.js):
   - Removed legacy filter: { public: true, visibility: { $exists: false } }
   - listDocuments() now uses clean filter: visibility: 'public'
   - searchDocuments() now uses clean filter: visibility: 'public'

4. Scripts Updated:
   - upload-document.js: Removed public: true
   - seed-architectural-safeguards-document.js: Removed public: true
   - import-5-archives.js: Removed public: true
   - verify-34-documents.js: Updated query filter to use visibility
   - query-all-documents.js: Updated query filter to use visibility

VERIFICATION:
✓ 0 remaining 'public: true/false' usages in src/ and scripts/
✓ All documents use visibility field exclusively
✓ API queries now filter on visibility only
✓ Backward compatibility code removed

DATA MODEL:
Before: { public: true, visibility: 'public' } (redundant)
After:  { visibility: 'public' } (single source of truth)

BENEFITS:
- Cleaner data model
- Single source of truth for visibility
- Simplified API logic
- Removed backward compatibility overhead
- Consistent with document security model

FRAMEWORK COMPLIANCE:
Addresses SCHEDULED_TASKS.md item "Legacy public Field Migration"
Completes Sprint 2 Medium Priority task

NEXT STEPS (Optional):
- Deploy migration to production
- Monitor for any edge cases
- Consider adding visibility to database indexes

🤖 Generated with Claude Code (https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-19 13:49:21 +13:00
TheFlow
9d8fe404df chore: update dependencies and documentation 
Update project dependencies, documentation, and supporting files:
- i18n improvements for multilingual support
- Admin dashboard enhancements
- Documentation updates for Koha/Stripe and deployment
- Server middleware and model updates
- Package dependency updates

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-19 12:48:37 +13:00
TheFlow
79a280a403 feat(security): implement document publish workflow with safe defaults 
SECURITY IMPROVEMENTS:
- Change default visibility from 'public' to 'internal' (prevents accidental exposure)
- Add visibility validation (public/internal/confidential/archived)
- Require valid category for public documents
- Add workflow_status tracking (draft/review/published)

PUBLISH WORKFLOW:
- New Document.publish(id, options) method with comprehensive validation
- New Document.unpublish(id, reason) method with audit trail
- New Document.listByWorkflowStatus(status) for workflow management

API ENDPOINTS (Admin only):
- POST /api/documents/:id/publish - Explicit publish with category validation
- POST /api/documents/:id/unpublish - Revert to internal with reason
- GET /api/documents/drafts - List unpublished documents

WORLD-CLASS UX:
- Clear validation messages with actionable guidance
- Lists available categories in error messages
- Tracks publish/unpublish history for audit trail

BACKWARD COMPATIBLE:
- Existing public documents unaffected
- Migration scripts automatically use safer defaults

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-19 12:34:51 +13:00
TheFlow
f042fa67b5 feat(koha): implement Stripe Customer Portal integration 
- Add createPortalSession endpoint to koha.controller.js
- Add POST /api/koha/portal route with rate limiting
- Add 'Manage Your Subscription' section to koha.html
- Implement handleManageSubscription() in koha-donation.js
- Add Koha link to navigation menu in navbar.js
- Allow donors to self-manage subscriptions via Stripe portal
- Portal supports: payment method updates, cancellation, invoice history

Ref: Customer Portal setup docs in docs/STRIPE_CUSTOMER_PORTAL_NEXT_STEPS.md

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-18 22:19:08 +13:00
TheFlow
44a91e7fcf feat: add case submission portal admin interface and i18n support 
Case Submission Portal (Admin Moderation Queue):
- Add statistics endpoint (GET /api/cases/submissions/stats)
- Enhance filtering: status, failure_mode, AI relevance score
- Add sorting options: date, relevance, completeness
- Create admin moderation interface (case-moderation.html)
- Implement CSP-compliant admin UI (no inline event handlers)
- Deploy moderation actions: approve, reject, request-info
- Fix API parameter mapping for different action types

Internationalization (i18n):
- Implement lightweight i18n system (i18n-simple.js, ~5KB)
- Add language selector component with flag emojis
- Create German and French translations for homepage
- Document Te Reo Māori translation requirements
- Add i18n attributes to homepage
- Integrate language selector into navbar

Bug Fixes:
- Fix search button modal display on docs.html (remove conflicting flex class)

Page Enhancements:
- Add dedicated JS modules for researcher, leader, koha pages
- Improve page-specific functionality and interactions

Documentation:
- Add I18N_IMPLEMENTATION_SUMMARY.md (implementation guide)
- Add TE_REO_MAORI_TRANSLATION_REQUIREMENTS.md (cultural sensitivity guide)

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-16 14:50:47 +13:00
TheFlow
ddc78329f0 fix: correct auth middleware imports in hooks metrics route 
Changed authMiddleware/roleMiddleware to authenticateToken/requireAdmin
to match actual exports from auth.middleware.js
 2025-10-15 21:03:32 +13:00
TheFlow
f56703c46d feat: enhance hooks with metrics tracking and admin dashboard 
Implements comprehensive monitoring and fixes hook execution issues.

Hook Validator Enhancements:
- Fixed stdin JSON input reading (was using argv, now reads from stdin)
- Changed exit codes from 1 to 2 for proper blocking (Claude Code spec)
- Added metrics logging to all validators (Edit and Write hooks)
- Metrics track: executions, blocks, success rates, timestamps

Admin Dashboard:
- Created /admin/hooks-dashboard.html - Real-time metrics visualization
- Shows: total executions, blocks, block rates, hook breakdown
- Displays recent blocked operations and activity feed
- Auto-refreshes every 30 seconds

API Integration:
- Created /api/admin/hooks/metrics endpoint
- Serves metrics.json to admin dashboard
- Protected by admin authentication middleware

Metrics Storage:
- Created .claude/metrics/hooks-metrics.json
- Tracks last 1000 executions, 500 blocks
- Session stats: total hooks, blocks, last updated
- Proven working: 11 hook executions logged during implementation

Bug Fix:
- Resolved "non-blocking status code 1" issue
- Hooks now properly receive tool parameters via stdin JSON
- Exit code 2 properly blocks operations per Claude Code spec

Impact:
- Framework enforcement is now observable and measurable
- Admin can monitor hook effectiveness in real-time
- Validates architectural enforcement approach

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-15 20:17:11 +13:00
TheFlow
231e8464d9 feat: complete file security testing with production-ready malware detection 
Implemented and tested comprehensive file upload security pipeline with automatic quarantine system. Added ClamAV fallback for development environments and resolved cross-filesystem quarantine issues. All tests passed including EICAR malware detection.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-14 18:03:56 +13:00
TheFlow
7387cb9807 security: implement file upload security with ClamAV integration (inst_041) 
Phase 1: File Security Complete
✅ Created file-security.middleware.js with multi-layer validation
✅ Installed multer for file uploads
✅ Created quarantine directories on production and dev
✅ Integrated ClamAV malware scanning

Features:
- Magic number validation (prevents MIME spoofing)
- ClamAV malware scanning (8.7M signatures)
- Automatic file quarantine with metadata
- Size limits: 10MB documents, 50MB media
- MIME type whitelist enforcement
- Comprehensive security event logging

Middleware provides:
- createSecureUpload() - Full pipeline (multer + security)
- createFileSecurityMiddleware() - Validation only
- Quarantine system with JSON metadata

Implements: inst_041 (file upload validation)
Refs: docs/plans/security-implementation-roadmap.md Phase 2-P2-2

ClamAV Status:
- Version: 1.4.3
- Signatures: 8,724,466
- Daemon: Running (521MB RAM)
- Test: EICAR detection confirmed
 2025-10-14 15:58:48 +13:00
TheFlow
2856c5ef65 fix: CSRF cookie secure flag for reverse proxy environments 
Check X-Forwarded-Proto header to determine if request is HTTPS
This ensures CSRF cookies work correctly when nginx terminates SSL
 2025-10-14 15:37:49 +13:00
TheFlow
059dd43b72 security: complete Phase 0 Quick Wins implementation 
Phase 0 Complete (QW-1 through QW-8):
✅ Enhanced input validation with HTML sanitization
✅ Form rate limiting (5 req/min on all submission endpoints)
✅ Modern CSRF protection (SameSite cookies + double-submit pattern)
✅ Security audit logging (CSRF violations captured)
✅ Applied to all public form endpoints:
   - /api/cases/submit (case studies)
   - /api/media/inquiries (media inquiries)
   - /api/newsletter/subscribe (newsletter)

New Middleware:
- csrf-protection.middleware.js (replaces deprecated csurf package)
- Enhanced input-validation.middleware.js applied to all forms

Security Features Active:
- Security headers (CSP, HSTS, X-Frame-Options, etc.)
- Rate limiting (100 req/15min public, 5 req/min forms)
- CSRF protection (double-submit cookie pattern)
- HTML sanitization (XSS prevention)
- Response sanitization (hide stack traces)
- Security event logging

Implements: inst_041, inst_042, inst_043, inst_044, inst_045, inst_046
Refs: docs/plans/security-implementation-roadmap.md Phase 0
 2025-10-14 15:32:54 +13:00
TheFlow
b078eec634 security: implement Quick Wins security middleware (inst_041-046) 
- Add security headers middleware (CSP, HSTS, X-Frame-Options, etc.)
- Add rate limiting (100 req/15min public, 5 req/min forms)
- Add input validation and sanitization middleware
- Add response sanitization (hide stack traces, remove sensitive fields)
- Add centralized security event logging to audit trail
- Disable CSRF (deprecated package, will implement modern solution in Phase 3)
- Update security logger to use HOME-based log path

Implements: inst_041, inst_042, inst_043, inst_044, inst_045, inst_046
Refs: docs/plans/security-implementation-roadmap.md
 2025-10-14 15:18:49 +13:00
TheFlow
d5af9a1a6b security: implement quick wins (80/20 approach) + full 6-phase tracker 
**Quick Wins Implemented (Phase 0):**
Ready-to-deploy security middleware for immediate protection:

1. **Security Headers Middleware** (inst_044)
   - CSP, HSTS, X-Frame-Options, X-Content-Type-Options, X-XSS-Protection
   - Prevents XSS, clickjacking, MIME sniffing
   - File: src/middleware/security-headers.middleware.js

2. **Rate Limiting** (inst_045 - basic version)
   - Public endpoints: 100 req/15min per IP
   - Form endpoints: 5 req/min per IP
   - Auth endpoints: 10 attempts/5min
   - In-memory (no Redis required yet)
   - File: src/middleware/rate-limit.middleware.js

3. **Input Validation** (inst_043 - basic version)
   - HTML sanitization (removes tags, event handlers)
   - Length limits enforcement
   - Email/URL format validation
   - Security logging for sanitized input
   - File: src/middleware/input-validation.middleware.js

4. **Response Sanitization** (inst_013, inst_045)
   - Hides stack traces in production
   - Removes sensitive fields from responses
   - Generic error messages prevent info disclosure
   - File: src/middleware/response-sanitization.middleware.js

5. **Security Logging** (inst_046 - basic version)
   - JSON audit trail: /var/log/tractatus/security-audit.log
   - Logs rate limits, validation failures, sanitization
   - File: src/utils/security-logger.js

**Implementation Time:** 1-2 hours (vs 8-14 weeks for full implementation)
**Value:** HIGH - Immediate protection against common attacks
**Performance Impact:** <10ms per request

**6-Phase Project Tracker:**
Created comprehensive project tracker with checkboxes for all phases:
- Phase 0: Quick Wins (8 tasks) - 🟡 In Progress
- Phase 1: Foundation (9 tasks) - ⚪ Not Started
- Phase 2: File & Email (11 tasks) - ⚪ Not Started
- Phase 3: App Security (7 tasks) - ⚪ Not Started
- Phase 4: API Protection (9 tasks) - ⚪ Not Started
- Phase 5: Monitoring (12 tasks) - ⚪ Not Started
- Phase 6: Integration (10 tasks) - ⚪ Not Started

File: docs/plans/security-implementation-tracker.md (1,400+ lines)
- Detailed task breakdowns with effort estimates
- Completion criteria per phase
- Progress tracking (0/66 tasks complete)
- Risk register
- Maintenance schedule
- Decisions log

**Quick Wins Implementation Guide:**
Step-by-step deployment guide with:
- Prerequisites (npm packages, log directories)
- Complete server.js integration code
- Client-side CSRF token handling
- Testing procedures for each security measure
- Production deployment checklist
- Troubleshooting guide
- Performance impact analysis

File: docs/plans/QUICK_WINS_IMPLEMENTATION.md (350+ lines)

**Next Steps:**
1. Install npm packages: express-rate-limit, validator, csurf, cookie-parser
2. Create log directory: /var/log/tractatus/
3. Integrate middleware into src/server.js (see guide)
4. Update client-side forms for CSRF tokens
5. Test locally, deploy to production
6. Proceed to Phase 1 when ready for full implementation

**Value Delivered:**
80% of security benefit with 20% of effort (Pareto principle)
- Immediate protection without waiting for full 8-14 week implementation
- Foundation for phases 1-6 when ready
- Production-ready code with minimal configuration

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-14 14:58:42 +13:00
TheFlow
29fa3956f9 feat: newsletter modal and deployment script enhancements 
**Newsletter Modal Implementation**:
- Added modal subscription forms to blog pages
- Improved UX with dedicated modal instead of anchor links
- Location: public/blog.html, public/blog-post.html

**Blog JavaScript Enhancements**:
- Enhanced blog.js and blog-post.js with modal handling
- Newsletter form submission logic
- Location: public/js/blog.js, public/js/blog-post.js

**Deployment Script Improvements**:
- Added pre-deployment checks (server running, version parameters)
- Enhanced visual feedback with status indicators (✓/✗/⚠)
- Version parameter staleness detection
- Location: scripts/deploy-full-project-SAFE.sh

**Demo Page Cleanup**:
- Minor refinements to demo pages
- Location: public/demos/*.html

**Routes Enhancement**:
- Newsletter route additions
- Location: src/routes/index.js

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-14 13:11:46 +13:00
TheFlow
f724d34f78 fix: update CSP to allow cdnjs.cloudflare.com resources 
## Critical Bug Fix
All CDN resources (marked.js, highlight.js) were blocked by CSP causing:
- FAQ markdown rendering failures
- No syntax highlighting for code blocks
- Plain text display instead of formatted HTML

## Changes Made

### Backend (src/server.js)
Updated helmet CSP configuration to allow cdnjs.cloudflare.com:
- scriptSrc: added https://cdnjs.cloudflare.com
- styleSrc: added https://cdnjs.cloudflare.com
- connectSrc: added https://cdnjs.cloudflare.com (was missing)
- fontSrc: added https://cdnjs.cloudflare.com

### Frontend (nginx production config)
Fixed nginx add_header inheritance issue:
- Duplicated security headers in HTML location block
- Nginx quirk: add_header in location block overrides parent headers
- Both server block AND location block now have full CSP

### Root Cause
Two-part issue:
1. CSP didn't include cdnjs.cloudflare.com (blocking external resources)
2. Nginx HTML location block used add_header, overriding parent security headers

## Testing
Verified with curl:
- Local: CSP headers include cdnjs.cloudflare.com ✅
- Production: CSP headers include cdnjs.cloudflare.com ✅

## Version
- Bumped to 1.0.6
- Force update enabled

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-14 13:01:11 +13:00
TheFlow
f19154c9e6 feat: add version control system and PWA support 
Implements cache busting and progressive web app features:

**Version Management:**
- version.json manifest with changelog tracking
- Service worker with automatic update checking (hourly)
- Update notification UI with changelog display
- Configurable forced updates after timeout
- Cache control headers for optimal performance

**PWA Features:**
- manifest.json with app shortcuts
- Apple touch icon support
- "Add to Home Screen" functionality
- Offline support via service worker

**Cache Strategy:**
- HTML: 5-minute cache with revalidation
- CSS/JS: 1-year immutable cache
- Images: 1-year immutable cache
- version.json/service-worker.js: no-cache

**Integration:**
- All main pages updated with PWA meta tags
- Version manager loaded on all user-facing pages
- Production deployment successful

Users who previously visited the site will now automatically receive
update notifications when version changes.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-14 10:53:29 +13:00
TheFlow
37687c7fe7 feat: fix pressure monitor for conversation length and compaction tracking 
CRITICAL FIXES for session management:

1. **Increased conversation length weight** (0.25→0.40)
   - Conversation decay is PRIMARY cause of compacting events
   - Each compaction: 1-3min disruption + critical context loss
   - Message count now MORE important than token count

2. **Reduced other weights** for proper balance:
   - Token usage: 0.35→0.30 (still important, but secondary)
   - Error frequency: 0.15→0.10
   - Instruction density: 0.10→0.05
   - Total still equals 1.0

3. **Added compaction multipliers**:
   - 1st compaction: 1.5x pressure boost
   - 2nd compaction: 3.0x pressure (CRITICAL)
   - 3rd+ compaction: 5.0x pressure (DANGEROUS)

4. **Reduced conversation thresholds**:
   - Critical: 100→40 messages (compacting observed at ~60)
   - Danger: 150→60 messages

5. **Updated script**: Added --compactions parameter

Example: 70 messages + 2 compactions = 100% conversation pressure
(70/40 * 3.0x = 5.25, capped at 1.0) → HIGH overall (58.3%)

Resolves: Frequent compacting events not properly reflected in pressure

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-12 22:51:30 +13:00
TheFlow
dcb778726b docs: fix Introduction language violations and add database utility scripts 
- Remove absolute claims from Introduction ("guarantees" -> "constraints")
- Align with TRA-VAL-0001 "Honest Limitations" principle
- Add compare-databases.js for dev/prod sync verification
- Add check-sections.js to audit card presentation status
- Add fix-category-mismatches.js for category corrections
- Fix Document.model.js metadata update handling

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-12 22:41:04 +13:00
TheFlow
a7ce65ca30 feat(server): integrate value pluralism services into governance system 
- Initialize PluralisticDeliberationOrchestrator (6th core service)
- Initialize AdaptiveCommunicationOrchestrator (support service)
- Add to governance services list for clean startup
- Server reports "6 core services" operational

All governance services now initialized on startup

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-12 16:35:52 +13:00
TheFlow
4ac0b867e7 fix(models): remove duplicate schema indexes for clean startup 
- GovernanceRule: Remove duplicate category index (uses compound index)
- VerificationLog: Remove duplicate verifiedAt index (uses compound + TTL)
- VariableValue: Remove duplicate category index (standalone index exists)

Eliminates 3 Mongoose duplicate index warnings on server startup
Server now starts with zero warnings

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-12 16:35:45 +13:00
TheFlow
3e2d2784d2 feat(services): add 6th core service - value pluralism deliberation 
- Implement PluralisticDeliberationOrchestrator (433 lines)
  - 6 moral frameworks: deontological, consequentialist, virtue, care, communitarian, indigenous
  - 4 urgency tiers: critical, urgent, important, routine
  - Foundational pluralism without value hierarchy
  - Precedent tracking (informative, not binding)

- Implement AdaptiveCommunicationOrchestrator (346 lines)
  - 5 communication styles: formal, casual (pub test), Māori protocol, Japanese formal, plain
  - Anti-patronizing filter (removes "simply", "obviously", "clearly")
  - Cultural context adaptation

- Both services use singleton pattern with statistics tracking
- Implements TRA-OPS-0002: AI facilitates, humans decide
- Supports inst_029-inst_035 (value pluralism governance)

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-12 16:35:15 +13:00
TheFlow
ebcd600b30 feat: comprehensive accessibility improvements (WCAG 2.1 AA) 
Achieved 81% error reduction (31 → 6 errors) across 9 pages through systematic
accessibility audit and remediation.

Key improvements:
- Add aria-labels to navigation close buttons (all pages)
- Fix footer text contrast: gray-600 → gray-300 (7 pages)
- Fix button contrast: amber-600 → amber-700, green-600 → green-700
- Fix docs modal empty h2 heading issue
- Fix leader page color contrast (bulk replacement)
- Update audit script: advocate.html → leader.html

Results:
- 7 of 9 pages now fully WCAG 2.1 AA compliant
- Remaining 6 errors likely tool false positives
- All critical accessibility issues resolved

Files modified:
- public/js/components/navbar.js (mobile menu accessibility)
- public/js/components/document-cards.js (modal heading fix)
- public/*.html (footer contrast, button colors)
- public/leader.html (comprehensive color updates)
- scripts/audit-accessibility.js (page list update)

Documentation: docs/accessibility-improvements-2025-10.md

🤖 Generated with Claude Code

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-12 07:08:40 +13:00
TheFlow
3208bae7b0 feat: implement Priority 4 backend - Media Triage AI Service 
Add AI-powered media inquiry triage with Tractatus governance:
- MediaTriage.service.js: Comprehensive AI analysis service
  - Urgency classification (high/medium/low) with reasoning
  - Topic sensitivity detection
  - BoundaryEnforcer checks for values-sensitive topics
  - Talking points generation
  - Draft response generation (always requires human approval)
  - Triage statistics for transparency

- Enhanced media.controller.js:
  - triageInquiry(): Run AI triage on specific inquiry
  - getTriageStats(): Public transparency endpoint
  - Full governance logging for audit trail

- Updated media.routes.js:
  - POST /api/media/inquiries/:id/triage (admin only)
  - GET /api/media/triage-stats (public transparency)

GOVERNANCE PRINCIPLES DEMONSTRATED:
- AI analyzes and suggests, humans decide
- 100% human review required before any response
- All AI reasoning transparent and visible
- BoundaryEnforcer escalates values-sensitive topics
- No auto-responses without human approval

Reference: docs/FEATURE_RICH_UI_IMPLEMENTATION_PLAN.md lines 123-164
Priority: 4 of 10 (10-12 hours estimated, backend complete)
Status: Backend complete, frontend UI pending

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-11 18:10:57 +13:00
TheFlow
a15b285bb1 feat: implement Priority 3 - Enhanced search with faceted filtering 
Add comprehensive search functionality to docs.html with:
- Faceted filters (quadrant, persistence, audience)
- Real-time search with 300ms debounce
- Search history with localStorage (last 10 searches)
- Keyboard navigation (Ctrl+K, arrows, Enter, Esc)
- Search tips modal with usage guide
- Result highlighting with query term emphasis
- Performance optimized (<500ms response time)

Backend enhancements:
- Enhanced /api/documents/search endpoint with filter support
- Combined text search + metadata filtering
- Returns pagination and filter state

Frontend additions:
- Search UI in docs.html (search bar, 3 filter dropdowns)
- docs-search-enhanced.js module with all functionality
- Search results panel with document cards
- Search tips modal with keyboard shortcuts

CSP Compliance:
- No inline event handlers or scripts
- All event listeners attached via external JS
- Pre-action check validated all files

Reference: docs/FEATURE_RICH_UI_IMPLEMENTATION_PLAN.md lines 123-156
Priority: 3 of 10 (8-10 hour estimated, completed)

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-11 18:06:15 +13:00
TheFlow
c96ad31046 feat: implement Rule Manager and Project Manager admin systems 
Major Features:
- Multi-project governance with Rule Manager web UI
- Project Manager for organizing governance across projects
- Variable substitution system (${VAR_NAME} in rules)
- Claude.md analyzer for instruction extraction
- Rule quality scoring and optimization

Admin UI Components:
- /admin/rule-manager.html - Full-featured rule management interface
- /admin/project-manager.html - Multi-project administration
- /admin/claude-md-migrator.html - Import rules from Claude.md files
- Dashboard enhancements for governance analytics

Backend Implementation:
- Controllers: projects, rules, variables
- Models: Project, VariableValue, enhanced GovernanceRule
- Routes: /api/projects, /api/rules with full CRUD
- Services: ClaudeMdAnalyzer, RuleOptimizer, VariableSubstitution
- Utilities: mongoose helpers

Documentation:
- User guides for Rule Manager and Projects
- Complete API documentation (PROJECTS_API, RULES_API)
- Phase 3 planning and architecture diagrams
- Test results and error analysis
- Coding best practices summary

Testing & Scripts:
- Integration tests for projects API
- Unit tests for variable substitution
- Database migration scripts
- Seed data generation
- Test token generator

Key Capabilities:
✅ UNIVERSAL scope rules apply across all projects
✅ PROJECT_SPECIFIC rules override for individual projects
✅ Variable substitution per-project (e.g., ${DB_PORT} → 27017)
✅ Real-time validation and quality scoring
✅ Advanced filtering and search
✅ Import from existing Claude.md files

Technical Details:
- MongoDB-backed governance persistence
- RESTful API with Express
- JWT authentication for admin endpoints
- CSP-compliant frontend (no inline handlers)
- Responsive Tailwind UI

This implements Phase 3 architecture as documented in planning docs.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-11 17:16:51 +13:00
TheFlow
2fc6e0a593 feat: implement documentation reorganization with archives 
Documentation Reorganization (Option A - Full):
- Reduced public docs from 47 to 11 (76% reduction)
- 31 documents archived (project tracking, outdated)
- 5 documents marked confidential (security, payments)
- Clear 3-tier structure: Getting Started, Framework Details, Case Studies

Archives Infrastructure:
- Added visibility: 'archived' | 'public' | 'confidential' | 'internal'
- Added category: 'conceptual' | 'practical' | 'reference' | 'archived' | 'project-tracking'
- Added order field for explicit document ordering (1-11 for public)
- Added archiveNote field for explaining why documents were archived
- New endpoint: GET /api/documents/archived
- New controller method: listArchivedDocuments()
- UI: Archives section (collapsed by default) at bottom of docs list

Public Documentation (11 documents, well-organized):
  1. Architectural Overview (reference)
  2. Core Concepts (conceptual) - needs Phase 5 update
  3. Implementation Guide (practical) - needs MongoDB rewrite
  4. Core Values & Principles (conceptual)
  5. Case Studies (practical)
  6. Business Case Template (practical)
  7. Glossary (reference) - needs Phase 5 terms
  8-11. Recent Case Studies (practical)

Model Updates:
- src/models/Document.model.js: Added visibility, category, order, archiveNote fields
- src/models/Document.model.js: Added listArchived() static method
- Default sort by order (1-999) instead of date

Controller Updates:
- src/controllers/documents.controller.js: Added listArchivedDocuments()
- Filter excludes archived docs from main list by default

Route Updates:
- src/routes/documents.routes.js: Added GET /api/documents/archived

UI Updates:
- public/js/docs-app.js: New category structure (Getting Started, Framework Details, Reference)
- public/js/docs-app.js: Fetches and displays archived documents in collapsed section
- public/js/docs-app.js: Archives show document count badge
- public/js/docs-app.js: Archive notes displayed below archived document links
- Auto-loads Architectural Overview (order: 1) on page load

Scripts Created:
- scripts/archive-outdated-documents.js: Archive 10 outdated documents
- scripts/update-document-metadata.js: Set order/category for 7 core docs
- scripts/archive-all-internal-documents.js: Mass archive 23 internal docs

Documentation:
- docs/DOCUMENT_AUDIT_2025-10-11.md: Comprehensive audit of all 47 documents
- docs/DOCUMENT_REORGANIZATION_SUMMARY.md: Executive summary with before/after

Next Steps (Phase 2 - Content Updates):
- Update Core Concepts for Phase 5 MongoDB architecture
- Rewrite Implementation Guide for MongoDB deployment
- Update Glossary with Phase 5 terms (MongoDB, MemoryProxy, API Memory)

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-11 01:26:14 +13:00
TheFlow
c417f5b7d6 feat: enhance framework services and format architectural documentation 
Framework Service Enhancements:
- ContextPressureMonitor: Enhanced statistics tracking and contextual adjustments
- InstructionPersistenceClassifier: Improved context integration and consistency
- MetacognitiveVerifier: Extended verification capabilities and logging
- All services: 182 unit tests passing

Admin Interface Improvements:
- Blog curation: Enhanced content management and validation
- Audit analytics: Improved analytics dashboard and reporting
- Dashboard: Updated metrics and visualizations

Documentation:
- Architectural overview: Improved markdown formatting for readability
- Added blank lines between sections for better structure
- Fixed table formatting for version history

All tests passing: Framework stable for deployment

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-11 00:50:47 +13:00
TheFlow
29f50124b5 fix: MongoDB persistence and inst_016-018 content validation enforcement 
This commit implements critical fixes to stabilize the MongoDB persistence layer
and adds inst_016-018 content validation to BoundaryEnforcer as specified in
instruction history.

## Context
- First session using Anthropic's new API Memory system
- Fixed 3 MongoDB persistence test failures
- Implemented BoundaryEnforcer inst_016-018 trigger logic per user request
- All unit tests now passing (61/61 BoundaryEnforcer, 25/25 BlogCuration)

## Fixes

### 1. CrossReferenceValidator: Port Regex Enhancement
- **File**: src/services/CrossReferenceValidator.service.js:203
- **Issue**: Regex couldn't extract port from "port 27017" (space-delimited format)
- **Fix**: Changed `/port[:=]\s*(\d{4,5})/i` to `/port[:\s=]\s*(\d{4,5})/i`
- **Result**: Now matches "port: X", "port = X", and "port X" formats
- **Tests**: 28/28 CrossReferenceValidator tests passing

### 2. BlogCuration: MongoDB Method Correction
- **File**: src/services/BlogCuration.service.js:187
- **Issue**: Called non-existent `Document.findAll()` method
- **Fix**: Changed to `Document.list({ limit: 20, skip: 0 })`
- **Result**: BlogCuration can now fetch existing documents for topic generation
- **Tests**: 25/25 BlogCuration tests passing

### 3. MemoryProxy: Optional Anthropic API Integration
- **File**: src/services/MemoryProxy.service.js
- **Issue**: Treated Anthropic Memory Tool API as mandatory, causing errors without API key
- **Fix**: Made Anthropic client optional with graceful degradation
- **Architecture**: MongoDB (required) + Anthropic API (optional enhancement)
- **Result**: System functions fully without CLAUDE_API_KEY environment variable

### 4. AuditLog Model: Duplicate Index Fix
- **File**: src/models/AuditLog.model.js:132
- **Issue**: Mongoose warning about duplicate timestamp index
- **Fix**: Removed inline `index: true`, kept TTL index definition at line 149
- **Result**: No more Mongoose duplicate index warnings

### 5. BlogCuration Tests: Mock API Correction
- **File**: tests/unit/BlogCuration.service.test.js
- **Issue**: Tests mocked non-existent `generateBlogTopics()` function
- **Fix**: Updated mocks to use actual `sendMessage()` and `extractJSON()` methods
- **Result**: All 25 BlogCuration tests passing

## New Features

### 6. BoundaryEnforcer: inst_016-018 Content Validation (MAJOR)
- **File**: src/services/BoundaryEnforcer.service.js:508-580
- **Purpose**: Prevent fabricated statistics, absolute guarantees, and unverified claims
- **Implementation**: Added `_checkContentViolations()` private method
- **Enforcement Rules**:
  - **inst_017**: Blocks absolute assurance terms (guarantee, 100% secure, never fails)
  - **inst_016**: Blocks statistics/ROI/$ amounts without sources
  - **inst_018**: Blocks production claims (production-ready, battle-tested) without evidence
- **Mechanism**: All violations classified as VALUES boundary violations (honesty/transparency)
- **Tests**: 22 new comprehensive tests in tests/unit/BoundaryEnforcer.test.js
- **Result**: 61/61 BoundaryEnforcer tests passing

### Regex Pattern for inst_016 (Statistics Detection):
```regex
/\d+(\.\d+)?%|\$[\d,]+|\d+x\s*roi|payback\s*(period)?\s*of\s*\d+|\d+[\s-]*(month|year)s?\s*payback|\d+(\.\d+)?m\s*(saved|savings)/i
```

### Detection Examples:
- ✅ BLOCKS: "This system guarantees 100% security"
- ✅ BLOCKS: "Delivers 1315% ROI without sources"
- ✅ BLOCKS: "Production-ready framework" (without testing_evidence)
- ✅ ALLOWS: "Research shows 85% improvement [source: example.com]"
- ✅ ALLOWS: "Validated framework with testing_evidence provided"

## MongoDB Models (New Files)
- src/models/AuditLog.model.js - Audit log persistence with TTL
- src/models/GovernanceRule.model.js - Governance rules storage
- src/models/SessionState.model.js - Session state tracking
- src/models/VerificationLog.model.js - Verification logs
- src/services/AnthropicMemoryClient.service.js - Optional API integration

## Test Results
- BoundaryEnforcer: 61/61 tests passing (22 new inst_016-018 tests)
- BlogCuration: 25/25 tests passing
- CrossReferenceValidator: 28/28 tests passing

## Framework Compliance
- ✅ Implements inst_016, inst_017, inst_018 enforcement
- ✅ Addresses 2025-10-09 framework failure (fabricated statistics on leader.html)
- ✅ All content generation now subject to honesty/transparency validation
- ✅ Human approval required for statistical claims without sources

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-11 00:17:03 +13:00
TheFlow
fdd2df6fcb feat: Session 3 - Audit analytics dashboard 
Created comprehensive audit analytics dashboard for monitoring governance
decisions from MemoryProxy audit trail.

Features:
- Real-time dashboard with summary metrics
- Decisions by action type (bar chart)
- Timeline visualization (hourly distribution)
- Recent decisions table with filtering
- Apache 2.0 licensed

Components:
- Frontend: /admin/audit-analytics.html
- JavaScript: /js/admin/audit-analytics.js
- Backend API: /api/admin/audit-logs
- Backend API: /api/admin/audit-analytics

Metrics Displayed:
- Total decisions count
- Allowed rate percentage
- Violations count
- Active services count

Visualizations:
- Action type distribution
- Timeline (decisions over time)
- Recent decisions log (last 50)

Session 3 Achievement: Advanced monitoring and insights for governance framework

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-10 13:05:14 +13:00
TheFlow
690ea60a40 feat: Session 2 - Complete framework integration (6/6 services) 
Integrated MetacognitiveVerifier and ContextPressureMonitor with MemoryProxy
to achieve 100% framework integration.

Services Integrated (Session 2):
- MetacognitiveVerifier: Loads 18 governance rules, audits verification decisions
- ContextPressureMonitor: Loads 18 governance rules, audits pressure analysis

Integration Features:
- MemoryProxy initialization for both services
- Comprehensive audit trail for all decisions
- 100% backward compatibility maintained
- Zero breaking changes to existing APIs

Test Results:
- MetacognitiveVerifier: 41/41 tests passing
- ContextPressureMonitor: 46/46 tests passing
- Integration test: All scenarios passing
- Comprehensive suite: 203/203 tests passing (100%)

Milestone: 100% Framework Integration
- BoundaryEnforcer: ✅ (48/48 tests)
- BlogCuration: ✅ (26/26 tests)
- InstructionPersistenceClassifier: ✅ (34/34 tests)
- CrossReferenceValidator: ✅ (28/28 tests)
- MetacognitiveVerifier: ✅ (41/41 tests)
- ContextPressureMonitor: ✅ (46/46 tests)

Performance: ~1-2ms overhead per service (negligible)

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-10 12:49:37 +13:00
TheFlow
341a0c0ac4 feat: Session 1 - Core services integration (InstructionPersistenceClassifier + CrossReferenceValidator) 
Complete MemoryProxy integration with core Tractatus services achieving 67% framework integration.

**Session 1 Summary**:
- 4/6 services now integrated with MemoryProxy (67%)
- InstructionPersistenceClassifier: Reference rule loading + audit trail
- CrossReferenceValidator: Governance rule loading + validation audit
- All 62 unit tests passing (100% backward compatibility)
- Comprehensive integration test suite

**InstructionPersistenceClassifier Integration**:
- Added initialize() to load 18 reference rules from memory
- Enhanced classify() with audit trail logging
- Audit captures: quadrant, persistence, verification level, explicitness
- 34/34 existing tests passing (100%)
- Non-blocking async audit to .memory/audit/

**CrossReferenceValidator Integration**:
- Added initialize() to load 18 governance rules from memory
- Enhanced validate() with validation decision audit
- Audit captures: conflicts, severity levels, validation status
- 28/28 existing tests passing (100%)
- Detailed conflict metadata in audit entries

**Integration Test**:
- Created scripts/test-session1-integration.js
- Validates initialization of both services
- Tests classification with audit trail
- Tests validation with conflict detection
- Verifies audit entries created (JSONL format)

**Test Results**:
- InstructionPersistenceClassifier: 34/34 ✅
- CrossReferenceValidator: 28/28 ✅
- Integration test: All scenarios passing ✅
- Total: 62 tests + integration (100%)

**Performance**:
- Minimal overhead: <2ms per service
- Async audit logging: <1ms (non-blocking)
- Rule loading: 18 rules in 1-2ms
- Backward compatibility: 100%

**Files Modified**:
- src/services/InstructionPersistenceClassifier.service.js (MemoryProxy integration)
- src/services/CrossReferenceValidator.service.js (MemoryProxy integration)
- scripts/test-session1-integration.js (new integration test)
- .memory/audit/decisions-{date}.jsonl (audit entries)

**Integration Progress**:
- Week 3: BoundaryEnforcer + BlogCuration (2/6 = 33%)
- Session 1: + Classifier + Validator (4/6 = 67%)
- Session 2 Target: + Verifier + Monitor (6/6 = 100%)

**Audit Trail Entries**:
Example classification audit:
{
  "action": "instruction_classification",
  "metadata": {
    "quadrant": "STRATEGIC",
    "persistence": "HIGH",
    "verification": "MANDATORY"
  }
}

Example validation audit:
{
  "action": "cross_reference_validation",
  "violations": ["..."],
  "metadata": {
    "validation_status": "REJECTED",
    "conflicts_found": 1,
    "conflict_details": [...]
  }
}

**Next Steps**:
- Session 2: MetacognitiveVerifier + ContextPressureMonitor integration
- Target: 100% framework integration (6/6 services)

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-10 12:39:58 +13:00
TheFlow
c735a4e91f feat: Phase 5 PoC Week 3 - MemoryProxy integration with Tractatus services 
Complete integration of MemoryProxy service with BoundaryEnforcer and BlogCuration.
All services enhanced with persistent rule storage and audit trail logging.

**Week 3 Summary**:
- MemoryProxy integrated with 2 production services
- 100% backward compatibility (99/99 tests passing)
- Comprehensive audit trail (JSONL format)
- Migration script for .claude/ → .memory/ transition

**BoundaryEnforcer Integration**:
- Added initialize() method to load inst_016, inst_017, inst_018
- Enhanced enforce() with async audit logging
- 43/43 existing tests passing
- 5/5 new integration scenarios passing (100% accuracy)
- Non-blocking audit to .memory/audit/decisions-{date}.jsonl

**BlogCuration Integration**:
- Added initialize() method for rule loading
- Enhanced _validateContent() with audit trail
- 26/26 existing tests passing
- Validation logic unchanged (backward compatible)
- Audit logging for all content validation decisions

**Migration Script**:
- Created scripts/migrate-to-memory-proxy.js
- Migrated 18 rules from .claude/instruction-history.json
- Automatic backup creation
- Full verification (18/18 rules + 3/3 critical rules)
- Dry-run mode for safe testing

**Performance**:
- MemoryProxy overhead: ~2ms per service (~5% increase)
- Audit logging: <1ms (async, non-blocking)
- Rule loading: 1ms for 3 rules (cache enabled)
- Total latency impact: negligible

**Files Modified**:
- src/services/BoundaryEnforcer.service.js (MemoryProxy integration)
- src/services/BlogCuration.service.js (MemoryProxy integration)
- tests/poc/memory-tool/week3-boundary-enforcer-integration.js (new)
- scripts/migrate-to-memory-proxy.js (new)
- docs/research/phase-5-week-3-summary.md (new)
- .memory/governance/tractatus-rules-v1.json (migrated rules)

**Test Results**:
- MemoryProxy: 25/25 ✅
- BoundaryEnforcer: 43/43 + 5/5 integration ✅
- BlogCuration: 26/26 ✅
- Total: 99/99 tests passing (100%)

**Next Steps**:
- Optional: Context editing experiments (50+ turn conversations)
- Production deployment with MemoryProxy initialization
- Monitor audit trail for governance insights

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-10 12:22:06 +13:00