Commit Graph

251 Commits

Author SHA1 Message Date
uprightbass360
3ec83b7714 adds fallback for workflow 2025-12-27 18:07:40 -05:00
uprightbass360
b7d55976cd updates setup language 2025-12-27 17:05:10 -05:00
uprightbass360
63b0a4ba5d adds thanks to readme 2025-12-27 17:00:05 -05:00
uprightbass360
9b9d99904a cleans up env generation and dropps disabled flags 2025-12-27 16:46:27 -05:00
uprightbass360
690ee4317c updates modules and module setup 2025-12-27 16:46:27 -05:00
uprightbass360
b8245e7b3f chore: updates modules and module updater 2025-12-27 15:30:59 -05:00
uprightbass360
6ed10dead7 add helps 2025-12-12 18:56:42 -05:00
uprightbass360
9f3038a516 flips qr generation to params 2025-12-12 18:49:17 -05:00
uprightbass360
ea3c2e750c adds pdump and 2fa generation 2025-12-12 18:33:53 -05:00
uprightbass360
63b2ca8151 backup fixes 2025-12-03 22:13:22 -05:00
uprightbass360
4596320856 add log bind mounts 2025-12-02 01:26:14 -05:00
uprightbass360
d11b9f4089 break apart paths for easier management 2025-11-30 23:21:09 -05:00
uprightbass360
82a5104e87 profile updates 2025-11-27 01:06:48 -05:00
uprightbass360
251b5d8f9f update port display for clarity 2025-11-26 15:37:41 -05:00
uprightbass360
5620fbae91 fix size computing for nested container 2025-11-26 15:19:41 -05:00
uprightbass360
319da1a553 remove test config 2025-11-26 15:00:08 -05:00
uprightbass360
681da2767b exclude bots from stats 2025-11-26 01:58:06 -05:00
uprightbass360
d38c7557e0 status info 2025-11-26 01:31:00 -05:00
uprightbass360
df7689f26a cleanup 2025-11-25 22:11:47 -05:00
uprightbass360
b62e33bb03 docs 2025-11-25 17:45:42 -05:00
uprightbass360
44f9beff71 cleanup hard-coded vars 2025-11-25 17:45:17 -05:00
uprightbass360
e1dc98f1e7 deploy updates 2025-11-23 16:42:50 -05:00
uprightbass360
7e9e6e1b4f setup hardening 2025-11-23 16:05:00 -05:00
uprightbass360
3d0e88e9f6 add status info for new containers 2025-11-23 16:04:29 -05:00
uprightbass360
b3019eb603 directory staging 2025-11-23 13:05:08 -05:00
uprightbass360
327774c0df tagging new modules and images 2025-11-22 22:08:07 -05:00
uprightbass360
9742ce3f83 cleanup 2025-11-22 16:59:18 -05:00
uprightbass360
6ddfe9b2c7 cleanup: validation and integrations for importing data 2025-11-22 16:56:02 -05:00
uprightbass360
e6231bb4a4 feat: comprehensive module system and database management improvements
This commit introduces major enhancements to the module installation system,
database management, and configuration handling for AzerothCore deployments.

## Module System Improvements

### Module SQL Staging & Installation
- Refactor module SQL staging to properly handle AzerothCore's sql/ directory structure
- Fix SQL staging path to use correct AzerothCore format (sql/custom/db_*/*)
- Implement conditional module database importing based on enabled modules
- Add support for both cpp-modules and lua-scripts module types
- Handle rsync exit code 23 (permission warnings) gracefully during deployment

### Module Manifest & Automation
- Add automated module manifest generation via GitHub Actions workflow
- Implement Python-based module manifest updater with comprehensive validation
- Add module dependency tracking and SQL file discovery
- Support for blocked modules and module metadata management

## Database Management Enhancements

### Database Import System
- Add db-guard container for continuous database health monitoring and verification
- Implement conditional database import that skips when databases are current
- Add backup restoration and SQL staging coordination
- Support for Playerbots database (4th database) in all import operations
- Add comprehensive database health checking and status reporting

### Database Configuration
- Implement 10 new dbimport.conf settings from environment variables:
  - Database.Reconnect.Seconds/Attempts for connection reliability
  - Updates.AllowedModules for module auto-update control
  - Updates.Redundancy for data integrity checks
  - Worker/Synch thread settings for all three core databases
- Auto-apply dbimport.conf settings via auto-post-install.sh
- Add environment variable injection for db-import and db-guard containers

### Backup & Recovery
- Fix backup scheduler to prevent immediate execution on container startup
- Add backup status monitoring script with detailed reporting
- Implement backup import/export utilities
- Add database verification scripts for SQL update tracking

## User Import Directory

- Add new import/ directory for user-provided database files and configurations
- Support for custom SQL files, configuration overrides, and example templates
- Automatic import of user-provided databases and configs during initialization
- Documentation and examples for custom database imports

## Configuration & Environment

- Eliminate CLIENT_DATA_VERSION warning by adding default value syntax
- Improve CLIENT_DATA_VERSION documentation in .env.template
- Add comprehensive database import settings to .env and .env.template
- Update setup.sh to handle new configuration variables with proper defaults

## Monitoring & Debugging

- Add status dashboard with Go-based terminal UI (statusdash.go)
- Implement JSON status output (statusjson.sh) for programmatic access
- Add comprehensive database health check script
- Add repair-storage-permissions.sh utility for permission issues

## Testing & Documentation

- Add Phase 1 integration test suite for module installation verification
- Add comprehensive documentation for:
  - Database management (DATABASE_MANAGEMENT.md)
  - Module SQL analysis (AZEROTHCORE_MODULE_SQL_ANALYSIS.md)
  - Implementation mapping (IMPLEMENTATION_MAP.md)
  - SQL staging comparison and path coverage
  - Module assets and DBC file requirements
- Update SCRIPTS.md, ADVANCED.md, and troubleshooting documentation
- Update references from database-import/ to import/ directory

## Breaking Changes

- Renamed database-import/ directory to import/ for clarity
- Module SQL files now staged to AzerothCore-compatible paths
- db-guard container now required for proper database lifecycle management

## Bug Fixes

- Fix module SQL staging directory structure for AzerothCore compatibility
- Handle rsync exit code 23 gracefully during deployments
- Prevent backup from running immediately on container startup
- Correct SQL staging paths for proper module installation
2025-11-22 16:56:02 -05:00
uprightbass360
0d83f01995 add helpful messaging for disabled mods 2025-11-14 21:31:02 -05:00
uprightbass360
5774694b71 add tags and changelog info 2025-11-14 20:55:33 -05:00
uprightbass360
1948b0b3d4 Add comprehensive backup statistics and configurable intervals
• Enhanced backup-scheduler.sh with detailed performance metrics:
  - Per-database timing and compression statistics
  - Overall backup throughput and duration tracking
  - Performance warnings for slow backups (>30min/>1hr)
  - Completion markers to prevent incomplete backup copies

• Added BACKUP_INTERVAL_MINUTES configuration (default 60):
  - Replaces fixed hourly scheduling with flexible intervals
  - Supports any interval from 1 minute to hours
  - Maintains daily backup scheduling at configured time

• New verify-backup-complete.sh script:
  - Checks backup completion before copying/processing
  - Supports waiting with timeout for active backups
  - Backward compatible with manifest validation

• Enhanced backup manifests with performance data:
  - Duration, compression ratio, throughput metrics
  - Enables historical performance trend analysis
  - Portable implementation using awk instead of bc

Tested with 5-minute intervals over 18+ hours:
- 218 successful backups, 0 failures
- Consistent 82.1% compression, 52MB/s throughput
- Production-ready backup monitoring infrastructure
2025-11-13 17:18:54 -05:00
uprightbass360
c30d5f2a63 add npc info 2025-11-10 17:37:18 -05:00
uprightbass360
28b7af1b3b makes import less redundant 2025-11-10 17:25:49 -05:00
uprightbass360
e521f8bf10 make worldserver wait for clientdata 2025-11-10 03:18:44 -05:00
uprightbass360
66667c1e85 backup imports 2025-11-10 03:00:11 -05:00
uprightbass360
68dc21d5ef import enhancements and npc spawn sketches 2025-11-10 01:59:47 -05:00
uprightbass360
fbf6b23f56 adds weekend changelog 2025-11-09 16:47:46 -05:00
uprightbass360
bc8bfdbeec add manual backup to ac-backup container 2025-11-09 15:46:51 -05:00
uprightbass360
7000f35972 fix: backup permissions 2025-11-09 15:03:17 -05:00
uprightbass360
78215687b4 fix: readme wording 2025-11-09 14:59:59 -05:00
uprightbass360
4bf781b82f make backup run as container user 2025-11-09 05:49:51 -05:00
uprightbass360
2079ef4b9a move temp files on remote to home dir 2025-11-09 05:39:27 -05:00
uprightbass360
90c53c47d9 bind network and remote cleanup 2025-11-09 05:15:58 -05:00
uprightbass360
964359e32b feat: add remote auto deploy option 2025-11-09 04:49:04 -05:00
uprightbass360
11ea55d44f add default client-data 2025-11-09 03:55:30 -05:00
uprightbass360
a53cf80d35 fix: repair script paths after reorg 2025-11-09 03:41:44 -05:00
uprightbass360
9eabe316db adds import folder 2025-11-09 03:04:13 -05:00
uprightbass360
6f91685319 docs: clarify ImportBackup usage 2025-11-09 02:58:32 -05:00
uprightbass360
acf2364294 docs: reflect new script directory layout 2025-11-09 02:49:48 -05:00