Metawerx Java Hosting Small Logo

Metawerx Cloud Roadmap

This is our customer-focussed project list and current status, in priority-order (lowest to highest).

Recently completed items are marked with a tick (in order of date completed).

Follow @metawerx on Twitter to keep up to date on our progress!

Metawerx Roadmap Complete
Instant Provisioning
- PayPal PDT and IPN integration (done)
- Work out strategy for instant provisioning of databases (done)
- Work out strategy for instant provisioning of new JVMs (done)
- VM control panel in SiteWinder allowing customers to add/delete/pause/resume JVMs (65%)
- VM control panel in SiteWinder allowing customers to add/delete databases (50%)
- Show all JVMs owned by customer in SiteWinder and allow File Browser, JVM restart and other standard features (done)
- Facility for instance-templates to auto-configure new instances on startup, including use-template, copy-instance or plain (fresh) options (80%)
76% Complete
Instant Scalability
- VM control panel in SiteWinder allowing customers to modify JVM specifications (80%)
- On-demand disk-space provisioning (30%)
- On-demand changes to traffic provisioning (done)
- On-demand changes to JDK and Tomcat versions (done)
- CPU auto-scaling system (done)
- RAM auto-scaling system (done)
- Add more servers, more RAM for currently foreseeable scalability requirements (done)
- Automate new-server configuration to allow fast addition of new servers (done)
83% Complete
AES-Encrypted Offsite Backup Encryption
- This task focuses on isolation between offsite backup servers and primary servers. Neither system should trust the other. Additionally, the backup system should accommodate a breach without putting user data at risk.
- Complete and review internal research paper: Information retrieval from a breach of an offsite-backup server
- Complete and review internal research paper: Offsite-backup erasure via a breach of a primary server
- Use Advanced Encryption Standard (AES) as recommended by FIPS and NSA
- Encryption for MySQL 4.x, 5.x backups
- Encryption for MariaDB 5.x backups
- Encryption for MongoDB 2.x backups
- Encryption for CouchDB 1.x backups
- Encryption for PostGreSQL 8.x, 9.x backups
- Encryption for SQL/Server 2005 backups
- Encryption for Subversion backups
- Encryption for all dedicated database instance backups
- Encryption for Cloud-Filesystem backups
- Encryption for Cloud-Master backups
- Ensure offsite backup servers only have read-only access to Metawerx servers, in case of breach of offsite backup server
- Ensure offsite backup-areas cannot be accessed by Metawerx servers, in case of breach of primary servers
- Ensure there is no offsite backup of security keys used for backup-encryption and encryption-key storage follows all Metawerx protocols
Live Tail System
- View logs in real-time in your browser
- Support WebSockets 1.0
- Support older browsers
- Support tablets
Mobile/Tablet version of Customer Control Panel
- Support Android, Apple, BlackBerry/RIM, Symbian, Windows Phone and Amazon Kindles
- Secure Server-Side KeyRing PIN authentication system
- Restart Tomcat/JBoss/Glassfish
- Restart Individual Apps
- Check Financial History, Balance, Pay Invoice
- Browse Files with Upload, Rename, Replace, Delete, View, Download
- Browse backups, Diff backups, Restore files/folders
- View and Tail Logs
- View Charts
- View Traffic Reports
- Mail Server Administration
- Domain Administration
Add CouchDB Support
- 14 days of rolling backups
- Encrypted offsite backup
- Block level replication to failover server
- Database failover implementation
- Security investigation and lockdown
- AppArmor security profile
- Monitoring, including monitoring on failover device
- Remote access to Couch and Futon via SSH Tunnel
SiteWinder Single-SignOn System
- Eliminate server-list on login screen
- Single login point allows access to the primary server for the account
- Automatic authentication to subsystems on separate servers using a central Auth server and SecureRandom/HMAC token system
Add MongoDB Support
- 14 days of rolling backups
- Encrypted offsite backup
- Block level replication to failover server
- Database failover implementation
- Security investigation and lockdown
- AppArmor security profile
- Monitoring, including monitoring on failover device
- Remote access support via SSH Tunnel
Dynamic JVM Cloud (BeanCloud) with Multi-Server Failover and Heuristic Load Distribution
- Any time a JVM is started or restarted, multiple servers contribute to a vote, describing their CPU, I/O and RAM load to determine the best server to run the specified JVM
- Based on the vote, the JVM is started on the most appropriate server
- In the case of complete hardware failure of a Java server, all JVMs from that server immediately enter the startup JVM pool and will be started on the most appropriate server
- User-Designed Page or Default Maintenance Page is displayed during the restart/migration of the JVM using Metawerx EpicFailover
- Multiple cloud-controllers patrol the cluster and initiate automatic repair, identify anomolies and alert support
- StandAlone mode is initiated if all cloud-controllers fail, enabling standalone servers to restart failed JVMs independently
Redundant Remote-DB Gateway Servers
- A critical component for companies using our Remote Database Service / Persistent DB Connections
- In the case of complete hardware failure of an SSH gateway server for remote database access, another server immediately and transparently takes over incoming SSH connections
Online Backup History / Online Restore
- Users can access their last 14 days of nightly filesystem backup history directly in SiteWinder file-view
- Easy-to-use "Restore" feature for deleted files and folders
- Option to rename existing file/folder with a ".old" extension when restoring
- "Restore-As" feature to restore an old version using a new name
- Deleted files and folders are shown in SiteWinder crossed-out, allowing the same features as active files/folders (list revisions, restore, restore-as)
- Deleted folders can be browsed directly, for restoration of individual files or subfolders contained in the deleted folder
- View file/folder changes since specific backups
Online Text Editor
- Browser-based Text-Editor using a modified version of SourceForge CodeMirror
- Make emergency changes to JSP/JS/CSS/HTML etc...
- Edit server.xml or web.xml online, skip the download/edit/upload process, then simply restart their app or JVM
- Save-As feature
- Unified Diff-Preview and Keep-Editing / Discard-Changes mode
- Editor controls for SmartIndent, TabIndent, TabSize, Theme, BracketMatch, WordWrap, Preview and SmartIndent
- Preferences are saved in cookies
- MouseOver help
- Auto FileType detection and mode-selection
- Undo/Redo, Code Folding, Syntax Highlighting
- UTF8 international file support
- AutoIgnore DOS/Unix CRLF differences
Dual STONITH Power Controllers
- STONITH means "Shoot The Other Node In The Head"
- Automatically detects complete server failure (eg: network card error, system lockup)
- Reboot-status monitoring / automatic recovery check and alerting system
- Metawerx Power Control initiates full power-cycles of failed servers using Dell remote-access hardware
- Dual STONITH servers, so if one goes down it can be auto-rebooted too, providing automated reboot-control over the entire Metawerx network and our new HA-Cluster
- Dell remote-access hardware based storage level failure detection
- Advanced sanity check system ensures that monitoring failures don't create false-positives, which could otherwise result in a cluster-wide cascade failure
AppArmor Implementation
- AppArmor provides an extra layer of sandboxing around binaries
- Using AppArmor around all JVMs and databases, we have a redundant security layer over our existing Linux/Java layers
- Custom AppArmor profiles for Metawerx Mail
- Custom AppArmor profiles for Metawerx Mail Admin
- Custom AppArmor profiles for SiteWinder
- Custom AppArmor profiles for Customer JVMs
- Custom AppArmor profiles for DNS servers
- Custom AppArmor profiles for MySQL and MariaDB
- Custom AppArmor profiles for PostGreSQL
- Custom AppArmor profiles for MongoDB
- Custom AppArmor profiles for CouchDB
- Custom AppArmor profiles for Apache (non-Java control panels)
- Custom AppArmor profiles for Subversion
- Custom AppArmor profiles for FTP
Redundant POP3/IMAP Mail Mirrors
- Redundant Mail servers for High Availability
- In the case of complete hardware failure of any primary mail server, another server must transparently take control of POP3/IMAP requests within 20 seconds
- Automatic 2-way failover
- Manual failover/failback capability
- Support POP3, IMAP, Mail Administrator
- STONITH system: Initiate a hard-reset of failed servers using Metawerx Power Control
Redundant Database Mirrors - MySQL/MariaDB/PostGreSQL
- Redundant Database servers for High Availability
- In the case of complete hardware failure of any primary DB server, another server must transparently take control of database requests within 20 seconds
- Automatic 2-way failover
- Manual failover/failback capability
- Support all instances of MySQL, MariaDB, PostGreSQL, MongoDB, CouchDB
- STONITH system: Initiate a hard-reset of failed servers using Metawerx Power Control
Redundant FTP Access
- Redundant FTP servers for High Availability
- In the case of complete hardware failure of any primary FTP server, another server transparently takes control of FTP requests within 20 seconds
- Fully automated 2-way failover within 20s
- Manual failover/failback capability
- Separation of FTP server from cloud storage devices
- STONITH system: Initiate a hard-reset of failed servers using Metawerx Power Control
Monitoring Improvements for Cloud Infrastructure
- Automated creation/distribution of ERAI monitoring scripts
- Cloud filesystem infrastructure monitoring
- Parallel service restart to increase migration and restart performance when multiple JVMs are being relocated or restarted at the same time
- Parallel alert-sender to avoid mail sends or mailserver outage delaying the monitoring loop
- Parallel monitoring threads for command-based checks
- Scan for offline processes separately to probe-tests to improve downed-process detection performance from ~30s to around ~90ms
- FastResume checks to determine whether Tomcat is ready without waiting for timeout or using continual TCP/IP probes
- Auto-detect process failure-to-start using separate timer, faster than waiting for normal full-timeout
- Auto-detect when queued services already restarted manually by admin
- Detect OutOfMemory exceptions, report them by email, restart the JVM
- Detect High-CPU conditions and report the thread and if possible the lines of JSP code
Tomcat JVM Dashboard Meters
- Various metrics are available to customers so they can monitor their usage in real-time within SiteWinder
- RealTime CPU Meter
- RealTime Traffic Meter
- RealTime Disk I/O Meter
- RealTime RAM Meters (Total,Perm,Heap,CC)
- RealTime Request/Response Time Meters
- RealTime Session Active/CreatedPerMin Meters
- RealTime GC time
- RealTime HotSpot Compilation time
- RealTime Stateful Firewall / Threat prevention monitor
- RealTime HTTP Throttling monitor
- 1 hour per minute, 300 mins per 5 minutes, 900 mins per 15 minutes, 2.5 days per hour, 10 days per 4-hour, 20 days per 8-hour, 2 months per day switch-panel
- Zoom mode to see 300+ periods
- Asynchronous load and cache per chart with Ajax-loader image
- Fully supports Tomcat 6, Tomcat 7, Tomcat 8
- Support Tomcat 5.5 and JBoss 6.0 via custom additions
- Available within customer control panel
Service/System Status Page
- All services should be reported on a public status page so customers can see the status of services important to them on demand
- One-line global summary to see issues instantly without scrolling down the page
- Display one-line global summary on SiteWinder login page if there are any alerts
Cloud Storage Migration - Linux
- All customer data is kept on two separate disk-arrays devices to provide zero-data-loss in case of complete hardware failure of an array
- Automatic array-level 2-way failover
- Manual failover/failback capability
Tomcat DIGEST support
- All Tomcat JVMs to be switched over to HTTP-DIGEST support to prevent the submission of plain-text passwords when using the Tomcat Manager application
FTPES Upgrade
- FTP systems must support TLS
- All users must be encouraged to use FTPES and stop using plain FTP
Mail Security Upgrade
- All incoming and outgoing mail to support TLS encryption
- Implement separate SSL ports and also STARTTLS for POP3/IMAP/SMTP
- All mail users must be encouraged to use SSL services for email
- Use salted passwords, multiple iterations
Failover/Maintenance Page
- If a site is being restarted or is offline, users of that site should be redirected to a Temporary Maintenance Page or Failover JVM
- Each customer should be able to fully customise their Maintenance Page to fit with their site design and branding
Customer Tools Upgrade to 100% SSL
- All Metawerx tools including SiteWinder, webmail and administration subsystems must use SSL
- FTP must use SSL, with a valid certificate
- IMAP, POP3 and SMTP must use SSL, with a valid certificate
Reliable 99.95% Uptime Guarantee
Helping to keep the net safe

 
Home | Java Hosting | News | Wiki | Privacy Policy | Login | Contact | Apply Now
(c) Metawerx 1997-2018 - All rights reserved