Online Testing Software Solution

The Vendor is required to provide online testing software solution for include:
- System maintenance
•    Software maintenance services: this includes routine checks and repairs to ensure the system functions smoothly and supports the city's business operations effectively.
•    Software change management services: the supplier must manage and implement changes in a controlled manner, ensuring that new features and functions are incorporated consistently with the evolution of the commercially available service.
•    Planned downtime work: in cases where service downtime is necessary to perform work, the supplier must execute this efficiently to minimize impact on the city's operations.
- Software maintenance services
1. Evergreening and patch management services 
•    The supplier must implement any commercially available software updates and upgrades to ensure the proposed software and associated hardware continually evolves to address identified defects, new security and privacy risks, improved user experiences and enhanced functionalities;
2. Preventative maintenance 
•    The supplier must proactively implement changes to address negative trends or foreseen events before they detrimentally impact the user experience, system operations or security.
3. Adaptive maintenance 
•    The supplier must continually plan, monitor, and adapt the system to maintain system performance and capacities based on past and forecasted usage including but not limited to:
o    Security risks - the supplier must continually monitor and adapt the system to address new or changing security risks; and
o    Privacy risks - the supplier must continually monitor and adapt the system to address new or changing privacy risks. 
4. Perfective maintenance 
•    The supplier must continually optimize performance of the applications, with particular focus on areas including general performance tuning (e.g. to improve application response time), search performance, application, and database performance tuning (e.g. Storage space, query refinement), etc.
- Software change management 
•    Sufficient notification of any changes, including a change description and impacts to the proposed software and associated hardware, such that the city can develop and implement its own change management activities as necessary;
•    Provide release notes to the city identifying the changes;
•    Provide updates to the city for any and all user and administrative documentation related to the change that may impact the city usage of the proposed software;
•    Provide updates to the city for training materials related to the change;
•    Support for any security assessment processes and audits, deemed necessary by the city prior to the change being implemented; and
•    Periodically (at least once a year) provide the city with technology roadmaps identifying significant upcoming changes and enhancements that it anticipates deploying to the proposed software. 
•    This will allow the city to assess those changes in advance so that any security and change management concerns can be identified well in advance of the change being deployed.