Custodian Assistant Tool

The Vendor is required to provide for the provision of a custodian assistant tool designed to review, associate and extract relevant information from the agency standardization documents database source to support standards development and review processes for the office.
- Develop and refine Custodians Assistant tool, focusing on accessibility, usability, finetuning existing functionalities, and expanding its features. Add advanced features such as other Gen AI functionalities, metadata-based search, user customization, and performance optimization to deliver a mature, secure and innovative tool ready for sustained use in standards development and review processes.
- Optimization
• Focus on optimizing the Large Language Models (LLM) within the tool to maximize accuracy and performance, as well as refining the existing features to address user feedback and meet the requirements. Additionally, chatbot’s ability to retrieve content based on metadata should be enhanced.
- Provide support to users during the duration of the contract and warranty period, including but not limited to troubleshooting, user training etc. Maintain clear communication with stakeholders and organize meetings to address remaining concerns and document user feedback.
- Ensure the stability and reliability of the software product with performance monitoring measures (e.g., confusion matrix) implemented to address any lingering inconsistencies or bugs. Complete the software structure to ensure long-term usability and compatibility with other environments.
- The software must be protected against any types of cyber-attacks. It must follow good practices followed by comprehensive testing against vulnerabilities.
- The provider, guided by user feedback, in coordination with the office and project stakeholders, shall:
• Organize stakeholder meetings to address any feedback.
• Pilot a GenAI drafting feature to create specific and small paragraphs.
• Integrate GenAI interface as PowerApp within the SharePoint Page, ensuring the chatbot retrieves exact keyword matches for more relevant results.
• Enhance chatbot’s ability to retrieve information based on expanded offline-fed documents repository and metadata from the agency (title, status, sponsor…).
• Introduce chatbot temperature to allow users to control response creativity.
• Monitor performance by providing a precision over recall matrix and make adjustments to ensure long-term tool readiness
• Test authentication integration with office IDP and ensure EntraID compatibility.
• Adapt solution’s architecture to approved models to facilitate future security approval.
• Provide full technical documentation to support handover and security checks.
• Produce a list of envisioned incompatibilities for the future solution migration (Azure to AWS) and propose mitigations for a seamless transition.
• Optional: allow users to suggest verified public data sources.
- Web application
• Microsoft Edge,
• Google Chrome,
• Mozilla Firefox,
• Apple Safari.
- The VPN client will check the presence of the following:
• Antimalware must be installed and updated.
• Operating system must be updated with the latest patches.
• Operating system firewall must be installed and enabled.
• Disk must be encrypted.