Comprehensive Item Banking Software Solution

The Vendor is required to provide a comprehensive item banking software solution.
- The desired system will provide a secure, centralized, and scalable platform for the creation, review, storage, organization, and management of employment examination content used in agency hiring and promotional testing processes.
- The solution is intended to support the full lifecycle of examination development activities, including collaborative item development, workflow management, test assembly, version control, reporting, and related administrative functions.
- The system should offer a high degree of operational efficiency, support standardized examination development practices, enhance collaboration among authorized users, and provide flexibility to accommodate the evolving needs of the agency.
- Requires a commercially available, cloud-hosted solution that incorporates robust security controls and role-based access functionality to protect confidential examination materials and sensitive data.
- Provide implementation services, system configuration, user training, ongoing technical support, software maintenance, and related professional services necessary to ensure successful deployment and continued operation of the product.
- Objectives:
• Provide a secure, centralized repository for test items, support collaborative item development including the ability for multiple stakeholders—such as subject matter experts, psychometricians, and editors—to contribute to item creation, provide feedback, track revisions, and formally approve items through configurable workflow stages.
• Facilitate efficient test development and form generation by allowing users to easily search, filter, and assemble items based on metadata such as content area, difficulty level, cognitive domain, and statistical performance, including the application of constraints and blueprint requirements, to ensure that generated forms meet content and psychometric specifications.
• Should integrate with or include tools for item analysis, calibration, and performance tracking to maintain psychometric integrity. This includes maintaining item statistics (e.g., difficulty, discrimination indices) and supporting pre-testing and equating processes.
• Ensure compliance with relevant accessibility standards (such as Web Content Accessibility Guidelines, “WCAG”) and security requirements including accessible item formats (e.g., screen reader compatibility, alternative text for images), secure data encryption (both at rest and in transit), and adherence to industry best practices and regulatory requirements for data protection.
- The item bank should provide a comprehensive, user-friendly authoring environment that supports the creation and editing of a wide range of item types, including but not limited to multiple-choice, multiple select, true/false, matching, short answer, essay/constructed response, and technology-enhanced or multimedia-based items (e.g., drag-and-drop, hotspot, simulation-based items).
- The platform should be flexible enough to accommodate both traditional and innovative assessment formats to meet evolving testing needs.
- The authoring interface should include a robust rich text editor that allows users to format content (e.g., fonts, tables, equations, symbols) and embed multimedia elements such as images, audio, and video. It should also support specialized content, such as mathematical notation (e.g., LaTeX or equation editors) and accessibility features like alt text for images, captions for audio/video, and compatibility with screen readers.
- The system should allow item authors to define all necessary components of an item, including stems, answer choices, correct responses, scoring rubrics (for constructed responses), rationales, and feedback. For selected items, the platform should support features such as randomization of answer choices and the inclusion of distractor rationales.
- The item bank should enable comprehensive tagging and metadata management. Users should be able to assign and manage tags such as content domain, subdomain, difficulty level, cognitive complexity (e.g., Bloom’s taxonomy levels), competencies/skills assessed, language, and item status (e.g., draft, under review, approved).
- The system should allow for customizable metadata fields to align with specific program needs and support advanced search and filtering capabilities based on these attributes.
- The solution should also include version control and editing history, allowing users to track changes, compare versions, and revert to prior iterations if necessary. Inline commenting and annotation features should support collaboration among item writers, reviewers, and psychometricians during the editing process.
- The item authoring and editing functionality should streamline the development of high-quality, accessible, and psychometrically sound assessment items while promoting efficiency, consistency, and collaboration.
- The system should incorporate robust role-based access controls, enabling administrators to assign permissions based on user roles such as item writers, reviewers, editors, psychometricians, and administrators. Each role should have clearly defined capabilities (e.g., create, edit, comment, approve, publish), ensuring that users can only perform actions appropriate to their responsibilities. This structure helps safeguard item security and maintains the integrity of the development process.
- The system should provide advanced search and filtering capabilities that enable users to quickly locate items based on a combination of criteria.
- These may include metadata fields such as content domain, subdomain, difficulty level, cognitive complexity, item type, status, author, date range, usage history, and psychometric performance (e.g., p-value, point-biserial). The search functionality should support keyword search, Boolean logic, saved searches, and dynamic filtering to enhance usability and efficiency.