DOD CDAO Open Call for Large Language Model Maturity Model Ideas

The CDAO is seeking ideas related to the development of a Large Language Model Maturity Model (LLM MM) that could be used to assess the appropriateness of LLM solutions for given mission use cases and workflows.  Selected LLM MM ideas will be the centerpiece of the LLM track at the upcoming Advantage DoD 2024 Symposium and will support community discussion aimed at improving LLM performance and suitability. The model should consider LLM capability in the context of classes of use cases, such as summarization, analysis, conversation, etc., and relate to LLM performance characteristics, such as accuracy, completeness, traceability, etc.  The model should specify acceptability criteria for use of LLMs at different levels of capability for different use cases.

🔊 Listen to Story