Skip to main content

Best Practice: Manage Content Quality with AQI (MT4)

Written by Damien Howley
Former Customer Success Expert at MindTouch
This page applies to:MindTouch 4

To truly create a knowledge environment that drives customer success, you have to deliver high quality content. Creating and ensuring quality can be very challenging, and typically this challenge is amplified by adding more contributors. Fortunately, the Knowledge Centered Services (KCS) team has developed a methodology for defining and measuring quality content.  

This article provides examples and practical instructions for leveraging the KCS quality methodology with your MindTouch knowledge. Be sure to take a look at the full KCS AQI methodology page and consult our friends at the KCS for additional direction and services. 

How do I create a basic quality standard for my MindTouch knowledge?

Some MindTouch customers employ complex quality standards that require very specific authoring practices. While your measure of quality may evolve to a complex level over time, it's good to start out simple. Here are some basic metrics to measure the quality of your MindTouch knowledge.

  1. Duplicate Articles - Duplicate articles can fragment your knowledge and compromise your customer success experience.  Additionally, duplicate knowledge can leave your authors and content creators vulnerable to incorrect or obsolete knowledge.  Lastly, duplicate content requires double the amount of time to maintain, which can place a large strain on your knowledge creators and knowledge managers. 
    • How? While assessing the quality of an individual article, use the MindTouch Search to look for similar or related articles.  If you find duplicates, make sure you verify and consolidate the knowledge.  
  2. Title Clarity - A poorly written title can eliminate both the value and adoption of an excellent article. It is important to create a title that is accurate and properly sets expectations. The example below show a before and after title that was improved to meet the quality criteria. 
    • Before:  MindTouch and KCS
    • After:  Applying KCS Methodologies to your MindTouch Knowledge
  3. Content Clarity - A simple way to measure the quality of you knowledge is to assess whether or not the content is cohesive.  Your knowledge articles should flow smoothly and not be just a collection of individual sentences.  
    • How?  First, make sure that the H1's in the article contextually align with the page title. Second, make sure that the H1's in the article are ordered in a way that is logical such as Why, What, How or Problem, Cause, Resolution. Lastly, make sure that the content under each header (H1, H2, etc.) strongly addresses the concept in the header with supporting media.
  4. Navigation - You cannot achieve the full potential of your knowledge experience thorough one individual article. The full potential is achieved through a collection of well-crafted knowledge that is contextually interlinked to facilitate learning and discovery. Your readers must have a way to go beyond the individual article. If you successfully enable learning and discovery, your users will advance their expertise and self-help. To measure the navigation quality of an article, make sure that you articles are accurately and thoroughly hyperlinked to related content. Also, make sure that your articles are accurately tagged with approximately 3 to 5 tags. 
    • How?  Add tags and classifications to your MindTouch articles. Tags are used to contextually generate the related articles, and classifications are used for customer and agent search. 
    • How?  Add hyperlinks throughout your articles to contextually related content.  Don't add hyperlinks simply to add hyperlinks; make sure they lead to value material that is contextually relevant and will deliver value to your customers. 

How do I track the overall quality of our MindTouch knowledge?

Once you have instituted a basic quality standard, you can then begin to measure the overall quality of your knowledge. You do not need to measure the quality of all of your content for the analysis to yield value. A sample can provide adequate information that ultimately leads to higher quality content.  

Step 1 - Get a list of articles to review

You can access a list of MindTouch articles in numerous ways.  

  • You can use you the Page Classification Manager to populate a list of articles by classifications and tags.  
  • You could also use your Site History to analyze articles that were recently worked on and which author worked on them. Site History is accessible from the Dashboard under Reporting.
  • Lastly, you could use Google Analytics to get all sorts of different content lists to analyze. 

Keep in mind that different lists will inherently have different filters or orders that may sway your sample results.  You may want to further randomize the list of articles that you go through to get wider coverage.

Step 2 - Score each article

Once you have created a list of articles to review, go through each article and provide a pass or fail for each of the quality measurements. For instance, if you find a very similar article to the article you are analyzing, then the article would fail the duplicate article criteria. Another example, if the article had no tags and no hyperlinks, then the article would fail the navigation criteria

Article Author Duplicate Article Title Clarity Content Clarity Navigation
Save Content as PDF John Doe icon_x.png icon_x.png icon_check.png icon_check.png
Double-Line Spacing Joe Doe icon_check.png icon_x.png icon_check.png icon_x.png

Tip: To make it easier to aggregate the data, you can simply put a 1 for fail and leave blank for pass. 
Important: Record your analysis in a spreadsheet with the URL of the article so you can review and fix issues later on.

Step 3 - Aggregate the results

The diagram (produced by the Consortium of Service Innovation) showcases an analysis of 141 articles that were written by 5 authors.  You can see that each author is given an Article Quality Index (AQI) for the sample of articles that were reviewed.  

This example includes 6 quality metrics that can pass or fail.  The total possible points is simply the number of articles reviewed multiplied by the number of quality metrics (6).   


Source:  Scoring the Article Quality Index from the Consortium for Service Innovation

Step 4 - Share with your authors

It is absolutely crucial that you share both the measurements and results of the analysis with your authors. You should reinforce the measurements through process and training. You should keep a regular interval for reviewing the measurements and the results of the analysis.

What additional measures can we include in our Article Quality Index?

Once you have successfully analyzed and improved your knowledge according to a basic quality standard, you can consider more complex quality metrics. Of course, each company's quality standards will vary based on industry, audience, material, etc.  

The only basic rule for adding to your quality criteria is to make sure that criteria is measurable and can clearly pass or fail.  For instance, adding "The article must be wonderful" to the criteria is not going to get valuable results. On the other hand, adding "The article must include an Overview header" will yield measurable results.  

Beyond the basic quality standard, you can consider adding the following measurements to your quality criteria:

  1. Density - Does the article contain enough material to sufficiently address the topic?
  2. Completeness - Does the article address all aspects of the topic?
  3. Terminology - Does the article utilize standardized company terminology?
  4. Overkill - Is the article too wordy and granular?
  5. Inappropriate - Is the article appropriate for the audience?
  6. Incorrect - Is the article wrong or obsolete?

How do I use AQI to help authors improve?

Analyzing the quality of your content is not just a one-time initiative. Your content will evolve, and you should analyze a sample of content with regularity. Analyzing your content on a monthly or quarterly basis will also provide you with data to determine the quality of your authors.  

The table below is an example of how you might record author quality scores throughout the year to determine if your authors are progressing.

Author Q1 Q2 Q3 Q4
John Doe  86% 91%  92%  94%  
Joe Doe  56% 62%  54%  52%  

 It is important to share quality scores with authors to provide an opportunity for improvement. You can even establish employee goals and objectives according to their average AQI score.  

How do I incorporate customer feedback into my Knowledge creation process?

The most powerful and useful knowledge feedback comes from your end-users. Whether it's from your customer, partners, sales reps, or support agents, it is crucial to act on your customer feedback. At MindTouch, we use a Knowledge Queue to ensure that all feedback (both internal and external) is queued and acted upon.  

How do I implement a Knowledge Queue?

A Knowledge Queue is very simple to implement. You can configure your feedback email (Control Panel > Configuration > Email Address for User Feedback) to point to a group email address or to a ticket management system such as SalesForce, Zendesk, or YouTrack. Typically, ticket management systems will provide an email address for ticket creation.  

  1. Configure your MindTouch Email Address for User Feedback to
  2. Set up your ticketing system so that any emails sent to are added to a queue.  
  3. Require your authors to review the queue daily or weekly and take ownership of the feedback.
  4. Use your ticketing system to report on KQ MTTR (mean time to resolution), KQ activity, completion ratios, author activity, and more. 
Driving Customer Success

Customer feedback not only provides you with a means to help your authors improve, but also provides you with a wonderful opportunity to engage and impress your customers. If you are properly incorporating feedback into your knowledge creation process, you will have tangible results to show.  

While the customer may appreciate that you implemented their feedback, a simple and genuine interaction to show that you value their input can be the difference between "support" and "customer success."