Bell Labs

Semantic Divergence between Emails to an IT Help Desk and Resultant Tickets

Rock R. Farmer-Tailor

In a study of randomly selected 100 solved tickets resulting from email interactions with the Global Help Desk the correspondence between emails and initial ticket descriptions was found to not be significantly better than random assignment of tickets to emails. A semantically rich ontology was developed in OWL 2 to cover all the computer-related concepts in the tickets and emails. Some aspects of this ontology, such as email delivery success rate, had to be adjusted to take local conditions into account. The semantic concepts in this ontology present in each email, in each initial ticket description, and in each ticket solution were determined. The semantic distance and direction from the (possibly multiple) emails from the requestor to both the initial ticket description and the ticket solution was determined using a semantic metric between sets of semantic concepts that took into account both specificity and difference and the correspondence between these two vectors was measured for each ticket. The measured correspondences were not significantly better than random assignment between requesting emails and tickets, but were significantly worse than many methods of matching tickets with requesting emails, including picking the highest number of common word stems between the initial email from the requestor and the intial ticket description. Attempts to introduce either of these or related better-performing methods in practice were forcibly rebuffed.

GHD Email Process


  1. Email sent to ghd@alcatel-lucent.com
  2. Email read by GHD first responder
  3. First responder tries to solve problem
    • May interact with requestor
  4. First responder creates ticket
    • Ticket description created by first responder
  5. Secondary responder views ticket and tries to solve problem
  6. Secondary responder anonymously enters solution into ticket system
  7. Requestor notified that problem is solved

Study Process

  1. Collect all tickets resulting from email message
  2. Randomly select 100 of these
  3. Construct OWL 2 ontology covering concepts in emails and tickets
  4. Determine ontology mapping of emails, initial ticket descriptions, and solutions
  5. Measure ontology semantic vector distance
    • ... from requestor emails to initial ticket descriptions
    • ... from requestor emails to ticket solution
  6. Determine portion of distance from requestor emails to ticket solution is covered by distance from requestor emails to initial ticket description
    • If email and solution have the same concepts, then distance is artificially set to 1
    • Best result is +1
    • Negative results are very bad

Study Results

Ontology of IT Concepts in OWL 2

SURPRESSED, now intellectual property of HP

Ontology Semantic Distance

Detailed Results

SURPRESSED, now intellectual property of HP

Questions?