An international study of interobserver variability of string sign of pancreatic cysts among experienced endosonographers

Background and Objectives: No single optimal test reliably determines the pancreatic cyst subtype. Following EUS-FNA, the string sign test can differentiate mucinous from nonmucinous cysts. However, the interobserver variability of string sign results has not been studied. Methods: An experienced endosonographer performed EUS-FNA of pancreatic cysts on different patients and was recorded on video performing the string sign test for each. The videos were shared internationally with 14 experienced endosonographers, with a survey for each video: Is the string sign positive? and If the string sign is positive, what is the length of the formed string? Also asked What is the cutoff length for string sign to be considered positive? Interobserver variability was assessed using the kappa statistic (kappa). Results: A total of 112 observations were collected from 14 endosonographers. Regarding string sign test positivity, kappa was 0.6 among 14 observers indicating good interrater agreement (P < 0.001) while kappa was 0.38 when observers were compared to the index endosonographer demonstrating marginal agreement (P < 0.001). Among observations of the length of the string in positive samples, 89.8% showed >5 mm of variability (P < 0.001), indicating marked variability. There was poor agreement on the cutoff length for a string to be considered positive. Conclusion: String sign of pancreatic cysts has a good interobserver agreement regarding its positivity that can help in differentiating mucinous from nonmucinous pancreatic cysts. However, the agreement is poor on the measured length of the string and the cutoff length of the formed string to be considered a positive string sign.

Automated summary

The string sign test shows good interobserver agreement in distinguishing mucinous from nonmucinous pancreatic cysts among 14 observers. However, there is significant variability among observers in the length of the string and the cutoff length for a positive string sign.