NLP Performance in Clinical Notes: Addressing Data Limitations and System Overfitting

There were insufficient instances in the notes of the emotional support subcategories to evaluate the NLP systems.

Table of Links

Abstract and 1. Introduction

2 Data

2.1 Data Sources

2.2 SS and SI Categories

3 Methods

3.1 Lexicon Creation and Expansion

3.2 Annotations

3.3 System Description

4 Results

4.1 Demographics and 4.2 System Performance

5 Discussion

5.1 Limitations

6 Conclusion, Reproducibility, Funding, Acknowledgments, Author Contributions, and References

SUPPLEMENTARY

Guidelines for Annotating Social Support and Social Isolation in Clinical Notes

Other Supervised Models

5.1 Limitations

Several limitations should be noted. There were insufficient instances in the notes of the emotional support subcategories to evaluate the NLP systems. Emotional support (and lack thereof) is an important and distinct fine-grained category that would ideally be identified in the notes. Second, the ...