| Author(s) | Modi N, Ashby D, Battersby C, Brocklehurst P, Chivers Z, Costeloe K, Draper ES, Foster V, Kemp J, Majeed A, Murray J, Petrou S, Rogers K, Santhakumaran S, Saxena S, Statnikov Y, Wong H, Young A. |
| Abstract | Background: Clinical data offer the potential to advance patient care. Neonatal specialised care is a high-cost NHS service received by approximately 80,000 newborn infants each year.
Objectives: (1) To develop the use of routinely recorded operational clinical data from electronic patient records (EPRs), secure national coverage, evaluate and improve the quality of clinical data, and develop their use as a national resource to improve neonatal health care and outcomes. To test the hypotheses that (2) clinical and research data are of comparable quality, (3) routine NHS clinical assessment at the age of 2 years reliably identifies children with neurodevelopmental impairment and (4) trial-based economic evaluations of neonatal interventions can be reliably conducted using clinical data. (5) To test methods to link NHS data sets and (6) to evaluate parent views of personal data in research.
Design: Six inter-related workstreams; quarterly extractions of predefined data from neonatal EPRs; and approvals from the National Research Ethics Service, Health Research Authority Confidentiality Advisory Group, Caldicott Guardians and lead neonatal clinicians of participating NHS trusts.
Setting: NHS neonatal units.
Participants: Neonatal clinical teams; parents of babies admitted to NHS neonatal units.
Interventions: In workstream 3, we employed the Bayley-III scales to evaluate neurodevelopmental status and the Quantitative Checklist of Autism in Toddlers (Q-CHAT) to evaluate social communication skills. In workstream 6, we recruited parents with previous experience of a child in neonatal care to assist in the design of a questionnaire directed at the parents of infants admitted to neonatal units.
Data sources: Data were extracted from the EPR of admissions to NHS neonatal units.
Main outcome measures: We created a National Neonatal Research Database (NNRD) containing a defined extract from real-time, point-of-care, clinician-entered EPRs from all NHS neonatal units in England, Wales and Scotland (n = 200), established a UK Neonatal Collaborative of all NHS trusts providing neonatal specialised care, and created a new NHS information standard: the Neonatal Data Set (ISB 1595) (see http://webarchive.nationalarchives.gov.uk/±/http://www.isb.nhs.uk/documents/isb-1595/amd-32–2012/index_html; accessed 25 June 2018).
Results: We found low discordance between clinical (NNRD) and research data for most important infant and maternal characteristics, and higher prevalence of clinical outcomes. Compared with research assessments, NHS clinical assessment at the age of 2 years has lower sensitivity but higher specificity for identifying children with neurodevelopmental impairment. Completeness and quality are higher for clinical than for administrative NHS data; linkage is feasible and substantially enhances data quality and scope. The majority of hospital resource inputs for economic evaluations of neonatal interventions can be extracted reliably from the NNRD. In general, there is strong parent support for sharing routine clinical data for research purposes.
Limitations: We were only able to include data from all English neonatal units from 2012 onwards and conduct only limited cross validation of NNRD data directly against data in paper case notes. We were unable to conduct qualitative analyses of parent perspectives. We were also only able to assess the utility of trial-based economic evaluations of neonatal interventions using a single trial. We suggest that results should be validated against other trials.
Conclusions: We show that it is possible to obtain research-standard data from neonatal EPRs, and achieve complete population coverage, but we highlight the importance of implementing systematic examination of NHS data quality and completeness and testing methods to improve these measures. Currently available EPR data do not enable ascertainment of neurodevelopmental outcomes reliably in very preterm infants. Measures to maintain high quality and completeness of clinical and administrative data are important health service goals. As parent support for sharing clinical data for research is underpinned by strong altruistic motivation, improving wider public understanding of benefits may enhance informed decision-making.
Future work: We aim to implement a new paradigm for newborn health care in which continuous incremental improvement is achieved efficiently and cost-effectively by close integration of evidence generation with clinical care through the use of high-quality EPR data. In future work, we aim to automate completeness and quality checks and make recording processes more ‘user friendly’ and constructed in ways that minimise the likelihood of missing or erroneous entries. The development of criteria that provide assurance that data conform to prespecified completeness and quality criteria would be an important development. The benefits of EPR data might be extended by testing their use in large pragmatic clinical trials. It would also be of value to develop methods to quality assure EPR data including involving parents, and link the NNRD to other health, social care and educational data sets to facilitate the acquisition of lifelong outcomes across multiple domains. |