Good TREs work

Methods Analytics Ltd projects

1625 data files in total were disseminated unsafely (information about files used safely is missing for TRE/"system access" projects).


🚩 Methods Analytics Ltd was sent multiple files from the same dataset, in the same month, both with optouts respected and with optouts ignored. Methods Analytics Ltd may not have compared the two files, but the identifiers are consistent between datasets, and outside of a good TRE NHS Digital can not know what recipients actually do.

Triple Negative Breast Cancer Study — DARS-NIC-744993-Z8K2K

Opt outs honoured: unknown (Excuses: Does not include the flow of confidential data)

Legal basis: Health and Social Care Act 2012 – s261(2)(a)

Purposes: Yes (Supplier)

Sensitive: Non-Sensitive

When:DSA runs 2024-12 – 2025-12 2025.01 — 2025.01. breached contract — audit report.

Access method: System Access
(System access exclusively means data was not disseminated, but was accessed under supervision on NHS Digital's systems)

Data-controller type: METHODS ANALYTICS LTD

Sublicensing allowed: No

Datasets:

  1. NDRS Cancer Consolidated Data Set

Type of data: Anonymised - ICO Code Compliant (note: this information not disclosed for TRE projects )

Objectives:

Method Analytics Ltd requires access to NHS England data for the purpose of the following research project:
Triple Negative Breast Cancer Study

The following is a summary of the aims of the research project provided by Method Analytics Ltd:

Methods Analytics requires access to NHS England data to describe and characterise the “Real World” treatment of TNBC breast cancer (both early and metastatic) in multiple centres in England. In particular, the associations of deprivation status and ethnicity with the following will be investigated:

a. Treatments received:
i. Chemotherapy

1. Timing (Adjuvant / neoadjuvant)

2. Regimens
ii. Use of PARP inhibitors
iii. Surgery
iv. Radiotherapy
v. Referral to cancer genetics (if meets age criteria)

Adjustment will be made for other potentially confounding factors including:

a. Other patient characteristics:
vi. Performance status
vii. Co-morbidities
viii. Body mass Index
ix. Age

b. Tumour Characteristics:
i. Tumour size
ii. Nodal involvement
iii. Grade
iv. Inflammatory breast cancer

This research aims to address critical disparities in TNBC treatment outcomes and access, ensuring the findings contribute valuable insights to the medical community. This study is particularly crucial as ICD-10 classifies breast cancer by site rather than phenotype, making standard analytics approaches using routinely collected data sources insufficient for TNBC. Data Scientists from Methods Analytics will also access the data for the purpose of conducting benchmarking, detecting variation, and facilitating informed comparisons. The processing activities are proportionate to the intended purpose, as national healthcare data is essential for benchmarking, detecting variation, and facilitating informed comparisons to drive improvement initiatives.

The following NHS England Data will be accessed:
> NDRS Cancer Consolidated Data Set - necessary to understand patients’ outcomes and treatments for TNBC.

The level of the Data will be:
> Pseudonymised

The Data will be minimised as follows:
> Limited to patients who have been diagnosed with Breast cancer, ICD-10 codes: C50, D05
> Limited to data between 1st January 2016 to latest available
> Data is required for all of England.

Understanding TNBC in contrast to non-TNBC is an essential part of characterisation of the disease and ensures the study will have significant additional value given the greater insight this will provide. Utilising the wider breast cancer dataset to provide these comparisons will be the most robust approach and minimise issues arising from differing analysis techniques or cohort construction.

Methods Analytics Ltd is the controller as the organisation responsible for ensuring that the Data will only be processed for the purpose described above.

Although Gilead Science Ltd is the research sponsor, Gilead Science Ltd will not carry out any controllership activities.

Gilead Science Ltd has commissioned Methods Analytics to undertake the work. Gilead Science Ltd does not specify what data are required to deliver the work nor how the data shall be processed to achieve that purpose. Such decisions are taken by Methods Analytics.

The lawful basis for processing personal data under the UK GDPR is:
Article 6(1)(f) - processing is necessary for the purposes of the legitimate interests pursued by the controller or by a third party.

Methods Analytics Ltd has determined the processing is necessary for its legitimate interests in providing healthcare data analytics services to help NHS and private sector healthcare providers. Methods Analytics Ltd is a commercial company which provides services for profit.

The lawful basis for processing special category data under the UK GDPR is:

Article 9(2)(j) - processing is necessary for archiving purposes in the public interest, scientific or historical research purposes or statistical purposes in accordance with Article 89(1) based on Union or Member State law which shall be proportionate to the aim pursued, respect the essence of the right to data protection and provide for suitable and specific measures to safeguard the fundamental rights and the interests of the data subject.

This processing is in the public interest because the research is focused on addressing significant gaps in the understanding of Triple Negative Breast Cancer, an area that has historically seen poor patient outcomes and limited research specifically investigating deprivation status, ethnicity and primary language with treatments received and patient outcomes. By conducting this study, Methods Analytics aim to generate valuable insights that will directly contribute to improving treatment strategies and healthcare practices within the NHS. The findings are expected to lead to better patient care, offering hope to those affected by this challenging disease.

The funding is provided by Gilead Science Ltd. The funding is specifically for the study described.

The funder will have no ability to suppress or otherwise limit the publication of findings.

Microsoft Limited provides IT hosting services to Methods Analytics and will store the Data as contracted by Methods Analytics.

A healthcare subject matter expert will be advising on the structure and format of the research paper but will not have access to the NHSE secure data platform.

As part of the scoping and feasibility work, Methods Analytics Ltd worked with medical professionals from Clatterbridge Hospital, University Hospitals Sussex NHS Foundation Trust, Nottingham City Hospital, Royal Free Hospital, Southampton General Hospital, University Hospitals Birmingham and University Hospitals Leicester to help design the research question and areas of focus.

Commercial element:

Gilead Science charge Methods Analytics with the task of obtaining data and analytical efforts. Methods Analytics receives funding from Gilead Science for the effort involved in obtaining the data and undertaking the analytical efforts.

Gilead Science may receive, review and assess the quality of outputs produced. Gilead Science will not direct the methodology of the work or comment/contribute to the analytical findings.

Gilead Science will not block publication on the grounds of the analytical outputs.

All of Methods Analytics work using NHS England data assets, whether with the NHS or non-NHS bodies supporting the NHS, is undertaken with a view to putting into the hands of decision makers and/or the public domain meaningful intelligence to enable people who directly or indirectly provide care to the population in England, so that care can be more efficient and higher quality.

While there is a small commercial component to this request, the primary objective of the research is to advance public health and improve outcomes for patients with Triple Negative Breast Cancer. The study is funded by a Gilead Science, which has provided the necessary resources to create this paper. However, the involvement of the funder is strictly limited to financial support and does not influence the study's design, analysis, or outcomes.

Nature of the Commercial Interest:
The funding received from the Gilead Science is specifically allocated for conducting the research and for the submission of the resulting paper to medical journals. The Gilead Science will not have access to the data itself, nor will they derive direct commercial benefit from the findings.

Gilead Science produced a drug (Trodelvy) used to treat TNBC. Methods analytics will receive data from the years when this drug was introduced to the market.

Demonstration of Public Benefit:
The research aims to fill critical gaps in understanding the progression, treatment efficacy, and patient outcomes for Triple Negative Breast Cancer, an area with disproportionately poor outcomes and limited existing research. The insights gained from this study have the potential to:
• Improve Patient Outcomes: By identifying factors that contribute to the poor prognosis, this research could inform the development of more effective treatment strategies, ultimately benefiting patients within the NHS and beyond.
• Enhance Healthcare Practices: The study's findings will be disseminated, contributing to the broader medical community's knowledge and potentially influencing future clinical guidelines and healthcare policies.
• Support the NHS in Research and Innovation: The results will support ongoing efforts within the NHS to innovate and improve care for cancer patients, aligning with the broader goals of the Health and Social Care Act 2012.

Expected Benefits:

The findings of this research study are expected to further the understanding of TNBC and to facilitate improvements to care of patients with TNBC.

The use of the data could:
> help the system to better understand the health and care needs of populations.
> lead to the identification or improvement of treatments or interventions, or health and care system design to improve health and care outcomes or experience.
> advance understanding of regional and national trends in health and social care needs.
> inform planning health services and programmes, for example to improve equity of access, experience and outcomes.
> inform decisions on how to effectively allocate and evaluate funding according to health needs.

It is hoped that through media publication(s) of findings, the findings of this research will add to the body of evidence that is considered by organisations and individual care practitioners charged with making policy decisions or decisions on treatment for or within the NHS. It is also hoped that this research will add to the real-world evidence available to understand the variation according to ethnicity and/ or social deprivation.

Access to the broader breast cancer data is essential for improving Methods understanding of any sociodemographic and clinical factors potentially influencing TNBC outcomes. TNBC disproportionately affects certain populations and often correlates with socioeconomic challenges, yet the existing research and comparison pools remain limited. By examining TNBC within the context of the broader breast cancer dataset, we can begin to uncover trends and disparities that would otherwise remain hidden. The value of this is particularly enhanced by having a direct comparison cohort as opposed to input variables from other research.

This broader dataset enables meaningful comparisons, identifying both shared and distinct patterns among TNBC cases and other breast cancer subtypes. While not providing direct solutions, these insights will help to refine hypotheses and inform more targeted research approaches. In particular, understanding how deprivation and ethnicity intersect with TNBC outcomes could guide future studies into tailored therapeutic strategies and interventions. Over time, this could support incremental advancements in care quality and accessibility, especially for communities most affected by disparities in TNBC outcomes.

Whilst it is not possible to predict the outcomes of the study and the full benefits this paper will have to patients, Methods believe this process will enhance diagnostic approaches to TNBC, improve patient outcomes and inform updates to current policies. Understanding the variation according to ethnicity and/ or social deprivation will ensure all patients can expect the same treatment and outcome. By addressing these key areas, the paper has the potential to make a significant and positive impact on the lives of patients, ensuring they receive the best possible care and support throughout their treatment journey.

In summary, this research aims to address critical gaps in understanding and treating TNBC, with the primary goal of advancing public health and improving patient outcomes. By analysing data and publishing the findings in a reputable medical journal, the intention is to disseminate valuable insights that can enhance treatment strategies and patient care practices.

The primary goal is to maximise the public benefits from this research by advancing the understanding and treatment of TNBC. The findings will be published in a reputable medical journal, ensuring that they reach a wide audience of healthcare professionals, researchers, and policymakers. This will facilitate the integration of insights into clinical practices and healthcare policies, ultimately benefiting patients and the broader health and social care system. In addition, Methods will be seeking to present the findings at medical conferences to further disseminate the findings to the medical community.

Additionally, Methods have been in contact with consultants in oncology and are actively exploring opportunities to collaborate with them as co-authors on the study. Their expertise will be invaluable in interpreting the data and ensuring that the findings are both accurate and impactful. This collaboration will further enhance the study’s credibility and its potential to influence future cancer treatment strategies.

Outputs:

The expected outputs of the processing will be:
> Submissions to peer reviewed journals such as Clinical Oncology, Value in Health, and the British Journal of Oncology, expected early 2025. These papers will be shared with Gilead, and the national GIRFT team lead
> Presentations at appropriate conferences, such as the UK Oncology Nursing Society Conference and the European Society for Medical Oncology Breast Cancer Conference

The outputs will not contain NHS England Data and will only contain aggregated information with small numbers suppressed as appropriate in line with the relevant disclosure rules for the dataset(s) from which the information was derived.

The outputs will be communicated to relevant recipients through the following dissemination channels:
> Journals
> Conferences

Outputs are expected to be produced by early 2025.

Processing:

No data will flow to NHS England for the purposes of this Data Sharing Agreement (DSA).

NHS England will grant access to the Data via the Secure Data Environment (SDE). The SDE is a secure data and research analysis platform. It allows approved researchers with approved projects access to pseudonymised data and industry-leading analytics tools.

NHS England will provide access to the relevant records from the NDRS Data to Methods Analytics Ltd. The Data will:
• Contain special categories of personal data but with no direct identifying data items. The Data will be pseudonymised and individuals cannot be reidentified through linkage with other data in the possession of the recipient.

The Data will not be transferred to any other location.

SDE users can request exportation of aggregated analysis results (suppressed and summarised according to the NHSE SDE Disclosure Control rules) subject to review and approval by the NHS England SDE Output Checking team. The SDE Output Checking team will ensure that no output contains information which could be used either on its own or in conjunction with other data to breach an individual's privacy.

Users must identify themselves via a multi-factor authentication mechanism and are only able to access the datasets detailed within this DSA. The access and use of the system is fully auditable, and all users must comply with the use of the Data as specified in this DSA.

Users are only authorised to access the Data specified in this DSA and can utilise a variety of analytical tools available within the SDE platform. Users are not permitted to export record-level data from the SDE.

The Data will be stored on servers at NHS England.

The Data will be accessed by authorised personnel via remote access.

The Controller(s) must confirm and provide evidence upon audit by NHS England that access via any remote device complies with the data security obligations within this DSA and the Data Sharing Framework Contract.

For remote access:
- Remote access will only be from secure locations situated within the territory of use (as further restricted elsewhere within the DSA if so done) stated within this DSA;
- Access controls granting users the minimum level of access required are in place;
- Remote access is only via secure connections (e.g., VPNs or secure protocols) to protect data;
- Multifactor authentication (MFA) is required for remote access;
- Device security, including up-to-date software and operating systems, antivirus software, and enabled firewalls are utilised for the remote access;
- All remote access is undertaken within the scope of the organisation’s DSPT (or other security arrangements as per this DSA) and complies with the organisation’s remote access policy.

The above applies in addition to any condition set out elsewhere within the DSA (e.g. who may carry out processing, and for what purpose).

Remote processing will be from secure locations within the UK. The data will not leave the UK at any time.

Access is restricted to employees of Methods Analytics Ltd who have authorisation from the Project Lead.

All personnel accessing the Data have been appropriately trained in data protection and confidentiality.

The Data will not be linked with any other data.

There will be no requirement and no attempt to reidentify individuals when using the Data.

Researchers from Methods Analytics Ltd will analyse the Data for the purposes described above.


Standard Extract Subscription - Renewal — DARS-NIC-09519-D5G0R

Opt outs honoured: N, Y, No - data flow is not identifiable, No (Excuses: Does not include the flow of confidential data)

Legal basis: Health and Social Care Act 2012, Section 42(4) of the Statistics and Registration Service Act (2007) as amended by section 287 of the Health and Social Care Act (2012), Health and Social Care Act 2012 – s261(1) and s261(2)(b)(ii), Health and Social Care Act 2012 – s261(7), Health and Social Care Act 2012 - s261 - 'Other dissemination of information', Health and Social Care Act 2012 – s261(1) and s261(2)(b)(ii), Health and Social Care Act 2012 – s261(2)(b)(ii)

Purposes: Yes (Supplier)

Sensitive: Non Sensitive, and Sensitive, and Non-Sensitive

When:DSA runs 2019-12 – 2020-12 2017.06 — 2022.12. breached contract — audit report.

Access method: Ongoing, One-Off

Data-controller type: METHODS ANALYTICS LTD

Sublicensing allowed: No

Datasets:

  1. Hospital Episode Statistics Accident and Emergency
  2. Hospital Episode Statistics Admitted Patient Care
  3. Hospital Episode Statistics Critical Care
  4. Hospital Episode Statistics Outpatients
  5. Bridge file: Hospital Episode Statistics to Diagnostic Imaging Dataset
  6. Diagnostic Imaging Dataset
  7. Standard Monthly Extract : SUS PbR A&E
  8. Standard Monthly Extract : SUS PbR APC Episodes
  9. Standard Monthly Extract : SUS PbR APC Spells
  10. Standard Monthly Extract : SUS PbR OP
  11. Bridge file: Hospital Episode Statistics to Mortality Data from the Office of National Statistics
  12. Office for National Statistics Mortality Data
  13. Mental Health Services Data Set
  14. Bridge file: Hospital Episode Statistics to Mental Health Minimum Data Set
  15. Secondary Uses Service Payment By Results Spells
  16. Secondary Uses Service Payment By Results Outpatients
  17. Civil Registration - Deaths
  18. Secondary Uses Service Payment By Results Accident & Emergency
  19. Secondary Uses Service Payment By Results Episodes
  20. HES:Civil Registration (Deaths) bridge
  21. Civil Registration (Deaths) - Secondary Care Cut
  22. Emergency Care Data Set (ECDS)
  23. Mental Health and Learning Disabilities Data Set
  24. Secondary Uses Service Payment By Results Accident & Emergency
  25. HES-ID to MPS-ID HES Accident and Emergency
  26. HES-ID to MPS-ID HES Admitted Patient Care
  27. HES-ID to MPS-ID HES Outpatients
  28. Civil Registrations of Death - Secondary Care Cut
  29. Diagnostic Imaging Data Set (DID)
  30. Hospital Episode Statistics Accident and Emergency (HES A and E)
  31. Hospital Episode Statistics Admitted Patient Care (HES APC)
  32. Hospital Episode Statistics Critical Care (HES Critical Care)
  33. Hospital Episode Statistics Outpatients (HES OP)
  34. Mental Health and Learning Disabilities Data Set (MHLDDS)
  35. Mental Health Services Data Set (MHSDS)

Type of data: Anonymised - ICO Code Compliant

Objectives:

The data will be used to support the NHS either directly: (specifically (Department of Health, NHS England, CCGs, CSUs, providers of NHS funded care and professional bodies) through the delivery of tools and bespoke analysis or indirectly through non-NHS organisations, where analytics are provided to the NHS as the end beneficiary via a non-NHS organisation. Such organisations work within the healthcare space and have access to analysis solely for the purpose of assisting NHS organisations. Such organisations will only be provided with aggregate, small number suppressed data in line with the HES Analysis Guide. Methods Analytics target audience is NHS organisations, however the NHS is increasingly looking to industry to support it in the provision of evidence and implementation support for service improvement, and hence Methods Analytics wish to offer the tool to a limited number of non-nhs organisations based on their agreeing to license terms and conditions, which include submitting and evidencing training in information governance and the restriction of the use of the tool to the uses outlined in this document, with this purpose statement flowed down as a contract schedule. For clarity, the schedule will state that:
• Only aggregated small number suppressed data may be used from the tool.
• No data is to be used for direct marketing to individuals or organisations.
• No data is to be used for direct sales activities.

There are five uses of data requested (and each is discussed further within the processing, outputs and benefits section). The specific uses are :-
1) For Stethoscope - a quality variation tool which provides national benchmarking of HES based indicators that is made available free to the public at an organisation roll up level, and more granular information to subscribing NHS organisations (NHS England, CCGs, CSUs and providers of NHS funded care and non-NHS organisations undertaking service improvement support for NHS benefit. Such organisations work within the healthcare space and have access to the system solely for the purpose of assisting NHS organisations. Such organisations will only be provided with aggregate, small number suppressed data in line with the HES Analysis Guide on their agreeing to license terms and conditions, which include submitting and evidencing training in information governance and the restriction of the use of the tool to the uses outlined in this document, with this purpose statement flowed down as a contract schedule. For clarity, this will state that:

• No record level data is provided to any third party organisation in any format.
• No data is to be used for direct marketing to individuals or organisations.
• No data is to be used for direct sales activities.

Non-NHS organisations to be included are: charity and not-for-profit organisations , academic researchers, companies that specialise in providing commissioning support and service improvement services to the NHS and life science companies. No other non-NHS organisations are permitted .

Consultant code will also provide a further level of drilldown in the Stethoscope product to provide Trusts only to explore and understand the variation in care between their own consultants across Method Analytics indicator set. Access to the more granular tool is provided securely to named subscribers only, with individual surgeons able to compare themselves to a national cohort of surgeons. Access controls restrict access to consultant identifiable data so that only authorised staff at an individual Trust can only see data for their own employees, and such data is suppressed in line with the HES analysis guide. No access to servers containing HES data is possible through Stethoscope as the Stethoscope servers are not linked in any way to the secure environment.

Only aggregated data (suppressed in line with the HES Analysis Guide) is surfaced through Stethoscope.

2) For bespoke tools and analysis for individual NHS clients (NHS England, CCG and providers of NHS funded care), CSUs, professional bodies and non-NHS organisations undertaking service improvement support for NHS benefit. Such organisations work within the healthcare space and receive analysis solely for the purpose of NHS benefit. All such organisations will only be provided with aggregate, small number suppressed data in line with the HES Analysis Guide. The majority of these reports contain data items from Stethoscope but are reported as dashboards for individual organisations. They also contain bespoke metrics generated from HES data presented as aggregated (small number suppressed in line with HES Analysis Guide) tabulated data and/or charts and graphics, and can have accompanying narrative interpretation. Methods Analytics may choose to place tabulations in the public domain (via Methods website or partner website) where a tabulation has been produced to support academic work or for other analysis under the terms of this agreement where there is public benefit in be a provider of open data. All such tabulations will be aggregate, small number suppressed in line with the HES analysis guide.

3) For creating and hosting dashboards and an explorer tool developed with the surgical associations working group under a NICE accredited methodology. This is work for the National Surgical Commissioning Centre, hosted by the Royal College of Surgeons of England and part of the NHS England Rightcare programme. These tools show activity rates and simple outcomes for CCG populations and care providers using HES/SUS PbR data. These tools are free to the public.

4) SWORD is a project for a number of the specialist surgical societies to develop an intelligence tool for only their Consultant Surgeons members to access measures and metrics about their own performance, which will be accessible via the associations member’s portals (therefore password protected). Only consultant surgeon members of the associations can access the SWORD tool. Access is further restricted so that surgeons can only access pathways developed with and for their specialist association and not those pertaining to other specialties. This is further secured by the request for access being generated by the association and sent to Methods Analytics, with Consultant name, GMC number and nhs.net email address that is used for communication with the individual. Method Analytics creates an account for that consultant with access granted only to pathways developed with and for the requesting association. When the user logs in the system validates a link between their user name and GMC number, so when they click the ‘consultant view’ they see only their own data with a national mean. At this level only data for the named consultant is visible. As requested and previously approved by DAAG the surgical associations individual consultants may see their own activity and outcomes without suppression, and national mean data to enable local discussion amongst surgeons of low volume activity and outcomes. There is no option to view other consultants’ data in this view. If the user does not have a valid GMC number linked to their user account, then when a user clicks on consultant view no information is presented.

The other use case for SWORD is ‘pathway view’ where a user looks at an organisation level comparative (benchmarking) data for an individual surgical pathway, such as cholecystectomy, groin hernia etc with the ability to drill in and investigate how behaviour varies for groups of patients (grouped by a common theme eg: treatment pathway, not by identifiers). The surgical associations have now requested that Methods Analytics do not undertake suppression in this view either as to do so compromises the quality and accuracy of data, meaning too much data is missing to form a complete and accurate picture of what is going on clinically for patients on these pathways and significantly reduces the value of tool to the surgical community. The ability to look at sub-cohorts of activity and understand variation in decision making and low volume activity is a core use case, as stated the entire tool is only available to active consultant surgeons and they can only view pathways developed with and for their specialty association. The pathway view without suppression is deemed vital for clinical engagement, improvement of data quality and improvement in surgical decision making and patient outcomes by providing insight into clinical behaviours that it would be desirable to understand and potentially challenge, and identify if there are places in the country that are doing well and can peer support improvement in these pathways for those struggling.

5) The HSCIC developed the Summary Hospital Mortality Indicator (SHMI) and provides quarterly publications for each Trust in England. This includes an observed number of deaths within that period that occurred in hospital plus the number of deaths which occurred within 30 days of discharge from hospital. Using the HES-ONS linked dataset, Methods Analytics were able to reproduce the exact methodology and figures in a timely manner which will allow subscribing NHS medical directors, chief executives, clinicians and managers to explore how the SHMI has changed over time and how their own trust is performing against other trusts in the country in terms of mortality rates. This means the data can be used to identify any issues and to improve the quality of care and to reduce patient mortality. ONS data has been used to create SHMI and variants of SHMI and include it as content in items 1-4 above as an indicator. Under this application, the ONS data is no longer held and thus cannot be reprocessed to create new such indicators, but indicators already produced may continue to be used.

Yielded Benefits:

Methods works with the DH GIRFT programme, generating report across many specialty areas under Lord Carters NHS efficiency programme. These detailed data rich reports are shaped by national lead clinicians for each specialty and they then visit every provider in England to discuss their data with them in order to improve the quality and efficiency of care. This programme is currently being rolled out. Methods Analytics have produced programme updates for the GIRFT team, using HES analysis to demonstrate the early impact the GIRFT programme has had across the NHS and supporting policy development, such as, realising over £4m of cashable saving and releasing over 50,000 bed days of surgical occupancy while improving the quality of care just in Orthopaedic Surgery. Methods has also supported the development and publication of GIRFT national reports (http://gettingitrightfirsttime.co.uk/girft-reports/) through use of NHS Digital data to enable the development of national level recommendations on policy and regulation of the services based on sound analysis. Across these reports many hundreds of millions of pounds of savings have been identified, with specific recommendations supporting the delivery of each savings opportunity.

Expected Benefits:

Benefits relating to each of the purpose statements is listed below:

1) Stethoscope Free (formerly Acute Trust Quality Dashboard) free to the NHS and the public is information tool showing aggregated indicator data across the domains of the NHS operating framework. This has significant usage across the NHS with hundreds of visits each period and users can download a free pdf report, with approximately 7000 views and 30 free pdfs downloaded by users each month. The free public Stethoscope website was used as input for the Keogh mortality reviews and is visited by Monitor, CQC and NTDA among many others. Methods are aware that the free pdf download is used to inform Trust boards, having been asked for permission by Trust secretaries.
Stethoscope Subscriber a password protected secure service offered with an annual subscription to cover the costs of data hosting and processing, licensing for Qlikview, development of the tool and hosting user groups. This offers users much more frequently than publically available sources updated indicator data with the ability to drill into the data and filter by different options to provide insight and understanding of the quality of care. Users would be assigned access to the tool by an administrator in their organisation and examples of users include Trust Chief Executives, Medical and Nursing Directors, Specialty Managers, Clinicians and Information Departments. CCG, Local Area Team and commissioning region subscribers may grant access to the tool for use by Quality Managers, Public Health analysts, Commissioning Managers and Executives.
It is important for Methods Analytics to work with their customers to ensure they can interpret the data and use it to take appropriate actions to safeguard against excess mortality and reduce mortality and improve the quality of care where possible. Many indicators are available dealing with Quality and Safety issues NHS Organisations face to allow decision makers to take actions based on up to date information. Methods have CCG, provider and NHS England regions as subscribers with over 100,000 page views per year and 100% contract renewal from subscribers indicating the value of the system to NHS users. The Stethoscope subscriber system has been used to support Quality Surveillance Groups, Quality Summits, and board to board oversight meetings
This application seeks to extend Stethoscope access to non-NHS organisations solely where they are working for NHS benefit by providing service improvement support to NHS organisations. As some NHS organisations require additional specialist resource to deliver the benefits of using benchmarking information, therefore subscription to Stethoscope is required by the non-NHS organisations as:

1. This enables the non-NHS organisation to have people equipped to provide immediate support to NHS organisations.
2. Providing them with aggregate level information via the tool is the most efficient way of disseminating information in support of this work – the alternative described directly below would clearly create large inefficiencies.
3. It allows such organisations to be autonomous in undertaking work that requires a level of independence and is beneficial to the NHS and negates the risk associated with further raw data dissemination these organisations directly.

Allowing select non-NHS healthcare focused organisations to access aggregate level analytics is beneficial to the NHS as it enable the NHS to quickly access additional specialist resource when it is required. This allows the timely delivery of improvements in clinical quality and/or operational efficiency. Without this option it would be necessary for them to increase or upskill their internal resource. To do so would require longer timescales and prove more costly for the organization and therefore the NHS in the long run if there is primarily a short term need.

2) Methods Analytics work with Trusts and CCGs, and wider programmes such as the DH GIRFT team to provide ad hoc reporting matching their requirements, using HES/SUS and SUS PbR data as appropriate to derive insight into a specific topic or issue.

A real life example is a review of urgent care within an NHS Trust: Methods Analytics used HES data to build a picture of issues around urgent care including where patients are flowing from, how referral patterns are changing over time and conversion rates that was used by the organization to initiate a transformation programme and improve urgent care timeliness and outcomes. Similar projects focusing on mortality have resulted in large and lasting reductions in hospital mortality. Projects include a large amount of clinical engagement to ensure that data in the reports is used in the best way possible to make changes to services that benefit patients in any organisation working with Methods Analytics. The Analytics team includes clinicians and consultants to provide the right expertise when discussing any insight with Methods Analytics NHS clients.
Methods are also working with the DH GIRFT programme, generating report across 12 specialty areas under Lord Carters NHS efficiency programme. These detailed data rich reports are shaped by national lead clinicians for each specialty and they then visit every provider in England to discuss their data with them in order to improve the quality and efficiency of care. This programme is currently being rolled out. Methods Analytics have recently produced a programme update for the GIRFT team, using HES analysis to demonstrate the early impact the GIRFT programme has had across the NHS and supporting policy development, such as, realising over £4m of cashable saving and releasing over 50,000 bed days of surgical occupancy while improving the quality of care.

Enabling Methods Analytics to place tabulations as described for free in the public domain will deliver benefit to the NHS and wider public as aggregate, anonymous, low volume suppressed data that we have created as part of the input to published academic work (e.g. http://www.iaas-med.com/files/Journal/21.4/Swift_et_al.pdf) and public reports (e.g. the NHS England surgical deep dive reports referred to in 3 below) will enable further local analysis, research and understanding of improvement science in healthcare, ultimately benefitting healthcare and the public purse.

3) The NSCC dashboards and PET tool was developed in partnership with the Royal College of Surgeons and NHS England Rightcare programme to support the work of the National Surgical Commissioning Centre
http://www.rcseng.ac.uk/healthcare-bodies/nscc. They developed commissioning guides for CCGs on specific interventions which all have NICE accreditation. As part of this work, Methods Analytics developed the PET tool to allow commissioners to access data to support the guidelines. The commissioning Guides are approved by the National Institution for Clinical Excellence and together with the data tools are used by commissioners across England to improve services for patients and monitor those improvements. RCSE has made the guidelines publically available and also the data tools in line with the requirements of the governments transparency agenda. Therefore there are no ‘customers’ as the tool is available to all. This tool has been live since 2012 and Methods Analytics has been recontracted, funded by NHS England, to maintain and enhance these tools. The tool receives of the order of 350 hits per month from NHS and wider public. Methods Analytics has recently produced a ‘surgical deep dive’ report for the RCSE and NHS England Rightcare programme that uses HES analysis to produce a detailed report for every NHS provider and CCG detailing variation across 29 surgical care pathways that will be available for free to the public and NHS on the NHS England web site.

4) SWORD is a tool developed with the ALS and AUGIS to provide to their consultant surgeon members detailed, clinically valid metric that report activity, quality and outcome metrics for surgical pathways. The tool is now live in a development state for user validation and testing, with consultant surgeons starting to request, and being provided with, access. Wider roll out is ongoing, including developing relationships with other surgical specialties.

By allowing surgeons to see how their quality of care varies from other surgeons performing the same operations they can work to improve the levels of care they are able to offer and improve the safety for patients they are operating on, in order to get a full understanding it is important they are able to identify themselves in the tool. Surgeons can also use the data could also be used for revalidation purposes therefore ensuring patient safety by providing evidence a surgeon is up to date and fit for practice. There is significant interest from other specialist societies based on the work done in upper GI and laparoscopic surgery and developmental work is underway with the Association of colorectal surgeons, British Association of Pediatric Surgeons and support from the over-arching Federation of Surgical Specialist Associations.

Outputs:

Outputs for the data will be as follows and are related back to the 4 purposes:
1) Stethoscope. Live. Tool developed as Ruby on Rails bespoke web tool combined with Qlikview 11 dashboards
https://stethoscope.methods.co.uk.

2) Ad hoc reports and bespoke tools ongoing. Created using MS Office Suite , Excel 2013, Word 2013, Qlikview and Tableau and also rendered as .PDF format for final reports on highly aggregate data. These include multiple reports on Mortality and Emergency care are for CCGs, providers and NHS England regions to support understanding of causes of failure and direct service improvement initiatives. Methods are also supporting the DH GIRFT programme, a wide ranging programme to improve secondary care quality and outcomes, with bespoke analysis and reporting for every provider in England.

3) Royal College of Surgeons Live dashboards and tool developed in Qlikview11 called the Procedures Explorer Tool (http://rcs.methods.co.uk/pet.html) and have recently produced surgical deep dive reports for every CCG and provider in England.

4) The output is an application SWORD, at http://www.augis.org/sword/

Processing:

For all purposes above the data is made available to Methods Analytics through HSCICs secure ftp, after which it is imported into directly into Methods Analytics SQL data warehouse that is hosted as discrete physical servers by Redcentric. The process is handled by a single Data Base Administrator, as per the HSCIC guidance who has the password for the secure ftp.. This process means the individual will set off a set of automatic instructions to import the data into SQL via an SSIS package. The package itself handles the data import process. Redcentric provide rack space, power, internet connectivity (controlled by physical firewalls) and high level server management support (such as server system software patching). They do not have any access to data within the servers.
Methods Analytics will install, maintain and operate all non-operating system software and have sole access to the servers. The installed software will be MS SQL Server 2014,and R server statistics package. Methods Analytics users will have to complete a Data Centre Access request form which is signed off by their line manager before being granted access the server. using 2 factor authentication, encrypted, VPN. The VPN supports the use of both SafeNet Software based tokens and hardware based tokens each of these types requires a pin-code in order to generate a one-time password for the VPN. Each token is only usable on one device. The use of tokens restricts each Methods Analytics user to a single computer, with a drive encrypted using Microsoft Bitlocker.
With the unique token issued to each member of Methods Analytics staff who need access, this identifies them discretely and incorporates user level access control limiting access to tables and data at a per user level. Data on the servers is encrypted using XTS AES 256-bit encryption at rest. All processing will be undertaken within the server environment. No episode level data will leave the secure environment. Once the record level data has been processed, only anonymous, aggregated data (with small numbers suppressed in line with the HES analysis guide), is transferred out of the secure Redcentric environment, as described in individual sections below. No record level data is provided to any third party, and all record level or aggregated data (small numbers unsuppressed data) is held at RedCentric. The development of Qlikview tools will be undertaken in the secure Redcentric environment.

1) HES/SUS PbR Data is processed into indicators within the Redcentric environment and the resulting aggregated data (with small numbers unsuppressed) dataset is transferred to a Qlikview server which is also within Redcentric over a secure internal unidirectional VPN tunnel. Suppression of small numbers as per the HES Analytics Guide is applied by the Qlikview product as the application is used, and thus ensures that no small number unsuppressed data is available to the user. Stethoscope’s functionality built in the web for providing indicator Alerts and MyView uses a different data model to Qlikview. The data is still processed in Redcentric and suppressed in line with HES Analysis Guide. Whilst the Analysis Guide does permit small numbers at certain geographical levels, Methods Analytics apply small number suppression to any low numbers in the data table regardless of the level of aggregation (i.e. Regional, Provider etc) before it is transferred to an Amazon Web Service instance (in the EU Ireland region), where the data is restored to a SQL database which serves the web product. To be clear, only aggregated small number suppressed data (anonymous data therefore) is held or processed
within Ireland.

2). HES/SUS PbR Data is processed into indicators and counts within the Redcentric environment and undergo a process to create an anonymous, small number suppressed tabulation. Those tabulations, which are suppressed in line with the HES Analysis Guide, are transferred via encrypted VPN to encrypted PCs/laptops in order to build reports using a suite of business intelligence software consisting of MS Office, MS PowerBI, Qlikview or Tableau. Reports are also rendered as Adobe PDF documents before being distributed.

3) HES/SUS PbR Data is processed into indicators and counts within the Redcentric and the resulting aggregated (small numbers unsuppressed) dataset is transferred to a Qlikview server which is also within Redcentric over a secure unidirectional VPN tunnel. Suppression of small numbers as per the HES Analysis Guide is applied at the application layer (Qlikview) and ensures that small numbers are not available to the user.

4) HES/SUS PbR Data is processed into indicators and counts within the server environment and the resulting
pseudonymised dataset is transferred to a Qlikview server which is also within Redcentric over a secure unidirectional VPN tunnel. Suppression of small numbers as per the HES Analysis Guide is applied at the application layer (Qlikview) and ensures that no numbers <=5 are available to the user at this time, except where expressly permitted above in section 5a.