Search for content, post, videos
Advertisement

The causes of the KI freezer failure according to internal report

On 12 April, the internal investigation into the freezer failure during the Christmas holidays in 2023 was presented in the Neo building at Karolinska Institutet.

The investigation has been led by KI’s head of security and it points to clear technical as well as organizational shortcomings. Taken together, a chain of these shortcomings caused the breakdown that led to the destruction of research material and the loss of years of research work. The inquiry recommends a number of measures.

Read more: Devastating freezer failure at Karolinska Institutet

It is about mandates, division of responsibilities, resources and organisation. We see shortcomings in all these areas for a long time, and the reason why things could go this badly is because a chain of these shortcomings coincided.”

“The university management will now carefully study the inquiry’s report and analyze what measures will be required. We can already conclude that KI needs to take a more comprehensive and central approach to business-critical facilities and infrastructure related to our research,” says KI’s president Annika Östman Wernerson. “It is about mandates, division of responsibilities, resources and organisation. We see shortcomings in all these areas for a long time, and the reason why things could go this badly is because a chain of these shortcomings coincided.”

Temperature rose in 16 cryo tanks

It was on the evening of December 22 that the level of liquid nitrogen in the cryo tanks of the Neo was to be routinely refilled from an external bulk tank. The cryogenic tanks stored large amounts of biological research material that had been collected over decades.

The automated filling of nitrogen keeps the temperature of -190 °C in the 19 isothermal tanks: the cryo tanks. However, on this occasion, the flow from the outer tank did not work and over the next few days the temperature rose in 16 cryo tanks.

The failure was discovered on 27 December, by which time a significant part of the contents of the freezers had been destroyed. On 28 December, troubleshooting and preparations for an accident investigation team began.

Three main parts

The investigation report has three main parts: a technical investigation, an organizational investigation and recommended measures.

The investigation is based on a large number of interviews with employees and management at Neo and KI Syd. Subcontractors have also been interviewed, states KI. In addition to the interviews, technical logs, available agreements and other documentation have been included in the investigation material. There has also been a technical investigation that forms the basis of the technical analysis.

Closed valve after filling

The technical part of the investigation shows that the supply of liquid nitrogen to the cryo tanks was stopped when a valve on the bulk tank was closed on the morning of 22 December in connection with a service work carried out by an external technician. When the service work was completed, the technician announced that the alarm would be reset, but this did not happen and the valve therefore remained closed, with the result that the supply of nitrogen was stopped.

The investigation rules out the possibility that the accident was an act of sabotage.”

The investigation shows that SMS and emails with information about alarms were sent out to the phone numbers and email addresses registered for this. However, there is no documentation that can confirm that SMS has actually been delivered to the recipients. Members of the Neo service team have confirmed that they have received SMS about alarms. However, as service work was underway, no action was taken.

The investigation rules out the possibility that the accident was an act of sabotage.

Unclear responsibilities

The investigation’s examination of the organizational causes shows that some parts of the accident can be traced back almost nine years. At that time, the design of the Neo building began with a KI-internal project manager.

The investigators point out that there is a process for documentation and registration of construction projects at KI’s property department. But for the Neo project, for unknown reasons, that routine has been departed from. Nor are there any notes from the meetings that were held during the design period with the relevant heads of department and operations, when functional requirements and needs regarding the premises were discussed.

The investigators conclude that there is a lack of important documentation in connection with the property department’s handover of the Neo building to the operations in 2018. Among other things, about risks related to nitrogen routines and in the event of non-delivery of nitrogen.

Day-to-day management

The report raises a number of questions about the day-to-day management of the freezer hotel at Neo. The term “hotel” implies that each research group has had its own responsibility for both the installation of cryo-freezers and the administration of alarm points.

Unfortunately, over time, this has resulted in a lack of clarity where one hand does not know or has asked about what the other is doing. It is undoubtedly extremely unfortunate, even though the intentions of everyone involved have always been the very best.”

“In retrospect, it is clear that the forms of operation and management of the freezer hotel were based on trust between the parties and that probably too much responsibility has been placed on the research groups. Something that in the other facilities has been more on the larger service teams,” says Matti Sällberg, dean of KI South. “Unfortunately, over time, this has resulted in a lack of clarity where one hand does not know or has asked about what the other is doing. It is undoubtedly extremely unfortunate, even though the intentions of everyone involved have always been the very best.”

The sample collections that have been destroyed are estimated to consist of 34,400 biobank samples, 3,800 samples from animal models, 2,600 samples from cell lines and 6,300 samples with manipulated/edited cell lines.

Need for designated system owners

The investigation team concludes that the accident did not occur due to a single event or source of error, but a combination of several.

The report presents a number of recommended measures, primarily about creating a robust freezing infrastructure at KI with a clear division of responsibilities to avoid serious consequences of individual wrongdoing. For example, it must be clear who is responsible for ensuring that staff handling the freezers receive adequate training, and who is responsible for regular maintenance, risk analysis and continuity planning.

The report also recommends a more central and common way of working for robust operations. Among other things, there should be a special round-the-clock on-call service for freezer hotels and other business-critical parts.

External review next step

Once the internal investigation has been completed, the external expert group will take over. It is led by Anna Beskow, head of Uppsala Biobank at Uppsala University, who will conduct an independent review.

The assignment includes further deepening the analysis of how KI secures robust structures for mission-critical systems. The investigators also have the opportunity to conduct supplementary interviews and investigations, if necessary. KI’s investigation will also be reviewed by the supervisory authority IVO, the police and the Legal, Financial and Administrative Services Agency (Kammarkollegiet).

What has happened is serious for KI and especially for the researchers affected. Therefore, the goal must be to ensure that similar incidents cannot happen again – neither in Neo nor anywhere at KI.”

“We can initiate certain measures in parallel with the external review of the freezing disaster, which it will not be until we in the management have studied the inquiry’s report and analysed what measures will be required. What has happened is serious for KI and especially for the researchers affected. Therefore, the goal must be to ensure that similar incidents cannot happen again – neither in Neo nor anywhere at KI,” says Annika Östman Wernerson.

When it comes to compensation and insurance issues, an inventory is underway of the costs associated with the freezer breakdown. “It’s something we need to look at first. So that issue is being reviewed and we will get back to you on it when the inventory is complete,” says KI’s president.

Source: Karolinska Institutet

Photo of Annika Östman Wernerson: Martin Stenmark

Advertisement