“Imperial College’s multi-country model used its earlier and more famous projections for the US and UK to claim validity for its more expansive set of international extrapolations. As Ferguson’s team wrote on March 26, 2020:
“Our estimated impact of an unmitigated scenario in the UK and the USA for a reproduction number, R0 , of 2.4 (490,000 deaths and 2,180,000 deaths respectively) closely matches the equivalent scenarios using more sophisticated microsimulations (510,000 and 2,200,000 deaths respectively)” that they released a few weeks prior. If Imperial’s US and UK projections matched, a similar validity could be inferred for the other countries they modeled in the multi-country report.”…
300 million Americans, including thousands of math professors and physicians, were instantly subordinated to 13 year old predictions about a different disease, the flu, by a failed UK math professor (though Knighted by the Queen in 2002 and listed as an advisor to the US government in his Nervtag bio) of a small foreign monarchy. By 3/16/2020, Trump had already published a 100-page US government lockdown plan in line with catastrophic predictions of unvetted 13 year old computer code about a different disease by a math professor of a small country thousands of miles away from the US. When Trump said, “15 days to slow the spread,” he had already planned it to be “18 months or longer" as his UK pals did. Imperial College reported US and UK as a single unit: “We show that in the UK and US context, [“UK and US context?” Why is US included in a lockdown sales pitch by a foreign citizen? UK and US are vastly different countries thousands of miles apart, totally different health systems and governments. US does have its own math professors, universities, and the like. If not Trump, who decided that 300 million Americans are subordinate to 13 year old unvetted computer code about a different disease, the flu, along with its lead salesman, an unelected, unaccountable, foreign math professor and subject of a foreign monarch?] suppression will minimally require a combination of social distancing of the entire population, home isolation of cases and household quarantine of their family members. This may need to be supplemented by school and university closures.…The major challenge of suppression is that this type of intensive intervention package…will need to be maintained until a vaccine becomes available (potentially 18 months or more).”…"So frequently and so epically did Ferguson overestimate death tolls that his colleagues mockingly call him “The Master of Disaster.”…Ferguson was behind the disputed research that sparked the mass culling of eleven million sheep and cattle during the 2001 outbreak of foot-and-mouth disease. Charlotte Reid, a farmer’s neighbor, recalls: “I remember that appalling time. Sheep were left starving in fields near us. Then came the open air slaughter. The poor animals were panic stricken….And all based on a model—if’s but’s and maybe’s.”...In 2002, Ferguson predicted that up to 150,000 people could die from exposure to BSE (mad cow disease) in beef. In the U.K., there were only 177 deaths from BSE. In 2005, Ferguson predicted that up to 150 million people could be killed from bird flu. In the end, only 282 people died worldwide from the disease between 2003 and 2009. In 2009, a government estimate, based on Ferguson’s advice, said a “reasonable worst-case scenario” was that the swine flu would lead to 65,000 British deaths. In the end, swine flu killed 457 people in the U.K.”...Of course, Neil Ferguson is listed as an “advisor” to the US government in his Nervtag bio (screen shot from 4/25/21 at end of this post). It makes sense that a citizen of a foreign government, subject of a foreign monarch, a global joke for his prediction failures, would be put on the payroll of fellow global jokes, US taxpayers.
……………………….
4/22/21, “The Failure of Imperial College Modeling Is Far Worse than We Knew,” AIER, Phillip W. Magness
Ferguson predicted catastrophic death tolls back on March 16, 2020 unless governments around the world adopted his preferred suite of nonpharmaceutical interventions (NPIs) to ward off the pandemic. Most countries followed his advice, particularly after the United Kingdom and United States governments explicitly invoked his report as a justification for lockdowns.
Ferguson’s team at Imperial would soon claim credit for saving millions of lives through these policies – a figure they arrived at through a ludicrously unscientific exercise where they purported to validate their model by using its own hypothetical projections as a counterfactual of what would happen without lockdowns. But the June hearing in Parliament drew attention to another real-world test of the Imperial team’s modeling, this one based on actual evidence.
As Europe descended into the first round of its now year-long experiment with shelter-in-place restrictions, Sweden famously shirked the strategy recommended by Ferguson. In doing so, they also created the conditions of a natural experiment to see how their coronavirus numbers performed against the epidemiology models. Although Ferguson originally limited his scope to the US and UK, a team of researchers at Uppsala University in Sweden borrowed his model and adapted it to their country with similarly catastrophic projections. If Sweden did not lock down by mid-April, the Uppsala team projected, the country would soon experience 96,000 coronavirus deaths.
I was one of the first people to call attention to the Uppsala adaptation of Ferguson’s model back on April 30, 2020. Even at that early date, the model showed clear signs of faltering. Although Sweden was hit hard by the virus, its death toll stood at only a few thousand at a point where the adaptation from Ferguson’s model already expected tens of thousands. At the one year mark, Sweden had a little over 13,000 fatalities from Covid-19 – a serious toll, but smaller on a per-capita basis than many European lockdown states and a far cry from the 96,000 deaths projected by the Uppsala adaptation [based on Ferguson’s math].
The implication for Ferguson’s work remains clear: the primary model used to justify lockdowns failed its first real-world test.
In the House of Lords hearing from last year [June 2020], Conservative member Viscount Ridley grilled Ferguson over the Swedish adaptation of his model: “Uppsala University took the Imperial College model--or one of them--and adapted it to Sweden and forecasted deaths in Sweden of over 90,000 by the end of May if there was no lockdown and 40,000 if a full lockdown was inforced.” With such extreme disparities between the projections and reality, how could the Imperial team continue to guide policy through their modeling?
Ferguson snapped back, disavowing any connection to the Swedish results: “First of all, they did not use our model. They developed a model of their own. We had no role in parameterising it. Generally, the key aspect of modelling is how well you parameterise it against the available data. But to be absolutely clear they did not use our model, they didn’t adapt our model.”
The Imperial College modeler [Ferguson] offered no evidence that the Uppsala team had erred in their application of his approach. The since-published version from the Uppsala team makes it absolutely clear that they constructed the Swedish adaptation directly from Imperial’s UK model. “We used an individual agent-based model based on the framework published by Ferguson and coworkers that we have reimplemented” for Sweden, the authors explain. They also acknowledged that their modeled projections far exceeded observed outcomes, although they attribute the differences somewhat questionably to voluntary behavioral changes rather than a fault in the model design.
Ferguson’s team has nonetheless aggressively attempted to dissociate itself from the Uppsala adaptation of their work. After the UK Spectator called attention to the Swedish results last spring, Imperial College tweeted out that “Professor Ferguson and the Imperial COVID-19 response team never estimated 40,000 or 100,000 Swedish deaths. Imperial’s work is being conflated with that of an entirely separate group of researchers.” It’s a deflection that Ferguson and his defenders have repeated many times since.
As it turns out though, Ferguson and the Imperial College team were being less than truthful in their attempts to dissociate themselves from Sweden’s observed outcomes. In the weeks following the release of their well-known US and UK projections, Ferguson and his team did in fact produce a trimmed-down version of their own modeling exercise for the rest of the world, including Sweden. They did not widely publicize the country-level projections, but the full list may be found buried in a Microsoft Excel appendix file to Imperial College’s Report #12, released on March 26, 2020.
Imperial’s own projected results for Sweden are nearly identical to the Uppsala adaptation of their UK model. Ferguson’s team forecast up to 90,157 deaths under “unmitigated” spread (compared to Uppsala’s 96,000). Under the “population-level social distancing” scenario meant to approximate NPI mitigation measures such as lockdowns, the Imperial modelers predicted Sweden would incur up to 42,473 deaths (compared to 40,000 from the Uppsala adaptation).
The Imperial team did not specify the exact timing of when they expected Sweden to reach the peak of its outbreak. We may reasonably infer it though from their earlier US and UK model, which anticipated the “peak in mortality (daily deaths) to occur after approximately 3 months” following the initial outbreak. That would place Sweden’s peak daily death toll around mid-June, or almost the exact same time period as the Uppsala team’s adaptation.
Figure I: Imperial College Model for Sweden, March 26, 2020
It turns out that Viscount Ridley’s line of questioning was correct all along. The Uppsala adaptation of Ferguson’s model not only projected exaggerated death tolls in Sweden. Ferguson’s own projections for Sweden advanced similar numbers, all wildly off the mark from what happened.
Imperial College’s multi-country model used its earlier and more famous projections for the US and UK to claim validity for its more expansive set of international extrapolations. As Ferguson’s team wrote on March 26, 2020:
“Our estimated impact of an unmitigated scenario in the UK and the USA for a reproduction number, R0 , of 2.4 (490,000 deaths and 2,180,000 deaths respectively) closely matches the equivalent scenarios using more sophisticated microsimulations (510,000 and 2,200,000 deaths respectively)” that they released a few weeks prior.
If Imperial’s US and UK projections matched, a similar validity could be inferred for the other countries they modeled in the multi-country report.
The Imperial College team fully intended for its multi-country model to guide policy. They called on other countries to adopt lockdowns and related NPIs to reduce the projected death toll from the “unmitigated” scenario to “social distancing.” As Ferguson and his colleagues wrote at the time, “[t]o help inform country strategies in the coming weeks, we provide here summary statistics of the potential impact of mitigation and suppression strategies in all countries across the world. These illustrate the need to act early, and the impact that failure to do so is likely to have on local health systems.”
Failure to act, they continued, would lead to near-certain catastrophe. As Ferguson and his team wrote, “[t]he only approaches that can avert health system failure in the coming months are likely to be the intensive social distancing measures currently being implemented in many of the most affected countries, preferably combined with high levels of testing.” In short, the world needed to go into immediate lockdown in order to avert the catastrophes predicted by their multi-country model.
(Note: Imperial College also included a third possible mitigation scenario for stricter measures on top of general population NPIs, aimed at further isolating elderly and vulnerable people, projecting it could reduce Sweden’s numbers to between 16,192 and 33,878. They further modeled a fourth possible “suppression” scenario consisting of a severe lockdown that would reduce human contacts by 75% for the duration of the pandemic and maintain them for a year or more until population-wide vaccination was achieved. It predicted 14,518 deaths. Sweden clearly did not adopt either of these approaches).
One year later we may now look back to see how Imperial College’s international projections performed, paying closer attention to the small number of countries that bucked his lockdown recommendations. The results are not pretty for Ferguson, and point to a clear pattern of modeling that systematically exaggerated the projected death tolls of Covid-19 in the absence of lockdowns and related NPIs.
Figure II compares the Imperial College model’s projections for its “social distancing” scenario and “unmitigated” scenario against the actual outcomes at the one-year mark after its release. These projections reflect an assumed replication rate (R0) of 2.4 – the most conservative scenario they considered, meaning Imperial’s upper range of projections anticipated substantially higher death tolls. The countries examined here – Sweden, Taiwan, Japan, and South Korea--are distinctive for either eschewing lockdowns and similar aggressive NPI restrictions entirely or for relying on them in a much more limited scope than Imperial College advised. The United States, where 43 of 50 states adopted lockdowns of some form, is also included for comparison.
Figure II: Performance of Imperial College Modeling in 4 Non-Lockdown Countries & the United States:
As can be seen, Imperial College wildly overstated the projected deaths in each country under both its “unmitigated” scenario and its NPI-reliant “social distancing” scenario--including by orders of magnitude in several cases.
Similar exaggerations may be found in almost every other country where Imperial released projections, even as most of them opted to lock down. The Imperial team’s most conservative model predicted 332,000 deaths in France under lockdown-based “social distancing” and 621,000 with “unmitigated” spread. At the one year mark, France had incurred 94,000 deaths. Belgium was expected to incur a minimum of 46,000 fatalities under NPI mitigation, and 91,000 with uncontrolled spread. At the one year anniversary of the model, it reached 23,000 deaths – among the highest tolls in the world on a per capita basis and an example of extreme political mismanagement of the pandemic under heavy lockdown to be sure, but still only half of Imperial College’s most conservative projection for NPI mitigation.
Just over one year ago, the epidemiology modeling of Neil Ferguson and Imperial College played a preeminent role in shutting down most of the world. The exaggerated forecasts of this modeling team are now impossible to downplay or deny, and extend to almost every country on earth. Indeed, they may well constitute one of the greatest scientific failures in modern human history.”
……………………………………
Added: Neil Ferguson himself says his Covid code [that so impressed Trump] was written 13 years ago (2007) to model an influenza (not a coronavirus) pandemic. Via LockdownSceptics.org, 2/28/2021, Derek Winton:
……………………………………
Added: “Prof Ferguson advises the UK and US governments, WHO and the EU on emerging infections and modelling.” Nervtag stands for “New and Emerging Respiratory Virus Threats Advisory Group.”
From Nervtag bios, 4/25/21:
……………………………………..
“Professor Neil Ferguson predicted Britain was on course to lose 250,000 lives during the coronavirus epidemic.”…
“In 2001, as foot and mouth disease (FMD) broke out in parts of Britain, Ferguson and his team at Imperial College produced predictive modelling – which was later criticised as “not fit for purpose.”
At the time, however, it proved highly influential and helped to persuade Tony Blair’s government to carry out a widespread pre-emptive culling which ultimately led to the deaths of more than six million cattle, sheep and pigs. The cost to the economy was later estimated at £10 billion.
The model produced in 2001 by Professor Ferguson and his colleagues at Imperial suggested that the culling of animals include not only those found to be infected with the virus but also those on adjacent farms even if there was no physical evidence of infection.
“Extensive culling is sadly the only option for controlling the current British epidemic, and it is essential that the control measures now in place be maintained as case numbers decline to ensure eradication,” said their report, published after the cull began. [May 2001 report in Science, Ferguson lead author.]
The strategy of mass slaughter–known as contiguous culling – sparked revulsion in the British public and prompted analyses of the methodology which has led to it.
A 2011 paper, Destructive Tension: mathematics versus experience – the progress and control of the 2001 foot and mouth epidemic in Great Britain, found that the government ordered the destruction of millions of animals because of “severely flawed” modelling.
According to one of its authors--the former head of the Pirbright Laboratory at the Institute for Animal Health, Dr Alex Donaldson – Ferguson’s models made a “serious error” by “ignoring the species composition of farms,” and the fact that the disease spread faster between some species than others.
The report stated: “The mathematical models were, at best, crude estimations that could not differentiate risk between farms and, at worst, inaccurate representations of the epidemiology of FMD.”
It also described a febrile atmosphere – reminiscent of recent weeks [in March 2020]--and claimed that this allowed mathematical modellers to shape government policy."…
Added: In 2001, Neil Ferguson’s unvalidated predictive models resulted in brutal slaughter of millions of healthy animals. In 2001, “In fact, the epidemic peak preceded the start of pre-emptive contiguous culling.…(p, 6) It was carnage by computer.” (9, 84)
From 2006 Abstract, Kitching, Thrusfield and Taylor:
“During the 2001 epidemic of FMD in the United Kingdom (UK), this approach [killing infected animals] was supplemented by a culling policy driven by unvalidated predictive models. The epidemic and its control resulted in the death of approximately ten million animals, public disgust with the magnitude of the slaughter….Page 6: “In fact, the epidemic peak preceded the start of pre-emptive contiguous culling.…It was carnage by computer’ (9, 84). This graphically exemplifies the isolation and abstraction of ‘armchair epidemiology’"….(75)….Page 6: “Modelling and scientific method:” “The disparity between the course of the 2001 epidemic and the model predictions demands an explanation. The numerical output of models has an air of intellectual superiority…while also seeming entirely appropriate in a society where numbers can ‘…reassure by appearing to extend control, precision and knowledge beyond their real limits…wrong numbers, one might add, are worst of all because all numbers pose as true’ (11). Numbers, therefore, may convey an illusion of certainty and security that is not warranted (43);…A model constitutes a theory, and a predictive model is therefore only a theoretical projection.…The degree of confidence in the 2001 predictive models is therefore low because they were not widely tested, and their conclusions (e.g. that pre-emptive contiguous culling was necessary to control the epidemic) have been refuted….The key question for any model is whether decisions made with it are more correct than those made without it (17). However, the consequences of following the recommendations of these [2001] models were severe: economically, in terms of cost to the country; socially, in terms of misery and even suicides among those involved in the slaughter programme; and scientifically, in the abuse of predictive models, and their possible ultimate adverse effects on disease control policy in the future.”…[For example, 2020].
……………………………………..
No comments:
Post a Comment