Search Results
Search this site
653 results found with an empty search
- News Feature: Predatory Journals and Paper Mills
March 28, 2023, #34 A paper mill is a journal that publishes large numbers of papers with little quality control, while a predatory journal lures authors into paying for publication with dubious quality promises. They are related but not identical. Ellie Kincaid writes in the Retraction Watch Blog on 21 March 2022 that Clarivate "dropped more than 50 journals from its indexes in March … for failing to meet 24 quality criteria such as adequate peer review, appropriate citations, and content that’s relevant to the stated scope of the journal."¹ Nineteen of the journals belonged to the open access publisher Hindawi, which Wiley now owns. Delisting can hurt authors directly because, as Kincaid explains, "Clarivate will no longer index its papers, count their citations, or give the title an impact factor, which can have negative effects for authors, as universities rely on such metrics to judge researchers’ work for tenure and promotion decisions."¹ Delisting does not necessarily mean that the journals are predatory, though it can. The problem for authors is to recognise when a journal is predatory. Florence Cook, Roganie Govender, and Peter A. Brennan write in the British Journal of Oral and Maxillofacial Surgery: "Predatory publishers, also known as counterfeit, deceptive, or fraudulent, are organisations that exploit the open-access scholarly model by charging hefty article processing charges (APCs), often without the scientific rigour and ethical processes offered by legitimate journals."² Unfortunately the advice for recognising predatory publishers is often vague: "Common characteristics include inappropriate marketing and misrepresentation of services by targeting individuals with solicitation emails, inadequate peer-review processes, lack of editorial services and transparency about APCs, and false claims about citation metrics and indexing that cannot be verified."² The problem is that these publishers prey on less well established scholars, especially those who are early in their careers, and have no one to turn to for advice. Often they are under heavy pressure to publish in order to retain their positions or get new ones. Universities contribute to the problem indirectly because of the pressure to publish. There is no perfect solution, but asking senior colleagues and being aware will help. 1: Ellie Kincaid, ‘Nearly 20 Hindawi Journals Delisted from Leading Index amid Concerns of Papermill Activity’, Retraction Watch (blog), 21 March 2023, https://retractionwatch.com/2023/03/21/nearly-20-hindawi-journals-delisted-from-leading-index-amid-concerns-of-papermill-activity/ 2: Florence Cook, Roganie Govender, and Peter A. Brennan, ‘Greetings from Your Predatory Journal! What They Are, Why They Are a Problem, How to Spot and Avoid Them’, British Journal of Oral and Maxillofacial Surgery, 4 March 2023, https://doi.org/10.1016/j.bjoms.2023.02.005.
- News Feature: Cloned Journals
April 11, 2023, #35 A cloned journal is one that has taken over a legitimate journal’s “titles, ISSNs, and other metadata without their permission”¹. A hijacked journal typically looks like the original journal (even the website can be mimicked), but there the similarity stops. In the Retraction Watch blog, Anna Abalkina gives the example of the Hong Kong Journal of Social Sciences. “The hijackers’ website mimicked the genuine journal well. The archive of past issues included papers from the genuine journal. Additionally, the clone journal falsely claimed that it was indexed in Scopus and Web of Science and adhered to the ethical principles set by the Committee on Publication Ethics (COPE). Although the papers were published online in English, the title and abstract of each paper were translated into Chinese to make the hijacked journal appear authentic.”¹ The original real journal discovered what happened and tried to inform readers on the University’s website, as quoted in the Blog: “We have been alerted that some English websites have collected payments from authors for publications on the pretext of our Journal’s English and Chinese titles, … The Journal solemnly clarifies that we are an academic journal [that] only publishes papers written in Chinese, and do not charge … authors. If in doubt, please contact us at hkjss@eduhk.hk”¹. The “genuine journal, according to the information on one Chinese website, ceased publishing in 2022.”¹ “Evidence from other cases also suggests that hijackers are particularly interested in cloning journals that have stopped publishing.”¹ We do not know how many journals have been hijacked, and there is no simple way to discover whether a hijacking has taken place. Nonetheless, significant policy shifts can be a signal, such as a move from cost-free publication to for-cost publication. One way of monitoring the problem is to follow the “recently launched [...] Retraction Watch Hijacked Journal Checker”¹ which promises to publish “regular posts”¹: 185 journals are already listed. These News Features have been highlighting a number of ways in which unsuspecting authors can be scammed. It is especially important for early career scholars and doctoral students to be aware of the risks. 1: Abalkina, Anna, ‘A High-Quality Cloned Journal Has Duped Hundreds of Scholars, and Has No Reason to Stop’, Retraction Watch (blog), 4 April 2023, https://retractionwatch.com/2023/04/04/a-high-quality-cloned-journal-has-duped-hundreds-of-scholars-and-has-no-reason-to-stop/.
- News Feature: ChatGPT as a Reviewer Tool
April 17, 2023, #36 On 5 April 2023 Jack Grove wrote an article called “ChatGPT-generated reading list sparks AI peer review debate” in the Times Higher Education. A “Dutch researcher has claimed that a reviewer who rejected his paper recommended a handful of fictitious publications invented by the AI chatbot”¹. The researcher checked the recommendations with GPT-2, which confirmed that “suggestions were AI-generated fakes”¹. The situation puzzled him “because he had received ‘constructive critical responses from this reviewer and the editor’ on the paper across three previous rounds of review.”¹ The overall review showed signs that the person had actually read the paper, and had probably only used an AI tool to create the reading list. According to a spokesperson for Emerald Publishing “ChatGPT and other AI tools should not be utilised by reviewers of papers submitted to journals published by Emerald.”¹ A generous interpretation could be that the reviewer understood the ban only to apply to text. Other stories about AI-based reviews have surfaced on Twitter. “Ben Maier, a German postdoctoral researcher in infectious diseases based at Humboldt University in Berlin, explained that he had been forced to withdraw a submitted paper from a journal after an editor suggested text should be fed into ChatGPT to ‘make it clearer’.”¹ When he tried it, the result was apparently not an improvement. The Committee on Publication Ethics (COPE) guidelines say that “authors should declare the use of AI in scholarly papers, adding that Chat-GPT and other AI chatbots should not be listed as co-authors.”¹ This does not answer the question of whether the use of AI tools like ChatGPT is acceptable for generating reading lists as part of an academic review. It is not unusual for reviewers to rely on technology-based tools for literature reviews, but not all tools are equal. Google Scholar is a tool that relies only on real articles drawn from known sources. ChatGPT and its AI relatives may be displaying an almost human adolescent urge to invent rather than research. Adolescents grow up, and AI may too. 1: Jack Grove, ‘“ChatGPT-Generated Reading List” Sparks AI Peer Review Debate’, Times Higher Education (THE), 5 April 2023, https://www.timeshighereducation.com/news/chatgpt-generated-reading-list-sparks-ai-peer-review-debate
- News Feature: AI Detection
April 25, 2023, #37 ChatGPT and other AI writing tools have been in the news regularly, with widespread interest among universities in finding detection tools. In January 2023 Nadine Yousif wrote an article for BBC News called “ChatGPT: Student builds app to sniff out AI-written essays”. She reported on Princeton senior Edward Tian, who built “an application that can determine, with high accuracy, if a text was written by a human or a bot.” He called his app GPTZero. “The app works by looking at two variables in a text - perplexity and burstiness - and it assigns each of those variables a score.”¹ The first factor depends on how similar the text is to the texts it was trained on. A high level of perplexity means that the text is “more likely to be human-written”.¹ The relevance of this variable may depend on knowing which sources the AI had at its disposal, and that will likely depend on the topic. The other factor is “burstiness” meaning the “mix of short versus long sentences” rather than sentences that are “more levelled and uniform”.¹ “‘If you plot precisely over time, a human-written article will vary a lot,’ Mr Tian said. ‘It would go up and down, it would have sudden spikes.’"¹ His test results were definitely good: GPTZero had “less than 2% false positive rate” in tests when he fed “the app BBC articles written by journalists, versus articles written by ChatGPT using the same headline as a prompt.” A clear danger here is that people will assume an even higher level of reliability, rather than think about what affects GPTZero’s accuracy. One factor could be knowing probable original sources. Guessing those sources could be easier under controlled circumstances such as university classes, where the topics are known. Another factor is the language of the suspicious text, since not all languages will show the same “burstiness”. What is important here is not just the tool itself, which will likely change over time, but how Edward Tian approached the problem, which others can and should learn from. Special thanks goes to our colleague Isaac Sserwanga, who brought this to our attention. 1: Nadine Yousif, ‘ChatGPT: Student Builds App to Sniff out AI-Written Essays’, BBC News, 13 January 2023, sec. US & Canada,https://www.bbc.com/news/world-us-canada-64252570.
- News Feature: Detecting Fake Scientific Papers
May 16, 2023, #39 Jeffrey Brainard wrote in Science about how ‘Fake Scientific Papers Are Alarmingly Common; But New Tools Show Promise in Tackling Growing Symptom of Academia’s “Publish or Perish” Culture. This problem is well known, but the development of tools to address the growth of fake papers is less so, perhaps because detection itself is a complex art. Neuropsychologist Bernhard Sabel tested his “fake-paper detector” by screening 5,000 papers. His results suggest that “up to 34% of neuroscience papers published in 2020 were likely made up or plagiarized; in medicine, the figure was 24%.”¹ Not everyone is convinced. “Sabel’s tool relies on just two indicators - authors who use private, noninstitutional email addresses, and those who list an affiliation with a hospital.”¹ The rationale for the choice of email addresses as an indicator is open to debate, and the fact that the tool has “a high false-positive rate”¹, undercuts the value of Sabel’s statistics, but at least he is transparent about how his tool works. The “International Association of Scientific, Technical, and Medical Publishers (STM), representing 120 publishers, is leading an effort called the Integrity Hub to develop new tools.”¹ Nonetheless they are “not revealing much about the detection methods, to avoid tipping off paper mills.”¹ Whether that is the whole reason, or whether some hope of commercialization lies behind their reluctance to speak openly is unknown. Automating detection is certainly economically important: “in 2021, Springer Nature’s postpublication review of about 3000 papers suspected of coming from paper mills required up to 10 part- and full-time staffers, said Chris Graf, the company’s director of research integrity…”¹ This cost could be one reason why serious publishers are expensive. Nonetheless small steps matter. “Adam Day, founding director of a startup called Clear Skies”¹ notes that flagging suspect journals helps and “points to his analysis of journals that the Chinese Academy of Sciences (CAS) put on a public list because of suspicions they contained paper mill papers.”¹ As Brainard suggests in his title, the “publish or perish” culture is part of the problem. While colleagues at even top universities may feel implicit social pressure to publish, the explicit “publish or perish" rules often reflect the anxiety of administrators who take comfort in the clarity of numerical rankings regardless of its effect on research fraud. 1: Jeffrey Brainard, ‘Fake Scientific Papers Are Alarmingly Common; But New Tools Show Promise in Tackling Growing Symptom of Academia’s “Publish or Perish” Culture’, 9 May 2023,https://www.science.org/content/article/fake-scientific-papers-are-alarmingly-common.
- News Feature: US Banned Books
May 23, 2023, #40 On 20 April 2023 Kasey Meehan and Jonathan Friedman wrote about “2023 Banned Books Update: Banned in the USA” in the PEN America blog (PEN is a US nonprofit corporation whose acronym stood originally for “Poets, Essayists, Novelists”). The authors write: “The 2022-23 school year has been marked to date by an escalation of book bans and censorship in classrooms and school libraries across the United States.”¹ Censorship is by no means unique to the United States, but the growth of this problem in the US has alarmed many librarians and academics. Censorship inevitably has a political component, in the US historically with a conservative flavour. Some topics are more often banned than others, especially ones involving sex, violence, and race. Here are some categories from the blog: books mentioning violence and physical abuse (44%), health and well-being (38%), grief and death (30%), themes of race and racism (30%), LGBTQ+ characters or themes (26%), detail sexual experiences between characters (24%), and teen pregnancy, abortion, or sexual assault (17%). A goal of many of these books is to create awareness about sensitive issues. The authors explain their collection methodology and provide a definition for what counts as part of a ban: “any action taken against a book based on its content and as a result of parent or community challenges … that leads to a previously accessible book being either completely removed from availability to students, or where access to a book is restricted or diminished.”¹ Vague laws are part of the problem. “Due to the lack of clear guidance, … three [Florida] laws have each led teachers, media specialists, and school administrators to proactively remove books from shelves…”¹ The laws also sometimes include penalties, like taking away the certification of teachers who violate the bills. School and library censorship can affect those who graduate from our programs. Such book bans vary by topic and country. The US is just an example where statistics are readily available. 1: Kasey Meehan and Jonathan Friedman, ‘2023 Banned Books Update: Banned in the USA’, PEN America (blog), 20 April 2023, https://pen.org/report/banned-in-the-usa-state-laws-supercharge-book-suppression-in-schools/.
- News Feature: Narrative CVs
May 30, 2023, #41 In a Leiden Madtrics blog post called “Narrative CVs: A New Challenge and Research Agenda" a group of authors led by Wolfgang Kaltenbrunner consider “a recent wave of initiatives to introduce so-called narrative CV formats by research funding bodies and universities across Europe”¹. The goal is to correct for “an overemphasis on publication- and funding-centric quality criteria”¹ since the traditional CV format reduces “complex comparative assessments in peer review to simple quantitative tallying…”¹ The authors organised a workshop to understand the effectiveness of Narrative CVs. There appears to be no simple standard for what constitutes a Narrative CV, and the workshop considered possible risks from using Narrative CVs because people would share more “personal details such as sexual orientation, age, ethnic origin or simply particular life choices”¹. Crafting a Narrative CV could allow for “focusing also on desirable but usually somewhat undervalued aspects like actively practising Open Science, communication and engagement with society, teaching, or exerting leadership in innovative ways.”¹ One of the advantages could be that “[t]he narrative CV in principle allows for showcasing diverse trajectories through academic research, for example in the sense of creating room to document experience working in other fields, professions, or experimenting with novel methods.”¹ A problem is “the time required to craft and evaluate narratives, which will often be significant.”¹ The authors note that there is a risk that candidates try to optimise their Narrative for particular kinds of funding, and that consultants could be involved in the polishing process. Reinventing the CV will not be easy, and may require compromise: “Rather than creating a sharp distinction between narrative and non-narrative, most organizations adopting such formats aim for a hybrid document that combines more traditional list-based information with narrative elements.”¹ Narrative CVs represent an ongoing concern about fair evaluation in the academic world. Nonetheless most candidates for jobs or for grants already expect to frame their credentials and strengths in order to convince readers. Perhaps Narrative CVs just give applicants another way to present their case. 1: Wolfgang Kaltenbrunner et al., ‘Narrative CVs: A New Challenge and Research Agenda’, 15 March 2023, https://www.leidenmadtrics.nl/articles/narrative-cvs-a-new-challenge-and-research-agenda.
- News Feature: Factory-Farming of Articles
June 13, 2023, #42 On 4 June 2023, Manuel Ansede wrote an article about “A researcher who publishes a study every two days reveals the darker side of science”¹ in the Spanish newspaper EL PAÍS, which has a section on Science and Technology. The prolific author in question is José Manuel Lorenzo who had “his name on 176 papers last year”¹. It was possible only via questionable collaborations. Lorenzo “and some researchers from India and Saudi Arabia published an article on the treatment of gum disease with bee venom. In a telephone conversation with EL PAÍS, Lorenzo admits that he doesn’t know any of these co-authors in person, nor is he an expert on any of these issues.”¹ Such things happen, Ansede notes, when “Researchers are under brutal pressure to publish studies. Their salary increases, promotions, project funding and social prestige depend on evaluations in which their performance is measured practically by weight.”¹ Some paper mills in India offer co-authorship “in exchange for money.”¹ When EL PAÍS “requested price rates from one of the Indian companies that sends their offers to Spanish scientists”¹ the company “offered the possibility of being the first author of a study that was already written … in exchange for about $500.“¹ The paper mill promised “to publish these ready-made studies in the journals of the world’s leading scientific publishers: Elsevier, Taylor & Francis, Springer Nature, Science and Wiley.”¹ Whether that would happen is less clear. Ansede blames the problem on the change from a reader-pays subscription model to an author-pays model combined with the rise of profitable mega-journals. Factory-farmed articles fed to mega-journals are unlikely to cease in the near future because they make money. Such articles are as much of a curse for serious scientific publishers as for universities, since a serious review process whose goal is to weed out fake research represents a non-trivial expense. Responsibility for the flood of unreliable articles may ultimately lie with universities and governmental organisations that distribute rewards based primarily on quantity rather than quality. Quality takes more effort than checking publication statistics, but serious assessment may be more cost-effective in the long run than the damage that fake scholarship does daily. 1: Manuel Ansede, ‘A Researcher Who Publishes a Study Every Two Days Reveals the Darker Side of Science’, EL PAÍS English, 4 June 2023, https://english.elpais.com/science-tech/2023-06-04/a-researcher-who-publishes-a-study-every-two-days-reveals-the-darker-side-of-science.html.
- News Feature: Conference Proceedings
June 20, 2023, #43 In the Retraction Watch blog on 15 June 2023, Frederik Joelving wrote that a “Plague of Anomalies in Conference Proceedings Hint at ‘Systemic Issues’”¹ His example is “the U.S.-based Institute of Electrical and Electronic Engineers (IEEE)”¹ where the concern is that “hundreds of conference papers … show signs of plagiarism, citation fraud and other types of scientific misconduct…”¹ This is a serious criticism toward a highly respected organisation. Some of the critique comes from Kendra Albert, a “clinical instructor at Harvard Law School and a lecturer in women, gender, and sexuality at Harvard University”¹, who has worked with Guillaume Cabanac, “a professor of computer science at the University of Toulouse”¹. They use the tool Problematic Paper Screener which “flags tortured phrases”¹ that may suggest copying or the use of “paraphrasing software that also renders scientific terminology near-unintelligible”¹. This is apparently not the first time that IEEE has faced problems that forced them to retract. Last year IEEE withdrew “400 conference papers at once, and “[i]n previous years, IEEE has retracted thousands of papers, accounting for a sizable chunk of the retractions”¹ in the Retraction Watch database. One reason for the problem may be reviewing practices. A concerned author was told that “it was standard procedure to recruit reviewers from the host institution, which also supplied most of the papers for the conference…”¹. A critique writes: “[T]hey [...] motivate all the faculty members and students to submit a low quality article which will be accepted through a fake peer review by a fellow colleague…”¹ This means “a large number of ostensibly peer-reviewed publications for the host institution”¹. It is hard for publishers to police the peer review process of every organisation that publishes with them and of course, the more organisations that use a publisher’s platform, the better for the publisher. The iSchools make every effort to avoid conflicts of interest of this sort through a carefully managed reviewer selection process. This is one reason why staff handle this, rather than leaving it to the hosts. 1: Frederik Joelving, ‘Plague of Anomalies in Conference Proceedings Hint at “Systemic Issues”’, Retraction Watch (blog), 15 June 2023, https://retractionwatch.com/2023/06/15/plague-of-anomalies-in-conference-proceedings-hint-at-systemic-issues/.
- News Feature: University Evaluation in the UK
June 27, 2023, #44 In a Science Insider post titled “‘Quietly revolutionary’ plan would shake up the way U.K. universities are evaluated”¹, Cathleen O’Grady writes that “United Kingdom’s four national funding bodies”¹ are changing “the way the labor-intensive Research Excellence Framework (REF) exercise defines ‘excellence’.”¹ Under these changes planned for the 2028 evaluation round “Research culture will get more weight, with less emphasis on publications.”¹ O’Grady writes that previous versions of the REF “have placed too great an emphasis on the number of ‘outputs’—peer-reviewed papers and other publications”¹, effectively prioritizing publication numbers “over long-term projects or contributions such as software development”¹ The new approach would alter the weighting so that “25% of each university’s score will rest on its assessment of ‘people, culture and environment,’ up from 15% in the 2021 REF.”¹ Publication numbers are not an ideal measure of quality, but they do have the virtue of being relatively transparent and equally clear criteria could be hard to find. One of the lead persons for this change appears to be “Catriona Firth, policy lead for research and culture at the national funding body Research England”¹, who “says she and her colleagues will be looking for ‘robust indicators and evidence’ that universities can submit so the assessment ‘goes beyond institutions making claims about how good they are.’”¹ Looking for robust indicators is good, but actually naming them may be harder. Unequal treatment of staff appears to be a problem with the current system. According to Firth the current system “created inequalities and low morale within departments, and incentivized universities to carefully time the end of short-term contracts to keep certain staff out of their REF submissions.”¹ It is never easy to change an evaluation culture. Institutions that were successful in the old culture may be uncomfortable with the new criteria, especially if the criteria are vague. Nonetheless, this change could have positive effects, because many countries and institutions implicitly or explicitly use the REF as a model. Having the UK take the lead in moderating the pressure to publish may also reduce the number of dubious publications around the world. 1: Cathleen O’Grady, “Quietly Revolutionary” Plan Would Shake up the Way U.K. Universities Are Evaluated’, Science Insider, accessed 22 June 2023,https://www.science.org/content/article/quietly-revolutionary-plan-would-shake-way-u-k-universities-are-evaluated.
- News Feature: Data Falsification in an Article about Dishonesty
July 04, 2023, #45 In the blog “Data Colada: Thinking about Evidence and Vice Versa” blog authors Uri Simonsohn, Leif Nelson, and Joe Simmons wrote an “introduction to a four-part series of posts detailing evidence of fraud in four academic papers co-authored by Harvard Business School Professor Francesca Gino. […] In the Fall of 2021, we shared our concerns with Harvard Business School (HBS). Specifically, we wrote a report about four studies for which we had accumulated the strongest evidence of fraud.”¹ The authors do not believe that Gino’s authors were involved in collecting the data. One of the studies with fake data was itself a study on dishonesty. The problem was not with the data collection, but involved tampering afterwards. One goal of the study was to find out whether signing a reporting form at the top or at the bottom made a difference in the honesty of the results. A problem signal was that the data were not sorted correctly. Simonsohn et al. write “There is no way, to our knowledge, to sort the data to achieve this order.”¹ Someone had apparently changed eight observations so that they now gave a very strong result in the predicted direction. “A little known fact about Excel files is that they are literal zip files, bundles of smaller files that Excel combines to produce a single spreadsheet” and a “calcChain” tells Excel what order to use when processing the data.¹ The authors used the “calcChain to go back and see what this spreadsheet may have looked like back in 2010, before it was tampered with”.¹ The Data Colada blog gives an example of how the manipulation took place. The manipulation was technically clever and not difficult to do. One result is that “Gino has gone on ‘administrative leave’, and the name of her chaired position at HBS [Harvard Business School] is no longer listed.”¹ The blog also “heard from some HBS faculty that Harvard’s internal report was ~1,200 pages long…”¹ Assuming all the evidence is true, key questions remain: why would a person with a safe job and good reputation falsify data, and what in our academic incentive structure makes the temptation worthwhile? NOTE: Data Colada has three other articles about data falsification involving Francesca Gino: "My Class Year Is Harvard" (LINK) "The Cheaters Are Out of Order" (LINK) "Forgetting The Words" (LINK) 1: Lief Nelson, Uri Simonsohn, and Joe Simmons, ‘[109] Data Falsificada (Part 1): “Clusterfake”’, Data Colada, 17 June 2023, http://datacolada.org/109.
- News Feature: AI Claim Debunked
July 18, 2023, #46 In an article in the Chronicle of Higher Education on 7 July 2023, Tom Bartlett writes about “‘A Study Found That AI Could Ace MIT. Three MIT Students Beg to Differ.”¹ It seems that “15 authors, including several MIT professors”¹ wrote a study that “found that ChatGPT, the popular AI chatbot, could complete the Massachusetts Institute of Technology’s undergraduate curriculum in mathematics, computer science, and electrical engineering with 100-percent accuracy.”¹ The students found “‘glaring problems’ that amounted to, in their opinion, allowing ChatGPT to cheat its way through MIT classes.”¹ The students who collaborated on the critique were Neil Deshmukh, Raunak Chowdhuri, and David Koplow. The more they looked at the paper, the more they had doubts about the methodology and ultimately about the data. “The study used what’s known as few-shot prompting, a technique that’s commonly employed when training large language models like ChatGPT to perform a task.”¹ But the “examples were so similar to the answers themselves that it was, they wrote, ‘like a student who was fed the answers to a test right before taking it.’”¹ When the authors posted their critique, the positive response to their comments surprised them. It seems that some of the paper’s authors had not expected the paper to be posted as a pre-print. Blame seems to fall on “Iddo Drori, an associate professor of the practice of computer science at Boston University.”¹ “The problems went beyond methodology. Solar-Lezama says that permissions to use course materials hadn’t been obtained from MIT instructors even though, he adds, Drori assured him that they had been.”¹ This may not be the only problematic example. A paper Drori “published last year in the Proceedings of the National Academy of Sciences”¹ made similar exaggerated claims. “Ernest Davis, a professor of computer science at New York University…” provides a balanced perspective: finding the right formulas is one thing, but “deep understanding may well take considerably longer”¹. This story shows how easily the hype about AI can lead to unreliable conclusions. It is also an example of how easily the search for fame can seduce even top professors into becoming involved with unreliable scholarship. 1: Tom Bartlett, ‘A Study Found That AI Could Ace MIT. Three MIT Students Beg to Differ.’, The Chronicle of Higher Education, 7 July 2023, https://www.chronicle.com/article/a-study-found-that-ai-could-ace-mit-three-mit-students-beg-to-differ.











