AI-generated sports news.

Gannett Stops Using AI To Write Articles For Now Because They Were Hilariously Terrible https://www.techdirt.com/2023/09/01/gannett-stops-using-ai-to-write-articles-for-now-because-they-were-hilariously-terrible/

#NLP #NLProc #generativeAI #SportsJournalism

4/

[3] Dhananjay Ashok and Zachary C. Lipton. 2023. PromptNER: Prompting For Named Entity Recognition. http://arxiv.org/abs/2305.15444

[4] https://paperswithcode.com/sota/named-entity-recognition-ner-on-conll-2003

[5] https://paperswithcode.com/sota/named-entity-recognition-on-genia

#NLP #NLProc #KnowledgeGraph #Paper

3/

REFERENCES

[1] Previous posts on ICL and why it works: https://www.linkedin.com/posts/benjaminhan_llms-iclr2023-mastodon-activity-7093281970792632320-XE87, https://www.linkedin.com/posts/benjaminhan_generativeai-gpt4-llm-activity-7045542002947457024-bGPt/, https://www.linkedin.com/posts/benjaminhan_llms-gpt3-nlp-activity-7073726814170337280-EED5/

[2] https://news.ycombinator.com/item?id=37443921

#NLP #NLProc #KnowledgeGraph #Paper

Ee constructed a scientific biomedical knowledge graph (s-BKG) comprising relationships between drugs, diseases, and genes derived from biomedical databases. Our protocol involves identifying drugs that exhibit limited association with the target disease but are closely located in the s-BKG, as potential drug candidates.

https://arxiv.org/pdf/2309.03227
#NLP #Healthcare

First was a nice talk by Boago Okgetheng on an #NLP system for Setswana and a panel on the startup journey of Amathambo AI with Ian Omung'a, Kira Düsterwald, and Sicelukwanda Zwane at #Indaba2023. This impressive, inspiring work to learn about https://www.youtube.com/watch?v=lBOO7iJPADA (2/11) #startups

The ability to generate responses with factually accurate content and to engage in non-trivial reasoning steps are crucial for the LLMs to be eligible for applications in clinical medicine. Employing a combination of techniques including instruction-tuning and in-prompt strategies like few-shot and chain of thought prompting has significantly enhanced the performance of LLMs.

https://arxiv.org/pdf/2309.02884
#NLP #Healthcare

In preparation for my talk today on #nlp #llm and #machinelearning, I took the time to write down some thoughts on how I think NLP/LLM apps should progress to make them safer for real business use.

Comments/thoughts/corrections appreciated:
https://www.jason-grey.com/posts/2023/nlp-maturity-model/

And a link for the talk:
https://www.warecorp.com/event/ai-for-natural-language-processing-1/register

Next was a nice group of short talks on various startups/projects at #Indaba2023. I particularly liked the talks by Asmelash Teka Hadgu and Paul Azunre with targeted #NLP approaches https://www.youtube.com/watch?v=F21GuEZ8EoY (6/11) #startups #Africa

We introduce a novel light-weight graph-based embedding method specifically catering radiology reports. It takes into account the structure and composition of the report, while also connecting medical terms in the report through the multi-lingual SNOMED Clinical Terms knowledge base.

https://arxiv.org/pdf/2309.00917
#NLP #Healthcare

We present a novel technique called ReOnto, that makes use of neuro symbolic knowledge for the RE task. ReOnto employs a graph neural network to acquire the sentence representation and leverages publicly accessible ontologies as prior knowledge to identify the sentential relation between two entities.

https://arxiv.org/pdf/2309.01370
#NLP #Healthcare

We present FlaMBé (Flow annotations for Multiverse Biological entities), a collection of expert-curated datasets across a series of complementary tasks that capture procedural knowledge in biomedical texts.

https://arxiv.org/pdf/2309.01812
#NLP #Healthcare

This paper introduces an automated evaluation framework that assesses the practical capabilities of LLMs as virtual doctors during multi-turn consultations. A benchmark is proposed by reformulating medical multiple-choice questions from the United States Medical Licensing Examinations (USMLE).

https://arxiv.org/pdf/2309.02077
#NLP #Healthcare

We investigate the potential benefit of incorporating dictionary information into a neural network architecture for natural language processing. In particular, we make use of this architecture to extract several concepts related to COVID-19 from an on-line medical forum.

https://arxiv.org/pdf/2309.02188
#NLP #Healthcare

In this study, we present the Large-scale Language Models Augmented with Medical Textbooks (LLM-AMT), which integrates authoritative medical textbooks as the cornerstone of its design, enhancing its proficiency in the specialized domain through plug-and-play modules, comprised of a Hybrid Textbook Retriever, supplemented by the Query Augmenter and the LLM Reader.

https://arxiv.org/pdf/2309.02233
#NLP #Healthcare

In this article, we create synthetic large-scale clinical notes using publicly available case reports extracted from biomedical literature. We then use these synthetic notes to train our specialized clinical large language model, Asclepius. Our findings convincingly demonstrate that synthetic clinical notes can serve as viable substitutes for real ones.

https://arxiv.org/pdf/2309.00237
#NLP #Healthcare

People often talk at cross-purposes without even realizing.

What happens when we do it at scale?

When it comes to NLP, sorting the science from the pseudo-science is the first step toward a meaningful conversation about the ethical concerns we can no longer ignore.

#NLP #programming #linguistics #language #Medium #history #communication

https://medium.com/@KimWitten/nlp-is-not-what-you-think-21ed3d031c71?sk=c00b0bea475a70bb7bc2faa98f26ab29

Of the 3 papers I co-reviewed for #emnlp2023 , 2 used chatgpt for generation or evaluation.

Does anyone see a problem with littering our research with proprietary, black-box baselines?

#nlproc #nlp #OpenScience

I've started a personal research prooject aiming to make #NLP systems more factually reliable

https://playfultechnology.co.uk/qarac-question-answering-reasoning-and-consistency.html

I'd like somebody from @DAIR to take a look at it and tell me what #AIEthics considerations I should be taking into account
@timnitGebru @emilymbender

@data_science

11/end

[3] Previously: “Model Editing: Performing Digital Brain Surgery”. https://www.linkedin.com/posts/benjaminhan_llms-causal-papers-activity-7101756262576525313-bIge

[4] Shirui Pan, Linhao Luo, Yufei Wang, Chen Chen, Jiapu Wang, and Xindong Wu. 2023. Unifying Large Language Models and Knowledge Graphs: A Roadmap. http://arxiv.org/abs/2306.08302

#KnowledgeGraphs #GenerativeAI #LLMs #NLP #NLProc #Paper

8/ There are surely other benefits of using KGs to collect and organize knowledge. They do not require costly retraining to update, therefore can be updated more frequently to remove obsolete or incorrect facts. They allow more trackable reasoning and can offer better explanations. They make fact editing more straightforward and accountable (think of GDPR) compared to model editing [3].

#KnowledgeGraphs #GenerativeAI #LLMs #NLP #NLProc #Paper