This dataset contains 141 Technical Contradictions extracted from .pdf files of 20 patents, using four Large Language Models: claude-sonnet-4, gpt-4.1, qwen3:32b and llama3.3:70b. Each extracted Technical Contradiction was manually assessed as either correct, or not (123 correct in total). Also, for each contradiction, a hallucination label (0/1) is provided, whether the contradiction can be inferred from the patent document (0) or not (1). Additionally, a prompt used to extract those contradictions is provided in .j2 format, including \n\nThe dataset was created as a result of the research project titled: \"Analysis of the effectiveness of Large Language Models (LLM) in identifying technical contradictions\", funded by the National Science Centre, Poland, grant no.: 2024/08/X/ST8/00391. Results for open-source models were\nobtained using resources provided by the Wroclaw Centre for Networking and Super-\ncomputing (http://wcss.pl).
przedsiębiorcy
naukowcy
Dziedzina nauk inżynieryjno-technicznych / inżynieria mechaniczna (2018)
Technical Contradictions extracted from patent documents
TRIZ
llm
contradiction
Patent
patent
sonnet