http://id.e-science.pl/records/83188
type: Database
acceptance date: 2025-09-29
author info: AuthorInfo
  affiliation: http://id.e-science.pl/vocab/unit/7098
  author: http://id.e-science.pl/vocab/person/8760
  position: 1
collection: http://id.e-science.pl/vocab/collection/1
creation year: 2025
description: This dataset contains 141 Technical Contradictions extracted from .pdf files of 20 patents, using four Large Language Models: claude-sonnet-4, gpt-4.1, qwen3:32b and llama3.3:70b. Each extracted Technical Contradiction was manually assessed as either correct, or not (123 correct in total). Also, for each contradiction, a hallucination label (0/1) is provided, whether the contradiction can be inferred from the patent document (0) or not (1). Additionally, a prompt used to extract those contradictions is provided in .j2 format, including \n\nThe dataset was created as a result of the research project titled: \"Analysis of the effectiveness of Large Language Models (LLM) in identifying technical contradictions\", funded by the National Science Centre, Poland, grant no.: 2024/08/X/ST8/00391. Results for open-source models were\nobtained using resources provided by the Wroclaw Centre for Networking and Super-\ncomputing (http://wcss.pl).
destination group: przedsiębiorcy @pl
destination group: naukowcy @pl
file info: FileInfo
  name: prompt-fdc97c0c.md
  uri: https://data.e-science.pl/83188/prompt-fdc97c0c.md
file info: FileInfo
  name: contradictions-fdc97c0c.json
  uri: https://data.e-science.pl/83188/contradictions-fdc97c0c.json
file info: FileInfo
  name: schema-dfc97c09c.json
  uri: https://data.e-science.pl/83188/schema-dfc97c09c.json
harmful content: false
keyword info: KeywordInfo
  name: TRIZ
  uri: http://id.e-science.pl/vocab/kv/52868
keyword info: KeywordInfo
  name: llm
  uri: http://plwordnet.pwr.wroc.pl/wordnet/synset/321038
keyword info: KeywordInfo
  name: TRIZ @pl
  uri: http://id.e-science.pl/vocab/kv/c119415
keyword info: KeywordInfo
  name: contradiction
  uri: http://plwordnet.pwr.wroc.pl/wordnet/synset/323840
keyword info: KeywordInfo
  name: Patent @pl
  uri: http://aims.fao.org/aos/agrovoc/c_5627
keyword info: KeywordInfo
  name: patent
  uri: http://plwordnet.pwr.wroc.pl/wordnet/synset/271846
keyword info: KeywordInfo
  name: sonnet
  uri: http://plwordnet.pwr.wroc.pl/wordnet/synset/375490
language: Angielski
license info: LicenseInfo
  name: CC BY-SA 4.0
  uri: https://creativecommons.org/licenses/by-sa/4.0/legalcode.pl
origin: OTHER
partner: Organization
  name: Politechnika Wrocławska
place of creation: Politechnika Wrocławska
scientific discipline: Dziedzina nauk inżynieryjno-technicznych / inżynieria mechaniczna (2018) @pl
submitter: Person
  name: Marek Mysior
title: Technical Contradictions extracted from patent documents