<?xml version="1.0"?>
<article xlink="http://www.w3.org/1999/xlink" mml="http://www.w3.org/1998/Math/MathML" xsi="http://www.w3.org/2001/XMLSchema-instance" ali="http://www.niso.org/schemas/ali/1.0/" noNamespaceSchemaLocation="http://jats.nlm.nih.gov/publishing/1.1/xsd/JATS-journalpublishing1-mathml3.xsd" article-type="research-article" dtd-version="1.1" lang="en"><front><journal-meta><journal-id journal-id-type="publisher-id">isrdo-SRJSET</journal-id><journal-id journal-id-type="pmc">isrdo-SRJSET</journal-id><journal-id journal-id-type="nlm-ta">isrdo-SRJSET</journal-id><journal-title-group><journal-title>Scientific Research Journal of Science, Engineering and Technology</journal-title><abbrev-journal-title abbrev-type="publisher" pub-type="epub">SRJSET</abbrev-journal-title></journal-title-group><issn>2584-0584</issn><publisher><publisher-name>ISRDO</publisher-name><publisher-loc>Gujarat,India</publisher-loc></publisher></journal-meta><article-meta><article-id pub-id-type="publisher-id">M-10133</article-id><article-id pub-id-type="doi"/><article-categories><subj-group subj-group-type="categories"><subject>Information Technology</subject></subj-group></article-categories><title-group><article-title>Implementation Approach for Duplicate Image Identification and Removal</article-title></title-group><contrib-group content-type="authors"><contrib id="188" contrib-type="author" corresp="yes"><name><given-names>Zaw Ye Htet</given-names></name><xref ref-type="aff" rid="aff-1">1</xref><aff id="aff-1"><label>0</label><institution>Yangon Technological University</institution><country>Myanmar</country></aff></contrib><contrib id="189" contrib-type="author" corresp="yes"><name><given-names>Tin Shine Aung</given-names></name><xref ref-type="aff" rid="aff-2">2</xref><aff id="aff-2"><label>1</label><institution>Yangon Technological University</institution><country>Myanmar</country></aff></contrib></contrib-group><contrib-group content-type="editors"><contrib contrib-type="editor"/></contrib-group><pub-date pub-type="epub" data-type="pub" iso-8601-date="2024-07-30"><day>30</day><month>07</month><year iso-8601-date="2">2024</year></pub-date><volume>2</volume><elocation-id>V2-I1-2024</elocation-id><history><date date-type="received" iso-8601-date="2024-07-25"><day>25</day><month>07</month><year iso-8601-date="2024">2024</year></date><date date-type="revised" iso-8601-date="2024-07-28"><day>28</day><month>07</month><year iso-8601-date="2024"/></date><date date-type="accepted" iso-8601-date="2024-07-28"><day>28</day><month>07</month><year iso-8601-date="2024"/></date></history><permissions><copyright-statement>&#xA9;2024 Tin Shine Aung Year Corresponding Author</copyright-statement><copyright-year>2024</copyright-year><copyright-holder>Tin Shine Aung</copyright-holder><license href="https://creativecommons.org/licenses/by/4.0/"><license-p>This is an open access article distributed under the terms of the, which permits unrestricted use, distribution, reproduction and adaptation in any medium and for any purpose provided that it is properly attributed. For attribution, the original author(s), title, publication source (ISRDO) and either DOI or URL of the article must be cited.<ext-link ext-link-type="uri" href="https://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution License</ext-link></license-p></license></permissions><self-uri href="https://isrdo.org/journal/SRJSET/currentissue/implementation-approach-for-duplicate-image-identification-and-removal"/><abstract><p>This paper presents a systematic approach for identifying and removing duplicate images from various 3D image format collections. The identification process considers image structure, density, meta descriptions, and other properties. The system employs a preprocessing module to standardise and extract meta descriptions from diverse formats like STL, OBJ, FBX, and others. A vector database, utilising tools like FAISS or Milvus, stores the image vectors and meta descriptions for efficient similarity searches. Deep learning models, particularly Convolutional Neural Networks (CNNs), are trained to extract image features and compare vectors using cosine similarity or Euclidean distance. An integrated search engine allows users to find similar images by uploading an image and its meta description. A human validation interface is provided for manual confirmation of potential duplicates. This approach ensures efficient management and retrieval of 3D images while enhancing storage utilisation. Future work will further explore alternative models and similarity measures to improve system accuracy and efficiency.</p></abstract><kwd-group kwd-group-type="author"><kwd>Duplicate image identification</kwd><kwd> 3D image formats</kwd><kwd> image structure</kwd><kwd> image density</kwd><kwd> meta descriptions</kwd><kwd> preprocessing module</kwd><kwd> Vision Transformers</kwd></kwd-group><funding-group><funding-statement>No grants from public, commercial, or non-profit funding agencies supported the research, authorship, or publication of this article.</funding-statement></funding-group></article-meta></front><back><sec sec-type="data-availability"><title>Data Availability</title><p>There are no data available for sharing in this work.</p></sec><sec sec-type="COI-statement"><title>Conflicts of Interest</title><p>The authors disclose no conflicts of interest in relation to this work.</p></sec><sec sec-type="author-contributions"><title>Authors&#x2019; Contributions</title><p>The study's design, data collection, result analysis, and manuscript preparation were entirely managed by the author.</p></sec><sec sec-type="funding-statement"><title>Funding Statement</title><p>No grants from public, commercial, or non-profit funding agencies supported the research, authorship, or publication of this article.</p></sec><sec sec-type="software-information"><title>software-information</title><p>The research did not involve the use of any particular software or tools.</p></sec><ack><title>Acknowledgments</title><p>My gratitude goes to those who assisted in this study and manuscript preparation, and to the anonymous reviewers for their constructive insights.</p></ack><ref-list content-type="authoryear"><ref id="1"><label>1</label><element-citation publication-type="journal"><p>-</p></element-citation></ref></ref-list></back></article>
