Skip to content

[Bug]: The mineru program fails to correctly recognize tables when present in PDF files. This might be a bug in the code. #17298

Description

@cuihangrui

Self Checks

  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (Language Policy).
  • Non-english title submitions will be closed directly ( 非英文标题的提交将会被直接关闭 ) (Language Policy).
  • Please do not modify this template :) and fill in all the required fields.

RAGFlow workspace code commit ID

0.26.4

RAGFlow image version

0.26.4

Other environment information

Actual behavior

I used curl to call mineru and the parsing result is as follows

Image However, the information in the table of the Ragflow knowledge base parsing result is garbled. Image Is it due to the following issue? In [mineru_parser.py] (/D:/ragflow-0.26.4/ragflow-0.26.4/deepdoc/parser/mineru_parser.py), RAGFlow calls MinerU/file_parse and then downloads the ZIP file, decompresses and extracts the contents. The problem is most likely in: The encoding of the markdown files in the ZIP is not UTF-8, causing garbled characters when reading The HTML tables in the markdown are wrongly stripped or escaped The subsequent chunk processing disrupts the content of the table

Expected behavior

No response

Steps to reproduce

Is it due to the following issue? In [mineru_parser.py] (/D:/ragflow-0.26.4/ragflow-0.26.4/deepdoc/parser/mineru_parser.py), RAGFlow calls MinerU/file_parse and then downloads the ZIP file, decompresses and extracts the contents. The problem is most likely in:
The encoding of the markdown files in the ZIP is not UTF-8, causing garbled characters when reading
The HTML tables in the markdown are wrongly stripped or escaped
The subsequent chunk processing disrupts the content of the table

Additional information

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    🐞 bugSomething isn't working, pull request that fix bug.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions