I am looking for a tool or workflow for Linux that can convert handwritten mathematical formulas into clean, rendered, readable formulas, ideally without depending on paid services such as Mathpix.
I am not necessarily looking for a smart whiteboard that recognizes an entire page in real time. I understand that full handwritten mathematical expression recognition is difficult. Instead, I am thinking about a simpler and more realistic workflow:
-
Write formulas by hand in an app such as Xournal++, Excalidraw, Rnote, or any digital whiteboard.
-
Take small screenshots by sections: one fraction, one integral, one square root, one short equation, one matrix, etc.
-
Send each screenshot to an application that recognizes the formula.
-
Let the application internally convert the image to LaTeX, MathML, or another math format.
-
Show the result directly as a rendered formula, not as code.
-
Allow copying the result as an image, SVG, or transparent PNG.
-
Ideally, provide a second panel or canvas where multiple rendered fragments can be arranged and combined into a larger expression or a complete math page.
Main goal:
Create or find an application with two panels:
-
Left panel: the original handwritten image or screen capture.
-
Right panel: the clean, rendered, readable mathematical result.
It would also be useful to have basic tools to:
-
accept or reject each fragment,
-
retry recognition,
-
copy the output as image/SVG,
-
move, align, and combine fragments,
-
export the final result as PNG, SVG, or PDF.
I am not necessarily looking for the user to see or write LaTeX code. LaTeX could be used internally, but the user experience should be visual: write, capture, convert, and obtain a clean formula.
I know projects such as pix2tex / LaTeX-OCR and Pix2Text exist, but I do not know of a free and polished application that combines fragment-based recognition, immediate rendering, and a canvas to assemble multiple sections.
Does anyone know of a free, local, or partially local tool that already does this?
Is there any project in development with this idea?
Would it be feasible to build a simple interface using pix2tex, KaTeX/MathJax, and a small screenshot tool?