Turn web pages into clean Markdown for AI and RAG: one row per URL with the main content, title, author, publish date and the page's links split into same-site and external; also works on pages that need JavaScript; pages that cannot be read say why and are not billed. Not affiliated with the websites read
PDF to Markdown
Turn PDF links into clean Markdown for AI and RAG: one row per PDF with headings, paragraphs, lists and tables kept as Markdown tables, multi-column pages read in order, running headers and page numbers removed, plus title, author, page count and creation date. Billed per PDF converted, no start fee; links that are not PDFs, scanned PDFs without text, and blocked downloads get a status row and are not billed. Not affiliated with the sites the files come from
概要
Give it a list of PDF links and get back one row per PDF: the whole document as clean Markdown, plus its title, author, creation date and page count.
Reports, papers, filings, manuals and datasheets still live in PDFs, and most of them are hard for an AI to use as they are: text comes out in the wrong order on multi-column pages, tables turn into a stream of numbers, and every page repeats the same header and footer. This app rebuilds the document as Markdown — headings, paragraphs, lists and tables — so a model can summarize it, answer questions from it or store it in a knowledge base.
Every link gets a row with a clear status: converted, not a PDF, a scan without text, password protected, refused by the site, gone, or not reached because the run was cancelled or ran out of time. You never send 10 links and get 7 rows back without knowing what happened to the other 3, and links that were not converted are not charged.
Data notes
- This app downloads the files at the links you give and converts their format; the documents belong to their publishers, so follow their copyright and terms of use. This is not an official product of any of these sites and is not affiliated with them. The fee covers downloading and conversion, not the documents themselves.
- Tables drawn with ruling lines become Markdown tables. Tables without lines (common in financial statements) come out one line per row, with the cells separated by " | ", so each label stays next to its numbers.
- Pages with two or three columns are read column by column. Running headers, footers and page numbers are removed.
- Headings are recognised from larger or bold section titles; "Title", "Author" and "Created" come from the file's own properties and are left empty when the file does not set them.
- Long PDFs can be read in parts: a row says which page to continue from when the file has more pages than were read.
- Not covered: scanned PDFs without a text layer (no text recognition is done), password-protected files, files over 50 MB, and files behind a login. Images and charts are not described; only their text labels may appear.
What the results look like
Each row is one link.
| Link | Status | Title | Pages read | Tables | Characters |
|---|---|---|---|---|---|
| https://arxiv.org/pdf/1706.03762 | ok | Attention Is All You Need | 15 | 0 | 38743 |
| https://nvlpubs.nist.gov/nistpubs/CSWP/NIST.CSWP.29.pdf | ok | The NIST Cybersecurity Framework (CSF) 2.0 | 32 | 2 | 66146 |
| https://example.com | not_pdf | 0 | 0 | 0 |
Each row also has the Markdown content, the author, creation date, total pages in the file, start page, file size, status details and the time it was read.
Use cases
- Feed an AI: hand "Content (Markdown)" to a model to summarize a report, compare two filings or answer questions about a manual.
- Build a knowledge base: store "Content (Markdown)" with "Title" and "Link" for each document, split it on its headings, and cite the source in answers.
- Pull figures out of reports: tables arrive as rows and columns, so a model or a script can pick out the numbers it needs.
- Clean a document list: filter on "Status" to find links that are dead, refused, scanned or not PDFs at all, and fix or drop them.
適用範囲と境界
Up to 100 PDF links per run and up to 500 pages per PDF (100 by default, from start_page); files over 50 MB are not downloaded. Only PDFs with a text layer are converted: scanned PDFs come back as no_text_layer, no text recognition (OCR) is done. Files are downloaded directly, robots.txt is respected, logins and paywalls are never bypassed. Markdown is cut at about 900 KB per row. Billed per PDF converted; rows for links that were not converted are free. The fee covers downloading and conversion, not the documents themselves
- 適している用途
- You have links to PDF files (papers, annual reports, filings, government reports, manuals, datasheets) and need their text as Markdown for an LLM to read, summarize or answer from, or to load into a RAG knowledge base
- You need tables from PDFs kept as rows and columns rather than jumbled text
- A PDF is longer than your model's context: read it in parts with max_pages and start_page
- 適さない用途
- The link is a web page, not a PDF file: use a web page to Markdown app (such links come back as not_pdf)
- The PDF is a scan or photo without a text layer: no text recognition is done here (it comes back as no_text_layer, not billed)
- The file sits behind a login or a paywall, or needs a password
失敗時の処理
開発者が宣言した失敗時と再試行の動作です。連携時にはシステムプロンプトに含めることをおすすめします。
- 1Every link gets exactly one row, in input order. `status` says what happened; only ok is billed (`billed_pdfs` = 1)
- 2blocked, timeout and error can be retried later; robots_disallowed means the site's robots.txt asks automated readers not to fetch the file
- 3When `pages_read` is less than the pages left in the file, `status_text` says which start_page to use next; `truncated` = true means the Markdown hit the row size limit, so read fewer pages per call
入力
この App の呼び出しに必要なパラメータで、manifest.json の input.schema から生成されています。
- PDF links
urls必須array<string>Links to PDF files, 1–100. Each link gets one row, in the order given. A link given twice is read once (the second row says duplicate).件数最大 100 件例["https://arxiv.org/pdf/1706.03762"] - Max pages per PDF
max_pages任意integerHow many pages of each PDF to read, counted from start_page; 1–500. Pages after that are not read, and the status details say where to continue.範囲1–500デフォルト100 - Start page
start_page任意integerThe first page to read (1 = the first page). Use it to continue a long PDF in a second call; it applies to every link in the run.範囲1–デフォルト1
出力
1 件のレコードのフィールド構造で、manifest.json の output.schema から生成されています。
- Link
input_urlstringThe link as given in the input, to match rows to inputs例https://arxiv.org/pdf/1706.03762 - Final link
final_urlstringThe address the file was downloaded from; differs from the input when the link redirected例https://arxiv.org/pdf/1706.03762 - Status
statusstringok = converted; not_pdf = not a PDF (often a web page); no_text_layer = scan without text; encrypted = password protected; unreadable = damaged file; too_large = over 50 MB; page_out_of_range = start_page is past the last page; robots_disallowed = robots.txt disallows it; not_found = HTTP 404/410; blocked = site refused the download; timeout; dns_error; error; invalid_url; duplicate = same link earlier in the run; not_reached = the run was cancelled or timed out first. Only ok is billed例ok - Status details
status_textstringPlain-English explanation of the status, with the reason when nothing was converted; also says which pages were read when the PDF has more pages, and when the Markdown was cut at the record size limit例Converted
サンプルデータ
output.schema から生成したサンプルです。サンプル値のないフィールドには構造上のプレースホルダーを使用しています。
{
"input_url": "https://arxiv.org/pdf/1706.03762",
"final_url": "https://arxiv.org/pdf/1706.03762",
"status": "ok",
"status_text": "Converted",
"billed_pdfs": 1,
"title": "Attention Is All You Need",
"author": "<author>",
"created_at": "2024-04-10T21:11:43Z",
"page_count": 15,
"start_page": 1,
"pages_read": 15,
"tables_found": 0,
"markdown": "Provided proper attribution is provided, Google hereby grants permission to reproduce the tables and figures in this paper solely for use in journalistic or scholarly works.\n\n# Attention Is All You Need\n\n...",
"char_count": 38757,
"truncated": false,
"file_size_bytes": 2215244,
"checked_at": "2026-11-17T03:53:42+00:00"
}連携方法
この App は MCP、API、SDK、ファイルエクスポートのいずれでも連携でき、どのチャネルも同じ能力と料金を共有します。すべてのリクエストは Authorization: Bearer ヘッダーで認証し、認証情報には API Key(長期有効。Data Hub コンソールで作成)を使用します。MCP クライアントは OAuth によるキー不要のログインにも対応しています。CLI や Skill など、さらに多くの連携方法も準備中です。 この App は非同期で実行され、途中でキャンセルできます:キャンセル後、実行は停止します。納品済みのレコードは保持され、課金対象になります。
MCP(Model Context Protocol)を使うと、Claude や Cursor などの AI クライアントからこの App を直接呼び出せます。クライアントと認証方式を選び、下の設定をコピーしてください。
クライアント設定
Bearer の後の値を長期有効な API Key に置き換えてください。あらゆるクライアント、CI、ヘッドレス環境で利用できます。
{
"mcpServers": {
"octoparse_datahub": {
"type": "http",
"url": "https://mcp-v2.octoparse.com?pin=MagicData/pdf-to-markdown",
"headers": { "Authorization": "Bearer <YOUR_API_KEY>" }
}
}
}AI に設定を任せる
設定を手作業で編集したくない場合は、インストールプロンプトをコピーして任意の AI クライアントに貼り付けてください。AI が自分のやり方でセットアップを完了します(デフォルトではログインを案内し、API Key をチャットに送るよう求めることはありません)。
detail.access.mcp.composeHint
料金
出力フィールド billed_pdfs の合計で計量されます。失敗した実行には課金されません。
複数の課金イベントはそれぞれ独立して累計されます。詳細は各項目をご覧ください。失敗した実行には課金されません。
Credits を確認今すぐ試す
パラメータを入力して実行してください。結果は実際の呼び出しによるものです。