Search the web from a natural-language request and return relevance-ranked webpage results with content and source metadata
Data Hub Content Search
Search Data Hub content with a phrase and filters, then return matching page records with source metadata and content text.
概要
Data Hub Content Search turns a complete phrase into a structured page of matching content records. It brings together the result title, text, summary, source details, publication timing, and URLs so research teams can move from a topic to evidence without manually opening every search result.
The search is useful for monitoring a phrase across public content sources, collecting a reproducible result set, and comparing what different sources publish about the same topic. Filters for time, domain, account, and organization help narrow the result set to the slice that matters.
Data notes
Each record comes from the Data Hub content search index and represents one matched content result. Results are returned in the requested page order, while the search response also reports the estimated total number of matches. Some source metadata, cached links, classification flags, and full content fields can be missing, so those values may be null. The original URL, display URL, snippet, summary, and full content are separate fields and should not be treated as interchangeable.
The search matches the complete phrase against content titles and summaries. It can restrict results to included domains, remove excluded domains, and apply exact account or organization filters. The returned language and timestamps follow the source values; the API documentation does not define a common timezone for those timestamps.
What the results look like
Each row represents one content result:
| Result ID | Content title | Source site | Publication time | Content text | Original URL |
|---|---|---|---|---|---|
| 0 | 小米汽车交付节奏持续提升 | Example Site | 2026-08-16 14:23:10 | 小米汽车近期交付节奏持续提升。数据显示,相关门店试驾热度上升,交付安排正在稳步推进。 | https://www.example.com/article/123 |
| 1 | 新能源汽车销量观察 | Industry News | 2026-08-15 10:05:00 | 新能源汽车市场的月度销量变化受到多项因素影响。 | https://www.example.com/article/456 |
Additional fields include account and organization names, crawl time, language, snippets, summaries, display URLs, cached page URLs, site icons, and source classification flags.
Use cases
- For topic monitoring, compare “Content title”, “Publication time”, and “Original URL” across repeated searches to identify newly published coverage.
- For source research, group “Source site”, “Account name”, and “Organization name” to see which publishers contribute to a topic.
- For evidence review, read “Content text”, “Short snippet”, and “Content summary” together, then use “Display URL” or “Original URL” to open the source page.
適用範囲と境界
Each call returns one page of up to 200 matching content records. Pages 1 through 50 can be requested, covering at most 10,000 records per search.
- 適している用途
- When you need matching Data Hub content for a complete phrase, topic, brand, or event.
- When you need content titles, summaries, source details, publication times, and URLs for monitoring or research.
- 適さない用途
- When you need more than 10,000 matches from one search.
- When you need unrestricted full-text crawling beyond the records returned by Data Hub search.
失敗時の処理
開発者が宣言した失敗時と再試行の動作です。連携時にはシステムプロンプトに含めることをおすすめします。
- 1An empty result list means that no content matched the phrase and filters; broaden the phrase or remove a restrictive filter.
- 2For authentication or authorization errors, verify the API Key configured for the execution environment before retrying.
- 3For rate-limit or temporary service errors, retry later without changing the search unless the error persists.
入力
この App の呼び出しに必要なパラメータで、manifest.json の input.schema から生成されています。
- Search phrase
keyword必須stringRequired complete phrase matched against content titles and summaries. Do not leave it empty.例iphone - Publication time range
freshness任意stringLimit results to a relative period such as oneMonth, a YYYY-MM-DD date, or a YYYY-MM-DD..YYYY-MM-DD date range. The default noLimit searches without a time limit.デフォルトnoLimit - Included domains
include任意stringOnly return results from these domains. Separate multiple domains with | or ,; leave empty to include all domains. - Excluded domains
exclude任意stringExclude results from these domains. Separate multiple domains with | or ,; leave empty to exclude none. - Account name
account_name任意stringFilter for an exact content account name; leave empty to use no account filter. - Organization name
office_name任意stringFilter for an exact organization name; leave empty to use no organization filter. - Result page
page任意integerPage number to retrieve. Pages are 200 records each; page 1 is the first page and page 50 is the last page within the 10,000-record search limit.範囲1–50デフォルト1 - Sort field
sort_field任意string(enum)Field used to order results. The default publishTime shows the newest published content first when paired with the default descending order.選択可能な値publishTimecrawlerTimeidcleanUpdateTimeデフォルトpublishTime - Sort direction
sort_order任意string(enum)Use ascending or descending order for the selected sort field. The default desc returns the newest or largest values first.選択可能な値ascdescデフォルトdesc
出力
1 件のレコードのフィールド構造で、manifest.json の output.schema から生成されています。
- Account name
account_namestringName of the account associated with the content; may be null when the source does not provide one.例China News Network - Cached page URL
cached_page_urlstringURL of a cached version of the page when available; the source may return null. - Content text
contentstringFull content text when available. It is independent from snippet and summary and may be null.例小米汽车近期交付节奏持续提升。数据显示,相关门店试驾热度上升,交付安排正在稳步推进。 - Last crawled time
date_last_crawledstringMost recent crawl timestamp in the source format; may be null.例2026-08-17 09:12:30
サンプルデータ
output.schema から生成したサンプルです。サンプル値のないフィールドには構造上のプレースホルダーを使用しています。
{
"account_name": "China News Network",
"cached_page_url": "<cached_page_url>",
"content": "小米汽车近期交付节奏持续提升。数据显示,相关门店试驾热度上升,交付安排正在稳步推进。",
"date_last_crawled": "2026-08-17 09:12:30",
"date_published": "2026-08-16 14:23:10",
"display_url": "https://www.example.com/article/123",
"id": "0",
"is_family_friendly": false,
"is_navigational": false,
"language": "zh",
"name": "小米汽车交付节奏持续提升",
"office_name": "<office_name>",
"site_icon": "<site_icon>",
"site_name": "Example Site",
"snippet": "小米汽车近期交付节奏持续提升。",
"summary": "小米汽车近期交付节奏持续提升,相关门店试驾热度上升。",
"url": "https://www.example.com/article/123"
}連携方法
この App は MCP、API、SDK、ファイルエクスポートのいずれでも連携でき、どのチャネルも同じ能力と料金を共有します。すべてのリクエストは Authorization: Bearer ヘッダーで認証し、認証情報には API Key(長期有効。Data Hub コンソールで作成)を使用します。MCP クライアントは OAuth によるキー不要のログインにも対応しています。CLI や Skill など、さらに多くの連携方法も準備中です。
MCP(Model Context Protocol)を使うと、Claude や Cursor などの AI クライアントからこの App を直接呼び出せます。クライアントと認証方式を選び、下の設定をコピーしてください。
クライアント設定
Bearer の後の値を長期有効な API Key に置き換えてください。あらゆるクライアント、CI、ヘッドレス環境で利用できます。
{
"mcpServers": {
"octoparse_datahub": {
"type": "http",
"url": "https://mcp-v2.octoparse.com?pin=meme_today/data-hub-content-search",
"headers": { "Authorization": "Bearer <YOUR_API_KEY>" }
}
}
}AI に設定を任せる
設定を手作業で編集したくない場合は、インストールプロンプトをコピーして任意の AI クライアントに貼り付けてください。AI が自分のやり方でセットアップを完了します(デフォルトではログインを案内し、API Key をチャットに送るよう求めることはありません)。
detail.access.mcp.composeHint
料金
正常に返されたレコードの件数に応じて課金されます。失敗した実行には課金されません。 20 件を 1 つの課金単位とし、端数は 20 件に切り上げて課金されます。
複数の課金イベントはそれぞれ独立して累計されます。詳細は各項目をご覧ください。失敗した実行には課金されません。
Credits を確認今すぐ試す
パラメータを入力して実行してください。結果は実際の呼び出しによるものです。