Crucible

Autonomous Research Engine

Raw sources in. Refined intelligence out.

Crucible discovers, evaluates, and curates knowledge from across the web into your private intelligence vault.

Start for freeView pricing

Integrates with

ObsidianOllamaOpenAIAnthropicarXivBrave SearchSearXNGDuckDuckGoHugging FaceLangChainPlaywrightMarkdownYAMLRSSFREDEIAMistralLM StudioGitNexusMiroFishJupyterTableauObsidianOllamaOpenAIAnthropicarXivBrave SearchSearXNGDuckDuckGoHugging FaceLangChainPlaywrightMarkdownYAMLRSSFREDEIAMistralLM StudioGitNexusMiroFishJupyterTableau

Capabilities

Built for serious research

Every component designed for autonomous intelligence gathering at scale.

Autonomous Research

The AI director plans search queries, scrapes pages, evaluates relevance, and connects documents without intervention.

Multi-Source Intelligence

DuckDuckGo, Brave, SearXNG, RSS feeds, arXiv, government data APIs, and full PDF extraction in one pipeline.

Knowledge Graph

Typed relationship edges between documents. Traverse causal chains, temporal sequences, and thematic clusters.

Vault Curator

Background agent that recategorizes, audits quality scores, surfaces connections, and flags stale content.

Local or Cloud AI

Run privately with Ollama on your GPU, or use OpenAI and Anthropic APIs. Per-step model overrides for cost control.

Private Vault

Markdown files with YAML frontmatter in an Obsidian-compatible vault. Your data never leaves your machine.


How it works

Three steps to intelligence

01

Configure

Define your topics, choose an AI provider, and set your research templates.

02

Research

Crucible searches, scrapes, and evaluates sources across the open web.

03

Refine

Documents are scored, categorized, and woven into your knowledge graph.

All without lifting a finger.


FAQ

Common questions

Crucible is an autonomous AI research engine. You define topics of interest, and it searches the web, scrapes documents, evaluates their relevance, and organizes everything into a private Obsidian-compatible knowledge vault -- without manual intervention.

All documents are stored locally as markdown files with YAML frontmatter in an Obsidian-compatible vault on your machine. Your data never leaves your device unless you choose a cloud AI provider for processing.

Yes. Crucible supports Ollama for fully private local inference on your own GPU, as well as OpenAI and Anthropic cloud APIs. You can configure different models per pipeline step to balance cost and quality.

Depending on your plan: DuckDuckGo, Brave Search, SearXNG (meta-search across dozens of engines), RSS feeds, arXiv academic papers, government data APIs (FRED, EIA), and direct PDF extraction.

Available on the Pro plan, the Vault Curator is a background AI agent that continuously maintains your vault -- recategorizing documents, auditing quality scores, detecting duplicates, surfacing cross-document connections, and flagging stale content.

Only if you want to run AI models locally with Ollama. If you use OpenAI or Anthropic cloud APIs instead, no GPU is required. The research pipeline itself runs on any modern computer.

Yes. The free tier includes manual collection triggers, up to 50 documents per cycle, DuckDuckGo search, a basic vault browser, and a single LLM provider. No credit card required.

Search engines return links. Crucible goes further -- it reads the pages, evaluates their quality, extracts key information, stores structured documents in your vault, and builds a knowledge graph of relationships between them. It's research automation, not just search.

Yes. Crucible stores documents as standard markdown with YAML frontmatter, fully compatible with Obsidian. You can point Crucible at an existing vault directory and it will integrate alongside your existing notes.

Research analysts use Crucible for competitive intelligence and market monitoring. Data scientists use it to aggregate training data and track papers. Prediction market traders use it to build information edges from diverse sources. Hobbyists use it to curate knowledge on any topic they're passionate about. Anyone doing serious research across multiple sources benefits from automated collection and organization.

Crucible focuses on the collection and organization layer -- gathering raw data from the web into structured, queryable documents. It pairs well with analysis tools like Jupyter, Tableau, or custom scripts. The knowledge graph and structured metadata make it easy to export curated datasets for downstream analysis, modeling, or simulation work.


ObsidianOllamaOpenAIAnthropicarXivBrave SearchSearXNGDuckDuckGoHugging FaceLangChainPlaywrightMarkdownYAMLRSSFREDEIAMistralLM StudioGitNexusMiroFishJupyterTableauObsidianOllamaOpenAIAnthropicarXivBrave SearchSearXNGDuckDuckGoHugging FaceLangChainPlaywrightMarkdownYAMLRSSFREDEIAMistralLM StudioGitNexusMiroFishJupyterTableau