Crucible

Autonomous Research Engine

Raw sources in. Refined intelligence out.

Crucible discovers, evaluates, and curates knowledge from across the web into your private intelligence vault.

Start for freeView pricing

Integrates with

ObsidianOllamaOpenAIAnthropicarXivBrave SearchSearXNGDuckDuckGoHugging FaceLangChainPlaywrightMarkdownYAMLRSSFREDEIAMistralLM StudioGitNexusMiroFishJupyterTableauObsidianOllamaOpenAIAnthropicarXivBrave SearchSearXNGDuckDuckGoHugging FaceLangChainPlaywrightMarkdownYAMLRSSFREDEIAMistralLM StudioGitNexusMiroFishJupyterTableau

Capabilities

Built for serious research

Every component designed for autonomous intelligence gathering at scale.

Autonomous Research

The AI director plans search queries, scrapes pages, evaluates relevance, and connects documents without intervention.

Multi-Source Intelligence

DuckDuckGo, Brave, SearXNG, RSS feeds, arXiv, government data APIs, and full PDF extraction in one pipeline.

Knowledge Graph

Typed relationship edges between documents. Traverse causal chains, temporal sequences, and thematic clusters.

Vault Curator

Background agent that recategorizes, audits quality scores, surfaces connections, and flags stale content.

Local or Cloud AI

Run privately with Ollama on your GPU, or use OpenAI and Anthropic APIs. Per-step model overrides for cost control.

Private Vault

Markdown files with YAML frontmatter in an Obsidian-compatible vault. Your data never leaves your machine.


How it works

Three steps to intelligence

1

Configure

Define your topics, choose an AI provider, and set your research templates.

2

Research

Crucible searches, scrapes, and evaluates sources across the open web.

3

Refine

Documents are scored, categorized, and woven into your knowledge graph.

All without lifting a finger.


Why Crucible

AI chatbots answer questions. Crucible builds intelligence.

ChatGPT and Claude are powerful — for conversations. But research isn't a conversation. It's an accumulating asset.

AI ChatbotsCrucible
OutputA chat log you'll never rereadA growing, searchable knowledge vault
SourcesWhatever the model remembers or hallucinatesReal documents from real URLs, scored for quality
PersistenceGone when you close the tabPermanent local files you own forever
ScaleOne prompt at a time, one answer at a timeAutonomous multi-source sweeps across the web
StructureFlat text in a conversation threadKnowledge graph with typed relationships
AccumulationEvery session starts from zeroEach cycle builds on everything before it

Research isn't a question you ask.
It's a system you build.

?

“But what about Perplexity? It searches the web too.”

AI search tools like Perplexity give you a better answer — sourced, cited, and polished. But it's still a single answer to a single question that lives in a chat log. Crucible doesn't answer your question. It builds an autonomous research pipeline that searches dozens of sources, scores what it finds, stores original documents with full provenance, and weaves them into a knowledge graph you own. Next week, it runs again — and your vault is deeper than before. Perplexity gives you a fish. Crucible builds the fishery.

AI tools give you an answer and move on. Crucible gives you a system that gets smarter every time it runs.


FAQ

Common questions

Crucible is an autonomous AI research engine. You define topics of interest, and it searches the web, scrapes documents, evaluates their relevance, and organizes everything into a private Obsidian-compatible knowledge vault, all without manual intervention.

All documents are stored locally as markdown files with YAML frontmatter in an Obsidian-compatible vault on your machine. Your data never leaves your device unless you choose a cloud AI provider for processing.

Yes. Crucible supports Ollama for fully private local inference on your own GPU, as well as OpenAI and Anthropic cloud APIs. You can configure different models per pipeline step to balance cost and quality.

Depending on your plan: DuckDuckGo, Brave Search, SearXNG (meta-search across dozens of engines), RSS feeds, arXiv academic papers, government data APIs (FRED, EIA), and direct PDF extraction.

Available on the Pro plan, the Vault Curator is a background AI agent that continuously maintains your vault by recategorizing documents, auditing quality scores, detecting duplicates, surfacing cross-document connections, and flagging stale content.

Only if you want to run AI models locally with Ollama. If you use OpenAI or Anthropic cloud APIs instead, no GPU is required. The research pipeline itself runs on any modern computer.

Yes. The free tier includes manual collection triggers, up to 50 documents per cycle, DuckDuckGo search, a basic vault browser, and a single LLM provider. No credit card required.

Search engines return links. Crucible goes further: it reads the pages, evaluates their quality, extracts key information, stores structured documents in your vault, and builds a knowledge graph of relationships between them. It's research automation, not just search.

AI chatbots are great at answering questions, but they give you a conversation, not a system. Every session starts from scratch, sources are unverifiable, and the output disappears into a chat log you'll never revisit. Crucible is research infrastructure: it autonomously searches real sources, verifies and scores what it finds, stores original documents with full provenance, and builds a permanent knowledge graph that compounds over time. You're not getting a summary from a model's memory. You're building an intelligence asset you own.

AI search tools are a step closer. They cite real sources and give better answers. But they're still one question, one answer, one session. You don't accumulate anything. Crucible runs autonomous research sweeps across dozens of sources simultaneously, stores every document it finds, scores and categorizes them, deduplicates across runs, and builds a knowledge graph that grows with every cycle. It's the difference between asking a librarian a question and building your own library.

Yes. Crucible stores documents as standard markdown with YAML frontmatter, fully compatible with Obsidian. You can point Crucible at an existing vault directory and it will integrate alongside your existing notes.

Research analysts use Crucible for competitive intelligence and market monitoring. Data scientists use it to aggregate training data and track papers. Prediction market traders use it to build information edges from diverse sources. Hobbyists use it to curate knowledge on any topic they're passionate about. Anyone doing serious research across multiple sources benefits from automated collection and organization.

Crucible focuses on the collection and organization layer: gathering raw data from the web into structured, queryable documents. It pairs well with analysis tools like Jupyter, Tableau, or custom scripts. The knowledge graph and structured metadata make it easy to export curated datasets for downstream analysis, modeling, or simulation work.


ObsidianOllamaOpenAIAnthropicarXivBrave SearchSearXNGDuckDuckGoHugging FaceLangChainPlaywrightMarkdownYAMLRSSFREDEIAMistralLM StudioGitNexusMiroFishJupyterTableauObsidianOllamaOpenAIAnthropicarXivBrave SearchSearXNGDuckDuckGoHugging FaceLangChainPlaywrightMarkdownYAMLRSSFREDEIAMistralLM StudioGitNexusMiroFishJupyterTableau