- Lane A — local crawlers (bulk + private). The
*crawlfamily archives each platform into local SQLite; DuckBrain attaches the archive read-only and maps it in. Crawlers install automatically from theinitplatform picker. - Lane B — SaaS connectors (incremental). Pipedream/Composio behind one proxy-first interface, for sources with no local crawler (Gmail, Calendar). Backfills prefer provider-native exports (e.g. Google Takeout) over API crawls.
Ingest Sources
Sources Overview
Sources Overview → DuckBrain ingest (Reference)
Status: Reference
DuckBrain ingests through two lanes, both landing in the same bronze envelope: