Decision procedure for an agent deciding whether to pay for structured NLP extraction (diffbot-style entity, sentiment,

Decision procedure for an agent deciding whether to pay for structured NLP extraction (diffbot-style entity, sentiment, and relation extraction) versus free regex or heuristic parsing versus inline LLM extraction. Ordered workflow: score the document batch by structure need tier (0 plain text search is enough, 1 named entities needed, 2 typed relations and entity graphs needed, 3 cross-document entity resolution needed), estimate per-document cost on each rail in USDC, compare against an inline