>i vdZddlmZddlmZmZddlmZmZddl m Z ddl m Z m Z GddeZ d d Zy ) z;ExtractionModel base class for declarative data extraction.) annotations)ClassVarOptional) BaseModel ConfigDict)InvalidExtractionModel)ExtractionMetadatapop_field_metadatacDeZdZUdZdZded<edZeddZ y) ExtractionModela~Base class for declarative extraction models. Inherits from pydantic.BaseModel, gaining automatic validation, type coercion, serialization (model_dump, model_dump_json), and JSON Schema generation (model_json_schema). Subclasses define fields using Field() descriptors with selectors and/or semantic descriptions. The extraction engine uses this metadata to extract structured data from web pages. Example:: class Article(ExtractionModel): title: str = Field(selector='h1', description='Article title') author: str = Field(selector='.author', description='Author name') Nz1ClassVar[Optional[dict[str, ExtractionMetadata]]]_extraction_fields_cacheT)arbitrary_types_allowedch|jjd}||St|}||_|S)aGet extraction metadata for all fields, collecting lazily on first access. Each subclass gets its own cache, even if a parent class has already been collected. This ensures inherited fields are included correctly. Returns: Dictionary mapping field name to ExtractionMetadata. Raises: InvalidExtractionModel: If a field has metadata but lacks both selector and description. r )__dict__get_collect_extraction_metadatar )cls own_cacheresults \/var/www/python/tenders/Scrapper/venv/lib/python3.12/site-packages/pydoll/extractor/model.pyget_extraction_fieldsz%ExtractionModel.get_extraction_fields#s<LL$$%?@   -c2'-$ )returndict[str, ExtractionMetadata]) __name__ __module__ __qualname____doc__r __annotations__r model_config classmethodrrrr r s3"SWOVd;Lrr c@i}|jjD]~\}}|j}t|ts#|j d}t|t sEt|}|S|js|jstd|d|||<|S)aRead ExtractionMetadata from pydantic FieldInfo objects via registry. For each field, checks if json_schema_extra contains an _extraction_key that maps to a registered ExtractionMetadata. Validates that each extraction field has at least a selector or a description. Args: cls: ExtractionModel subclass to inspect. Returns: Dictionary mapping field name to ExtractionMetadata. Raises: InvalidExtractionModel: If a field has metadata but lacks both selector and description. _extraction_keyzField "z0" must have at least a selector or a description) model_fieldsitemsjson_schema_extra isinstancedictrintr has_selector descriptionr)rrname field_infoextrakeymetadatas rrr;s&-/F,,224 j,,%& ii)*#s# %c*   $$Z-C-C($OP  t % & MrN)rztype[ExtractionModel]rr)r __future__rtypingrrpydanticrrpydoll.extractor.exceptionsrpydoll.extractor.fieldr r r rr"rrr7s9A"%*>I+i+\' '"'r