graphai.api.scraping.schemas module

class graphai.api.scraping.schemas.GetSublinksRequest(*, url: str, force: bool = False)

Bases: BaseModel

url: str

force: bool

model_config: ClassVar[ConfigDict] = {}

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].

class graphai.api.scraping.schemas.GetSublinksTaskResponse(*, token: str | None = None, validated_url: str | None = None, sublinks: List[str] | None = None, status_msg: str, successful: bool, fresh: bool)

Bases: BaseModel

token: str | None

validated_url: str | None

sublinks: List[str] | None

status_msg: str

successful: bool

fresh: bool

model_config: ClassVar[ConfigDict] = {}

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].

class graphai.api.scraping.schemas.GetSublinksResponse(*, task_id: str, task_name: str | None = None, task_status: str, task_result: GetSublinksTaskResponse | None)

Bases: TaskStatusResponse

task_result: GetSublinksTaskResponse | None

model_config: ClassVar[ConfigDict] = {}

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].

class graphai.api.scraping.schemas.ExtractContentRequest(*, url: str, force: bool = False, remove_headers: bool = False, remove_long_patterns: bool = False)

Bases: GetSublinksRequest

remove_headers: bool

remove_long_patterns: bool

model_config: ClassVar[ConfigDict] = {}

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].

class graphai.api.scraping.schemas.ExtractContentTaskResponse(*, token: str | None = None, validated_url: str | None = None, sublinks: List[str] | None = None, status_msg: str, successful: bool, fresh: bool, data: Dict[str, Dict[str, str | None]] | None = None)

Bases: GetSublinksTaskResponse

data: Dict[str, Dict[str, str | None]] | None

model_config: ClassVar[ConfigDict] = {}

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].

class graphai.api.scraping.schemas.ExtractContentResponse(*, task_id: str, task_name: str | None = None, task_status: str, task_result: ExtractContentTaskResponse | None)

Bases: TaskStatusResponse

task_result: ExtractContentTaskResponse | None

model_config: ClassVar[ConfigDict] = {}

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].