graphai.core.common.lookup module

graphai.core.common.lookup.lookup_latest_allowed_date(fp_tokens, db_manager)

graphai.core.common.lookup.fingerprint_lookup_retrieve_from_db(results, db_manager, equality_conditions=None)

Retrieves the number of cache rows relevant to fingerprint lookup :param results: Dict containing results of fingerprint computation :param db_manager: DBCachingManagerBase object :param equality_conditions: Dictionary of equality conditions for fingerprint counting. Only used for translation,

System Message: ERROR/3 (/data/actions-runner/_work/graphai/graphai/main/graphai/core/common/lookup.py:docstring of graphai.core.common.lookup.fingerprint_lookup_retrieve_from_db, line 5)

Unexpected indentation.

where the lookup needs to be done only among cached rows with the same source and target langs.

Returns:

Dict of original results plus the number of relevant cache rows.

graphai.core.common.lookup.fingerprint_lookup_parallel(input_dict, i, n_total, min_similarity, db_manager, data_type='audio', equality_conditions=None)

Performs parallel lookup of fingerprints :param input_dict: Dict of results from previous step :param i: The index of this parallel task :param n_total: Total number of parallel tasks :param min_similarity: Minimum similarity threshold for two fingerprints to be considered a match :param db_manager: DBCachingManagerBase object :param data_type: Type of data. Can be ‘audio’, ‘video’, ‘image’, and ‘text’ :param equality_conditions: Equality conditions dict, only used for translation (‘text’ mode)

Returns:

Dict with fingerprinting results, plus details of the closest match (which can be None)

graphai.core.common.lookup.fingerprint_lookup_direct(fp_results, db_manager, equality_conditions=None)

graphai.core.common.lookup.fingerprint_lookup_callback(results_list, db_manager)

Handles the collection and aggregation of parallel fingerprint lookup results, plus database insertion. :param results_list: List of parallel fingerprint lookup results :param db_manager: DBCachingManagerBase object

Returns:

Results of fingerprinting and the closest match

graphai.core.common.lookup.retrieve_fingerprint_callback(results, db_manager, has_origin=True)

graphai.core.common.lookup.add_token_status_to_results(results, token_status_func)

graphai.core.common.lookup.ignore_fingerprint_results_callback(results, token_status_func)

graphai.core.common.lookup.is_fingerprinted(token, db_manager)

graphai.core.common.lookup.fingerprint_cache_lookup(token, db_manager)

graphai.core.common.lookup.fingerprint_cache_lookup_with_most_similar(token, db_manager, extra_cols=None)

graphai.core.common.lookup.cache_lookup_generic(token, db_manager, cols)

graphai.core.common.lookup.database_callback_generic(token, db_manager, values_dict, force=False, use_closest_match=False)

graphai.core.common.lookup.token_based_text_lookup(token, db_manager, main_col, modify_result_func=None, modify_result_args=None, **kwargs)

graphai.core.common.lookup.fingerprint_based_text_lookup(token, fp, db_manager, main_col, extra_cols, equality_conditions, modify_result_func=None, modify_result_args=None, **kwargs)