a vK6dŸã@s0ddlmZmZmZmZmZdd„Zdd„ZdS)é)Ú AutoTokenizerÚ BertModelÚ BertTokenizerÚ RobertaModelÚRobertaTokenizerFastcCsbt|tƒsFt|dƒr|j}n*| dd¡r4| d¡}ntd t|ƒ¡ƒ‚td |¡ƒt   |¡}|S)NÚtext_encoder_typeFz%Unknown type of text_encoder_type: {}zfinal text_encoder_type: {}) Ú isinstanceÚstrÚhasattrrÚgetÚ ValueErrorÚformatÚtypeÚprintrÚfrom_pretrained)rÚ tokenizer©rú–/mnt/e/Liuyz_DL_and_ML/jupyter_notebook/python_CVs/Grounded-Segment-Anything_huggingface_yizhangliu/GroundingDINO/groundingdino/util/get_tokenlizer.pyÚget_tokenlizers     ÿ rcCs6|dkrt |¡S|dkr$t |¡Std |¡ƒ‚dS)Nzbert-base-uncasedz roberta-basezUnknown text_encoder_type {})rrrr r )rrrrÚget_pretrained_language_models   rN)Ú transformersrrrrrrrrrrrÚs